-- Logs begin at Thu 2022-06-23 10:11:02 UTC, end at Thu 2022-06-23 11:25:16 UTC. -- Jun 23 10:48:22.268811 dv-cinder-826607-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 23 10:48:22.277413 dv-cinder-826607-6-smb devstack@keystone.service[75616]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 23 10:48:22.279409 dv-cinder-826607-6-smb devstack@keystone.service[75616]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 10:48:22 2022] *** Jun 23 10:48:22.279409 dv-cinder-826607-6-smb devstack@keystone.service[75616]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 10:48:22.279409 dv-cinder-826607-6-smb devstack@keystone.service[75616]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 10:48:22.279409 dv-cinder-826607-6-smb devstack@keystone.service[75616]: nodename: dv-cinder-826607-6-smb Jun 23 10:48:22.279409 dv-cinder-826607-6-smb devstack@keystone.service[75616]: machine: x86_64 Jun 23 10:48:22.279409 dv-cinder-826607-6-smb devstack@keystone.service[75616]: clock source: unix Jun 23 10:48:22.279409 dv-cinder-826607-6-smb devstack@keystone.service[75616]: pcre jit disabled Jun 23 10:48:22.279409 dv-cinder-826607-6-smb devstack@keystone.service[75616]: detected number of CPU cores: 4 Jun 23 10:48:22.279409 dv-cinder-826607-6-smb devstack@keystone.service[75616]: current working directory: / Jun 23 10:48:22.279409 dv-cinder-826607-6-smb devstack@keystone.service[75616]: detected binary path: /usr/bin/uwsgi-core Jun 23 10:48:22.279409 dv-cinder-826607-6-smb devstack@keystone.service[75616]: your processes number limit is 47680 Jun 23 10:48:22.280141 dv-cinder-826607-6-smb devstack@keystone.service[75616]: your memory page size is 4096 bytes Jun 23 10:48:22.280141 dv-cinder-826607-6-smb devstack@keystone.service[75616]: detected max file descriptor number: 2048 Jun 23 10:48:22.280141 dv-cinder-826607-6-smb devstack@keystone.service[75616]: lock engine: pthread robust mutexes Jun 23 10:48:22.280141 dv-cinder-826607-6-smb devstack@keystone.service[75616]: thunder lock: enabled Jun 23 10:48:22.280141 dv-cinder-826607-6-smb devstack@keystone.service[75616]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 23 10:48:22.280141 dv-cinder-826607-6-smb devstack@keystone.service[75616]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 10:48:22.324408 dv-cinder-826607-6-smb devstack@keystone.service[75616]: Python main interpreter initialized at 0x55f66f60b9c0 Jun 23 10:48:22.324408 dv-cinder-826607-6-smb devstack@keystone.service[75616]: python threads support enabled Jun 23 10:48:22.324408 dv-cinder-826607-6-smb devstack@keystone.service[75616]: your server socket listen backlog is limited to 100 connections Jun 23 10:48:22.324408 dv-cinder-826607-6-smb devstack@keystone.service[75616]: your mercy for graceful operations on workers is 90 seconds Jun 23 10:48:22.324773 dv-cinder-826607-6-smb devstack@keystone.service[75616]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 10:48:22.324849 dv-cinder-826607-6-smb devstack@keystone.service[75616]: *** Operational MODE: preforking *** Jun 23 10:48:22.325109 dv-cinder-826607-6-smb devstack@keystone.service[75616]: *** uWSGI is running in multiple interpreter mode *** Jun 23 10:48:22.325109 dv-cinder-826607-6-smb devstack@keystone.service[75616]: spawned uWSGI master process (pid: 75616) Jun 23 10:48:22.325323 dv-cinder-826607-6-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 23 10:48:22.327687 dv-cinder-826607-6-smb devstack@keystone.service[75616]: spawned uWSGI worker 1 (pid: 75629, cores: 1) Jun 23 10:48:22.327687 dv-cinder-826607-6-smb devstack@keystone.service[75616]: spawned uWSGI worker 2 (pid: 75630, cores: 1) Jun 23 10:48:22.327687 dv-cinder-826607-6-smb devstack@keystone.service[75616]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 10:48:27.913691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:48:27.913691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: from cryptography.utils import int_from_bytes Jun 23 10:48:27.914492 dv-cinder-826607-6-smb devstack@keystone.service[75629]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:48:27.914492 dv-cinder-826607-6-smb devstack@keystone.service[75629]: from cryptography.utils import int_from_bytes Jun 23 10:48:27.918563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:48:27.918563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: from cryptography.utils import int_from_bytes Jun 23 10:48:27.919049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 10:48:27.919049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: from cryptography.utils import int_from_bytes Jun 23 10:48:27.967697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 10:48:27.967912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 10:48:27.968110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] command line args: [] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 10:48:27.968385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 10:48:27.969102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ================================================================================ {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 10:48:27.969360 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] admin_token = **** {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.969610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] config_dir = [] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.969800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.969984 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] config_source = [] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.970165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] debug = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.970364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.971741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.971741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] insecure_debug = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.971741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.971741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.971741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] list_limit = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.972162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] log_config_append = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.972162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.972162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] log_dir = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.972324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] log_file = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.972528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.972781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.973030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.973284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.973465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.973645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.973891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.974139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.974374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.974614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.974846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.975081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.975325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.975576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] notification_format = cadf {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.975871 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.976362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.976549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] publish_errors = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.976783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.977013 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.977193 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.977271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 10:48:27.977424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 10:48:27.977512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.977622 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] command line args: [] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 10:48:27.977707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.977884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] standard_threads = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.977967 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 10:48:27.978071 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ================================================================================ {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 10:48:27.978158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] strict_password_check = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.978339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] admin_token = **** {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.978423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.978500 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] use_eventlog = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.978574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] config_dir = [] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.978680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] use_journal = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.979058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.979140 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] use_json = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.979216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] config_source = [] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.979292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] use_stderr = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.979372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] debug = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.979452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] use_syslog = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.979550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.979659 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] watch_log_file = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.979790 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.979928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.980025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] insecure_debug = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.980172 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.980323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.980435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.980590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.980668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.980826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] list_limit = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.980914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.980992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] log_config_append = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.981138 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.981216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.981338 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] log_dir = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.981420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.981501 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] log_file = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.981615 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.981729 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.981865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.981971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.982116 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.982196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.982368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.982453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.982603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.982692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.982772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.982849 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.983009 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.983088 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.983258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.983340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.983477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.983558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.983713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.983791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.983970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.984056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.984238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.984837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.985020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.985105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.985271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] notification_format = cadf {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.985356 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.985548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.985633 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.985810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.986049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.52/identity {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.986137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.986276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] publish_errors = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.986355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.986517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.986605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.986748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.986886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.986960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.987036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.987167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.987258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.987403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.987482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.987640 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] standard_threads = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.987718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.987898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] strict_password_check = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.987997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.988140 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.988224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.988316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] use_eventlog = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.988399 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.988495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] use_journal = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.988626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.988712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] use_json = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.988837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] use_stderr = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.988919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.989015 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] use_syslog = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.989092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.989240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] watch_log_file = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 10:48:27.989319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.989492 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.989571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.989740 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.989823 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.989986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.990064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.990219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.990303 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.990452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.990530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.990685 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.990765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.990921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.991005 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.991159 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.991242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.991390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.991467 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.991674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.991880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.991956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.992093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.992174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.992245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.992395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.992479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.992648 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.992738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.992884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.992963 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.993125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.993238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.993364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.993456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.993601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.993679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.993838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.993923 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.994075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.994191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.994310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.994424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.994563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.994675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.994807 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.994927 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.995032 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.995138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.995266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.995355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.995525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.995620 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.995760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.995915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.996018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.996096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.996253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.996341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.996490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.996618 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.996751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.996830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.996987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.997068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.997220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.997309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.997467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.997548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.997704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.997830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.997941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.998020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.998177 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.998254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.998423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.998510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.enabled = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.998659 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.998738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.998895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.998983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.999143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.999256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.999482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.999595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.999856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:27.999856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.000082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.005654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.005747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.005830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.005903 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.005979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006350 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006635 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006848 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006907 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.006971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.007104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.007189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.007268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.007340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.007409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.007478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.007547 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.007615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.007693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.007769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.007947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008336 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008464 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008906 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.008975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] auth.external = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009206 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] auth.mapped = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009487 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] auth.password = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] auth.token = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.009937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010078 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] catalog.caching = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.enabled = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010722 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010793 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.010995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.011111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] credential.caching = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.011186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.011256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] credential.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.011335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.011396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.011466 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.011536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.011604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.011680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.011759 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.011886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.011966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012595 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012710 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.012956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013013 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013140 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] federation.caching = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] federation.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013918 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.013978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.014036 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.014094 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.014151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.014208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.014286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.014346 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.014409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.014509 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.014569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] auth.external = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.014728 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.014877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] auth.mapped = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.014941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.015000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.015061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.caching = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.015119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.015177 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.015243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] auth.password = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.015309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.015368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] auth.token = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.015488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.015599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.015735 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.015884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] catalog.caching = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.016011 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.016092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.016246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.016315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.016484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.016598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.016738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.016815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.016971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.017039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.017217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.017307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] credential.caching = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.017450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.017570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] credential.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.017688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.017830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.017934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.018183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.018383 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.018452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.018638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.018714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.018886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.018957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.019124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.019194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.019397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.019464 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.019635 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.019706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.019895 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.019969 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.020139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.020207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.020371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.020443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.020611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.020680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.020853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.020921 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.021095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.021166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.021345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.021414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.021579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.021656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] federation.caching = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.021827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.021897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.022076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.022152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] federation.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.022314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.022745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.022889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.022991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.023071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.023144 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.023222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.023295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.023377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.023449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.023519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.password = **** {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.023588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.023682 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.023827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.023951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.024078 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.024198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.024325 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.024438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.024553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.caching = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.024678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.024806 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.024929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.025057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.025187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.025295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.025435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.025554 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.025654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.025768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.025904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.026003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.026155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.026238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.026390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.026470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.026627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.026726 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.026864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.026947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.027097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.027177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.027343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.027453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.027610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.027709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.027861 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.027948 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.028113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.028193 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.030988 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.031580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.031645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.031703 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.031842 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.031920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032150 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032290 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032417 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032635 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.032931 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033144 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033813 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033883 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.033953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034623 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.password = **** {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] policy.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034965 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.034965 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.035102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.035181 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.035257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.035329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] receipt.caching = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.035399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.035477 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.035549 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.035619 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.035689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.035758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.035848 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.035939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.036014 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.036084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.036153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.036223 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] resource.caching = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.036293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.036449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.036522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.036700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] resource.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.036780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.036939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.037025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.037176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.037256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.037428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.037507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.037673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] revoke.caching = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.037752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.037925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.038007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.038166 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.038245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.038409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] role.cache_time = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.038488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.038645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] role.caching = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.038726 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.038888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.038966 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] role.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.039120 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] role.list_limit = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.039197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.039355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.039435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.039591 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.039670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.039883 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.039969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.040084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.040165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.040334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.040414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.040584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.040662 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.040831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.040911 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.041079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.041157 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.041314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.041393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.041547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.041628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.041796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.041875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.042033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.042112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.042268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.042356 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.042585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.042705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.042832 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.042947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.043082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.043199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.043350 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.043452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.043610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.043699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.043894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] policy.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.043976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.044140 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.044220 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.044391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.044483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.044632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.044712 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.044870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] receipt.caching = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.044950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.045112 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.045201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.045354 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.045432 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.045589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.045668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.045823 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.045909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.046064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.046143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.046307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] resource.caching = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.046386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.046546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.046633 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.047350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.047437 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] resource.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.047591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] token.cache_time = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.047671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.047873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] token.caching = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.047977 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.048092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.048173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.048343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] token.provider = fernet {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.048428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] revoke.caching = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.048583 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.048672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.048822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.048901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.049185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] role.cache_time = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.049272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.049345 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] role.caching = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.049425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.049582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] role.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.049669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.049816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] role.list_limit = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.049896 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.050072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.050187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] trust.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.050311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.050394 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.050552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.050633 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.050788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.050878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.051036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.051116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.051285 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.051363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.051515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.051602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.051760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.051854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.052022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.052101 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.052274 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.052367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.connection = **** {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.052527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.052618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.052778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.052858 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.053028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.053108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.053306 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.053486 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.053566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.053728 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.053806 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.053980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.054068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.054216 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.054295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.054466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.054562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.054705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.054798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.054950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.055031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.055195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.055276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.055446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.055535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.055685 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.055765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.055942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.056022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.056178 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.059628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.059704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.059764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.059764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.059907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060053 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=75629) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 10:48:28.060149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] token.cache_time = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] token.caching = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] token.provider = fernet {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] trust.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.060732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.061202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.061202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.061365 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.061597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.061841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.062136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.062425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.connection = **** {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.062673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.062921 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.063160 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.063403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.063641 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.063900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.064141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.064383 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.064629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.064869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.065113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.065351 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.065604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.065843 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.066155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.066392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.066636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.066881 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 10:48:28.067055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=75630) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 10:48:28.087404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.087641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.087904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.094424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.094666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.094889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.097187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.104030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.137179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.137409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.137715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.137952 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.292468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.293996 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.342395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.342626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.343040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.343277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.435367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.435555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.435659 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.435730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.435794 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.435979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.436092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.436228 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.436343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.436453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.436540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.436670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.469055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.469237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.469321 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.469397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.469503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.469616 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.469732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.469842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.469956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.470041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.470173 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.470257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.470389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.470474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.482247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.482663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.498040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.498231 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.498322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.498402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.498477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.498545 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.498682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.498767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.498895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.498977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.499119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.499208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.499335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=75630) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.499425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=75629) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 23 10:48:28.517507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.517709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 10:48:28.517798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.518013 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 10:48:28.518098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.518253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 10:48:28.518345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.518488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.518571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 23 10:48:28.518747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.518831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.519000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.519081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.519829 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.519946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.519946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.530174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.530446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.530558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.530712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.530874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.531535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.531675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.531989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.539903 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.540488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.543262 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.543497 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.543776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.543910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.544075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.544258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.544340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.544413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.544590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.544684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.544854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.544937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.545122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.545204 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.545385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.545476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.545652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.545734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.545915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.545997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.546186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.546454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.573083 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.573757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.574733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.575502 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.575630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.575736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.580393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.580798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.581038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.581128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.581447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.581731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.588360 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.588644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.589069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.589353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.593143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.593429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.594434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.594548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.594721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.594836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.595004 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.595112 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.595289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.595373 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.595564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.595646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.595856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.596032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.596144 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.596379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.615565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.615859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.616149 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.616429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.620580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.621122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.624236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.624638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.624819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.625220 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.629694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.630305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.633333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.633961 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.637014 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.637310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.637592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.637688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.637873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.637957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.638156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.638240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.638431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.638515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.638769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.639054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.658127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.658411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.658690 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.658772 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.658959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.659044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.659289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.659562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.666873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.667492 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.668617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.668986 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.669227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.669504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.672718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.673018 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.673349 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.673462 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.673591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.673676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.673873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.673958 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.674216 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.674436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.687412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.687694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.687875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.688014 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.688176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.688298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.688458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.688739 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.689991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.690294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.690469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.690587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.690767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.691063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.708697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.709190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.712040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.712561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.715338 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.715887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.717102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.717637 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.719280 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.719554 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.719833 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.719920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.720122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.720406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.727197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.727781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.729103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.729694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.732347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.732643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.733023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.733107 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.733294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.733375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.733684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.733970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.742996 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.743273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.743547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.743747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.744060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.744340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.751466 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=75630) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.751748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.752059 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.752298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=75629) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 23 10:48:28.752410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.752584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.752669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.752867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.752949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.753147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.753241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.753419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.753503 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.753750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.753840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.754024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.754131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.754295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.754416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.754574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.754778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.754866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.754945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.755101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=75630) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.755216 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.755580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.755750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.756055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=75629) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 23 10:48:28.793871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f66f60b9c0 pid: 75630 (default app) Jun 23 10:48:28.794730 dv-cinder-826607-6-smb devstack@keystone.service[75629]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f66f60b9c0 pid: 75629 (default app) Jun 23 10:48:28.797837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488bc4e-96d1-4fe1-aede-8a40ffda9bd3 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:28.798128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488bc4e-96d1-4fe1-aede-8a40ffda9bd3 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:28.798410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488bc4e-96d1-4fe1-aede-8a40ffda9bd3 None None] PATH_INFO: `/v3` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:28.802595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1/1] 10.222.0.52 () {50 vars in 791 bytes} [Thu Jun 23 10:48:28 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:37.462778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a836a-ff9a-4440-b986-c21be390c489 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:37.463372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a836a-ff9a-4440-b986-c21be390c489 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:37.463372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a836a-ff9a-4440-b986-c21be390c489 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:37.467633 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1/2] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:48:37.474136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f7c3f-f571-4952-a157-1e0a55cd5a8e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:37.474576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f7c3f-f571-4952-a157-1e0a55cd5a8e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:37.474693 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7f7c3f-f571-4952-a157-1e0a55cd5a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:37.545573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: INFO dbcounter [None req-9a7f7c3f-f571-4952-a157-1e0a55cd5a8e None None] Registered counter for database keystone Jun 23 10:48:37.567624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG oslo_db.sqlalchemy.engines [None req-9a7f7c3f-f571-4952-a157-1e0a55cd5a8e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75630) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:48:37.574789 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writer thread running {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:48:37.755138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG passlib.handlers.bcrypt [None req-9a7f7c3f-f571-4952-a157-1e0a55cd5a8e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=75630) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 10:48:37.755485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG passlib.handlers.bcrypt [None req-9a7f7c3f-f571-4952-a157-1e0a55cd5a8e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=75630) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 10:48:37.811131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-9a7f7c3f-f571-4952-a157-1e0a55cd5a8e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:37.812990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-9a7f7c3f-f571-4952-a157-1e0a55cd5a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:37.938152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 2/3] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 23 10:48:38.101618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a836a-ff9a-4440-b986-c21be390c489 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:38.173680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: INFO dbcounter [None req-a81a836a-ff9a-4440-b986-c21be390c489 None None] Registered counter for database keystone Jun 23 10:48:38.193101 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG oslo_db.sqlalchemy.engines [None req-a81a836a-ff9a-4440-b986-c21be390c489 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75629) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 10:48:38.199493 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writer thread running {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 10:48:38.320468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81a836a-ff9a-4440-b986-c21be390c489 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:38.324773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e781d4-0c68-4d8f-b53c-4eecad4bdb70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:38.325436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e781d4-0c68-4d8f-b53c-4eecad4bdb70 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:38.325727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e781d4-0c68-4d8f-b53c-4eecad4bdb70 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:38.326023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e781d4-0c68-4d8f-b53c-4eecad4bdb70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:38.334282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e781d4-0c68-4d8f-b53c-4eecad4bdb70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:38.386365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: WARNING keystone.common.rbac_enforcer.enforcer [None req-10e781d4-0c68-4d8f-b53c-4eecad4bdb70 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 10:48:38.386644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e781d4-0c68-4d8f-b53c-4eecad4bdb70 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:38.396657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 2/4] 10.222.0.52 () {58 vars in 1324 bytes} [Thu Jun 23 10:48:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 10:48:38.402776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f7c3f-f571-4952-a157-1e0a55cd5a8e None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:38.417718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7f7c3f-f571-4952-a157-1e0a55cd5a8e None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:38.422721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9ad89-4916-4d35-9d67-8fdf0b7b789b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:38.423870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9ad89-4916-4d35-9d67-8fdf0b7b789b admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:38.424156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9ad89-4916-4d35-9d67-8fdf0b7b789b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:38.424428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9ad89-4916-4d35-9d67-8fdf0b7b789b admin admin] PATH_INFO: `/v3/projects/38b92a57b84f432b87f291c46bdda9ea` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:38.428511 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9ad89-4916-4d35-9d67-8fdf0b7b789b admin admin] RBAC: Authorizing `identity:get_project(project_id=38b92a57b84f432b87f291c46bdda9ea)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:38.478988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8bd9ad89-4916-4d35-9d67-8fdf0b7b789b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 23 10:48:38.479551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd9ad89-4916-4d35-9d67-8fdf0b7b789b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:38.484460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 3/5] 10.222.0.52 () {56 vars in 1207 bytes} [Thu Jun 23 10:48:38 2022] GET /identity/v3/projects/38b92a57b84f432b87f291c46bdda9ea => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:40.514803 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcc4cf-8b77-4095-bb72-0a5bf4633a3a None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:40.515331 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcc4cf-8b77-4095-bb72-0a5bf4633a3a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:40.515445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bcc4cf-8b77-4095-bb72-0a5bf4633a3a None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:40.519523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 3/6] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:40.525095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b90d0-0a78-48be-890c-2d981ea06cef None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:40.525479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b90d0-0a78-48be-890c-2d981ea06cef None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:40.525714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0b90d0-0a78-48be-890c-2d981ea06cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:40.545052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-bb0b90d0-0a78-48be-890c-2d981ea06cef None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:40.547188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-bb0b90d0-0a78-48be-890c-2d981ea06cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:40.555135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 4/7] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 23 10:48:40.576989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcc4cf-8b77-4095-bb72-0a5bf4633a3a None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:40.589130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bcc4cf-8b77-4095-bb72-0a5bf4633a3a None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:40.593776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2b7eef-5159-4942-b216-089c1ac4957b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:40.594404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7eef-5159-4942-b216-089c1ac4957b admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:40.594685 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7eef-5159-4942-b216-089c1ac4957b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:40.594959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2b7eef-5159-4942-b216-089c1ac4957b admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:40.603093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b7eef-5159-4942-b216-089c1ac4957b admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:40.605157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2b7eef-5159-4942-b216-089c1ac4957b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:40.614450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 4/8] 10.222.0.52 () {58 vars in 1324 bytes} [Thu Jun 23 10:48:40 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 10:48:40.620023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b90d0-0a78-48be-890c-2d981ea06cef None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:40.629205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0b90d0-0a78-48be-890c-2d981ea06cef None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:40.633577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec70e317-2eb6-4bcf-a307-5bb11017dcb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:40.634462 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70e317-2eb6-4bcf-a307-5bb11017dcb9 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:40.634747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70e317-2eb6-4bcf-a307-5bb11017dcb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:40.635028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec70e317-2eb6-4bcf-a307-5bb11017dcb9 admin admin] PATH_INFO: `/v3/users/42a7a441efc44b648a036ca3257b9aad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:40.636449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70e317-2eb6-4bcf-a307-5bb11017dcb9 admin admin] RBAC: Authorizing `identity:get_user(user_id=42a7a441efc44b648a036ca3257b9aad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:40.638279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec70e317-2eb6-4bcf-a307-5bb11017dcb9 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:40.639878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 5/9] 10.222.0.52 () {56 vars in 1198 bytes} [Thu Jun 23 10:48:40 2022] GET /identity/v3/users/42a7a441efc44b648a036ca3257b9aad => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:42.734110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bd67b-8ac5-412c-b9a8-6d6674e8d389 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:42.734618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bd67b-8ac5-412c-b9a8-6d6674e8d389 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:42.734724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40bd67b-8ac5-412c-b9a8-6d6674e8d389 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:42.736068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 5/10] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:42.741460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc22f62-ff59-46c0-95ca-05152a75fc44 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:42.741856 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc22f62-ff59-46c0-95ca-05152a75fc44 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:42.742141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc22f62-ff59-46c0-95ca-05152a75fc44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:42.758824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-8fc22f62-ff59-46c0-95ca-05152a75fc44 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:42.760063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8fc22f62-ff59-46c0-95ca-05152a75fc44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:42.760238 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e8a81-7669-45fc-9737-2c7f4cfd0bc6 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:42.760506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e8a81-7669-45fc-9737-2c7f4cfd0bc6 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:42.760789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e8a81-7669-45fc-9737-2c7f4cfd0bc6 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:42.762153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 6/11] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:42.774612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e31a2-4af6-40fd-b1ca-75a033bd6166 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:42.774902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e31a2-4af6-40fd-b1ca-75a033bd6166 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:42.775187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e31a2-4af6-40fd-b1ca-75a033bd6166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:42.815496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG passlib.handlers.bcrypt [None req-920e31a2-4af6-40fd-b1ca-75a033bd6166 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=75629) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 23 10:48:42.815953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG passlib.handlers.bcrypt [None req-920e31a2-4af6-40fd-b1ca-75a033bd6166 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=75629) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 23 10:48:42.846125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 6/12] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:48:42.861849 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-920e31a2-4af6-40fd-b1ca-75a033bd6166 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:42.863441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-920e31a2-4af6-40fd-b1ca-75a033bd6166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:42.869228 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc22f62-ff59-46c0-95ca-05152a75fc44 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:42.894755 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:42.963937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 7/13] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:48:42.975923 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc22f62-ff59-46c0-95ca-05152a75fc44 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:42.986236 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e31a2-4af6-40fd-b1ca-75a033bd6166 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:43.010782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e20fc-ad70-4a02-a63c-3cd756b9fc80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:43.011577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e20fc-ad70-4a02-a63c-3cd756b9fc80 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:43.011888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e20fc-ad70-4a02-a63c-3cd756b9fc80 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:43.012171 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e20fc-ad70-4a02-a63c-3cd756b9fc80 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:43.023831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e20fc-ad70-4a02-a63c-3cd756b9fc80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-e74e20fc-ad70-4a02-a63c-3cd756b9fc80 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:48:43.035055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:48:43.036100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:48:43.036981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 7/14] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:48:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:48:43.042272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e20fc-ad70-4a02-a63c-3cd756b9fc80 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:43.101115 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e31a2-4af6-40fd-b1ca-75a033bd6166 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:43.108905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:43.129042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:43.147408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e20fc-ad70-4a02-a63c-3cd756b9fc80 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:43.148750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf600c-c73d-4362-a915-a65222ebd7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:43.149657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf600c-c73d-4362-a915-a65222ebd7b9 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:43.149947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf600c-c73d-4362-a915-a65222ebd7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:43.150229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf600c-c73d-4362-a915-a65222ebd7b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:43.181628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af5c8e-ba8f-43dd-a6cc-6dd0b8d35d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:43.182326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5c8e-ba8f-43dd-a6cc-6dd0b8d35d25 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:43.182613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5c8e-ba8f-43dd-a6cc-6dd0b8d35d25 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:43.182897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af5c8e-ba8f-43dd-a6cc-6dd0b8d35d25 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:43.183651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af5c8e-ba8f-43dd-a6cc-6dd0b8d35d25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:43.184000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af5c8e-ba8f-43dd-a6cc-6dd0b8d35d25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:43.185419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af5c8e-ba8f-43dd-a6cc-6dd0b8d35d25 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:43.197801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 8/15] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:48:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:48:43.203376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af5c8e-ba8f-43dd-a6cc-6dd0b8d35d25 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:43.219033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf600c-c73d-4362-a915-a65222ebd7b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:43.220587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbf600c-c73d-4362-a915-a65222ebd7b9 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:43.304667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af5c8e-ba8f-43dd-a6cc-6dd0b8d35d25 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:43.321111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 8/16] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:48:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:48:43.327006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf600c-c73d-4362-a915-a65222ebd7b9 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:43.329926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:43.338813 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812f0bb-b6c7-4472-b71b-18d33cbac0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:43.342774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812f0bb-b6c7-4472-b71b-18d33cbac0f9 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:43.342774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812f0bb-b6c7-4472-b71b-18d33cbac0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:43.342774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6812f0bb-b6c7-4472-b71b-18d33cbac0f9 None admin] PATH_INFO: `/v3/users/42a7a441efc44b648a036ca3257b9aad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:43.342774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812f0bb-b6c7-4472-b71b-18d33cbac0f9 None admin] RBAC: Authorizing `identity:get_user(user_id=42a7a441efc44b648a036ca3257b9aad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:43.343119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6812f0bb-b6c7-4472-b71b-18d33cbac0f9 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:43.344713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 9/17] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:48:43 2022] GET /identity/v3/users/42a7a441efc44b648a036ca3257b9aad => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:48:43.350074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812f0bb-b6c7-4472-b71b-18d33cbac0f9 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:43.365700 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:43.453154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf600c-c73d-4362-a915-a65222ebd7b9 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:43.455538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6812f0bb-b6c7-4472-b71b-18d33cbac0f9 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:43.488229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8819264-d6bc-40e5-8c5d-8c72f172d039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:43.489022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8819264-d6bc-40e5-8c5d-8c72f172d039 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:43.489312 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8819264-d6bc-40e5-8c5d-8c72f172d039 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:43.489593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8819264-d6bc-40e5-8c5d-8c72f172d039 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:43.490402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa71f42-4b91-44b5-bbee-37f86e213379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:43.491195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa71f42-4b91-44b5-bbee-37f86e213379 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:43.491480 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa71f42-4b91-44b5-bbee-37f86e213379 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:43.491766 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa71f42-4b91-44b5-bbee-37f86e213379 None admin] PATH_INFO: `/v3/domains/default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:43.492990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa71f42-4b91-44b5-bbee-37f86e213379 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:43.494452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa71f42-4b91-44b5-bbee-37f86e213379 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:43.496106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 10/18] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:48:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:48:43.502496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa71f42-4b91-44b5-bbee-37f86e213379 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:43.510183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8819264-d6bc-40e5-8c5d-8c72f172d039 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:43.511661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8819264-d6bc-40e5-8c5d-8c72f172d039 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-f8819264-d6bc-40e5-8c5d-8c72f172d039 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:48:43.532646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:48:43.533781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:48:43.534810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:48:43.534810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:48:43.534810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:48:43.534810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:48:43.534810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 9/19] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:48:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:48:43.539578 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8819264-d6bc-40e5-8c5d-8c72f172d039 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:43.591020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:43.596836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:43.609584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa71f42-4b91-44b5-bbee-37f86e213379 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:43.640910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8819264-d6bc-40e5-8c5d-8c72f172d039 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:43.643041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe532a3-7087-4ff8-9428-2ea99f593010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:43.643699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe532a3-7087-4ff8-9428-2ea99f593010 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:43.644112 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe532a3-7087-4ff8-9428-2ea99f593010 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:43.644394 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe532a3-7087-4ff8-9428-2ea99f593010 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:43.645221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe532a3-7087-4ff8-9428-2ea99f593010 None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.domain.id=default, user.id=42a7a441efc44b648a036ca3257b9aad) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:43.645537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe532a3-7087-4ff8-9428-2ea99f593010 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:43.646991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe532a3-7087-4ff8-9428-2ea99f593010 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:43.653953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 11/20] 10.222.0.52 () {56 vars in 1322 bytes} [Thu Jun 23 10:48:43 2022] GET /identity/v3/role_assignments?user.id=42a7a441efc44b648a036ca3257b9aad&scope.domain.id=default&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:48:43.677694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4742f53f-a14d-401e-819f-b7ddf3aeb703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:43.678386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f53f-a14d-401e-819f-b7ddf3aeb703 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:43.678675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f53f-a14d-401e-819f-b7ddf3aeb703 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:43.678957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4742f53f-a14d-401e-819f-b7ddf3aeb703 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:43.679724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f53f-a14d-401e-819f-b7ddf3aeb703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:43.680069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f53f-a14d-401e-819f-b7ddf3aeb703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:43.681543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4742f53f-a14d-401e-819f-b7ddf3aeb703 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:43.701262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 10/21] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:48:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:48:46.001914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d87cc9-33cc-4cbd-a0fd-d19bae2e5157 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:46.002909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d87cc9-33cc-4cbd-a0fd-d19bae2e5157 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:46.003404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d87cc9-33cc-4cbd-a0fd-d19bae2e5157 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:46.005017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 12/22] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:46.010835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2050b-3fef-477c-8cde-042271ca839b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:46.011285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2050b-3fef-477c-8cde-042271ca839b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:46.011371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2050b-3fef-477c-8cde-042271ca839b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:46.037364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-10c2050b-3fef-477c-8cde-042271ca839b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:46.038618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-10c2050b-3fef-477c-8cde-042271ca839b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:46.137367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 11/23] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:48:46.173329 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d87cc9-33cc-4cbd-a0fd-d19bae2e5157 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:46.291231 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd693f-b1f4-4bab-870e-3bbf38526727 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:46.291880 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd693f-b1f4-4bab-870e-3bbf38526727 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:46.292385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cd693f-b1f4-4bab-870e-3bbf38526727 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:46.293824 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 12/24] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:48:46.301292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103a19-0edf-4dab-bd26-595841e56909 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:46.301873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103a19-0edf-4dab-bd26-595841e56909 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:46.302374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33103a19-0edf-4dab-bd26-595841e56909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:46.324445 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d87cc9-33cc-4cbd-a0fd-d19bae2e5157 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:46.348890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-33103a19-0edf-4dab-bd26-595841e56909 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:46.350438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-33103a19-0edf-4dab-bd26-595841e56909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:46.393089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e564fb-7247-4f0f-b983-5c1f884742fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:46.393884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e564fb-7247-4f0f-b983-5c1f884742fd None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:46.394169 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e564fb-7247-4f0f-b983-5c1f884742fd None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:46.394443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e564fb-7247-4f0f-b983-5c1f884742fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:46.410320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e564fb-7247-4f0f-b983-5c1f884742fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-28e564fb-7247-4f0f-b983-5c1f884742fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:48:46.430531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:48:46.431428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:48:46.432207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 13/25] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:48:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:48:46.439015 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e564fb-7247-4f0f-b983-5c1f884742fd None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:46.444137 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:46.450801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:46.498229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 13/26] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:48:46.500147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548a839-f86b-4b3b-b87f-1a85b26db30d None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:46.500636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548a839-f86b-4b3b-b87f-1a85b26db30d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:46.501121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548a839-f86b-4b3b-b87f-1a85b26db30d None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:46.502620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 14/27] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:46.507957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2a312-c97c-4c98-9042-c03b21b6e0da None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:46.508503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2a312-c97c-4c98-9042-c03b21b6e0da None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:46.509000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a2a312-c97c-4c98-9042-c03b21b6e0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:46.540857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-32a2a312-c97c-4c98-9042-c03b21b6e0da None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:46.542490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-32a2a312-c97c-4c98-9042-c03b21b6e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:46.590851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e564fb-7247-4f0f-b983-5c1f884742fd None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:46.628465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1155c-c167-45e8-862e-3967b94f7fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:46.629146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1155c-c167-45e8-862e-3967b94f7fb7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:46.629434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1155c-c167-45e8-862e-3967b94f7fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:46.629721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b1155c-c167-45e8-862e-3967b94f7fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:46.630472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1155c-c167-45e8-862e-3967b94f7fb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:46.630784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1155c-c167-45e8-862e-3967b94f7fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:46.632221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b1155c-c167-45e8-862e-3967b94f7fb7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:46.641491 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 14/28] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:48:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:46.646874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1155c-c167-45e8-862e-3967b94f7fb7 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:46.705677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 15/29] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:48:46.706543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2a312-c97c-4c98-9042-c03b21b6e0da None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:46.717020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:46.754780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b1155c-c167-45e8-862e-3967b94f7fb7 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:46.791328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efdc79-83f3-43ac-8a6b-a7f0e27bf422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:46.792391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efdc79-83f3-43ac-8a6b-a7f0e27bf422 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:46.792878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efdc79-83f3-43ac-8a6b-a7f0e27bf422 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:46.793302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0efdc79-83f3-43ac-8a6b-a7f0e27bf422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:46.805648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efdc79-83f3-43ac-8a6b-a7f0e27bf422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:46.807419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0efdc79-83f3-43ac-8a6b-a7f0e27bf422 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-e0efdc79-83f3-43ac-8a6b-a7f0e27bf422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:48:46.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:48:46.828915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:48:46.829853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:48:46.829853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:48:46.829853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:48:46.829853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:48:46.831384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 15/30] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:48:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:48:46.832425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efdc79-83f3-43ac-8a6b-a7f0e27bf422 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:46.904426 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a2a312-c97c-4c98-9042-c03b21b6e0da None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:46.915235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:46.955345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a2e48-8efa-4a85-8119-be26d694049c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:46.956799 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a2e48-8efa-4a85-8119-be26d694049c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:46.957279 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a2e48-8efa-4a85-8119-be26d694049c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:46.958100 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4a2e48-8efa-4a85-8119-be26d694049c None admin] PATH_INFO: `/v3/users/42a7a441efc44b648a036ca3257b9aad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:46.960117 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a2e48-8efa-4a85-8119-be26d694049c None admin] RBAC: Authorizing `identity:get_user(user_id=42a7a441efc44b648a036ca3257b9aad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:46.960682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0efdc79-83f3-43ac-8a6b-a7f0e27bf422 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:46.961749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4a2e48-8efa-4a85-8119-be26d694049c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:46.965699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 16/31] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:48:46 2022] GET /identity/v3/users/42a7a441efc44b648a036ca3257b9aad => generated 247 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:46.966725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a2e48-8efa-4a85-8119-be26d694049c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:46.983230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:47.003251 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770db39-e1c8-4a08-a6b2-a3b2354e921c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:47.004756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770db39-e1c8-4a08-a6b2-a3b2354e921c None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:47.004887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770db39-e1c8-4a08-a6b2-a3b2354e921c None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:47.005155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770db39-e1c8-4a08-a6b2-a3b2354e921c None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:47.005977 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770db39-e1c8-4a08-a6b2-a3b2354e921c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:47.007387 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770db39-e1c8-4a08-a6b2-a3b2354e921c None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:47.090471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4a2e48-8efa-4a85-8119-be26d694049c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:47.132666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62fb039-bec1-4be8-84e0-ce8e4c6b7ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:47.133700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fb039-bec1-4be8-84e0-ce8e4c6b7ff1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:47.134236 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fb039-bec1-4be8-84e0-ce8e4c6b7ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:47.134717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62fb039-bec1-4be8-84e0-ce8e4c6b7ff1 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:47.135951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fb039-bec1-4be8-84e0-ce8e4c6b7ff1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:47.136517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fb039-bec1-4be8-84e0-ce8e4c6b7ff1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:47.138177 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62fb039-bec1-4be8-84e0-ce8e4c6b7ff1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:47.152986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 17/32] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:47.154724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae62f-e222-4cc5-b534-74d20b6f2393 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:47.155335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae62f-e222-4cc5-b534-74d20b6f2393 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:47.155918 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae62f-e222-4cc5-b534-74d20b6f2393 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:47.161700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 18/33] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:47.162883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae62f-e222-4cc5-b534-74d20b6f2393 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:47.201726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:47.225963 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 16/34] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Jun 23 10:48:46 2022] POST /identity/v3/roles => generated 219 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:48:47.228111 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770db39-e1c8-4a08-a6b2-a3b2354e921c None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:47.301413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae62f-e222-4cc5-b534-74d20b6f2393 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:47.352176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37183f-bb81-4bca-9331-683fc0fccfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:47.353163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37183f-bb81-4bca-9331-683fc0fccfae None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:47.353448 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37183f-bb81-4bca-9331-683fc0fccfae None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:47.353721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37183f-bb81-4bca-9331-683fc0fccfae None admin] PATH_INFO: `/v3/domains/default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:47.355090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37183f-bb81-4bca-9331-683fc0fccfae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:47.356580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b37183f-bb81-4bca-9331-683fc0fccfae None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:47.358367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 19/35] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:48:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:47.359724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3ff27-a130-4aab-9f30-e176c7ea8110 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:47.360038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3ff27-a130-4aab-9f30-e176c7ea8110 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:47.360316 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f3ff27-a130-4aab-9f30-e176c7ea8110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:47.378726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-85f3ff27-a130-4aab-9f30-e176c7ea8110 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:47.379715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-85f3ff27-a130-4aab-9f30-e176c7ea8110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:47.387120 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770db39-e1c8-4a08-a6b2-a3b2354e921c None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:47.433625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1979ca2a-a5b3-4ee6-b7ee-7d3c0bc91ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:47.434690 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ca2a-a5b3-4ee6-b7ee-7d3c0bc91ed9 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:47.435176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ca2a-a5b3-4ee6-b7ee-7d3c0bc91ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:47.435653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1979ca2a-a5b3-4ee6-b7ee-7d3c0bc91ed9 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:47.437118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979ca2a-a5b3-4ee6-b7ee-7d3c0bc91ed9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:47.438937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1979ca2a-a5b3-4ee6-b7ee-7d3c0bc91ed9 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:47.472923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 20/36] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:48:47.474060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec0162-3622-4e0e-aa09-c040e3940769 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:47.474359 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec0162-3622-4e0e-aa09-c040e3940769 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:47.474645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ec0162-3622-4e0e-aa09-c040e3940769 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:47.481139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 21/37] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:47.481842 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec0162-3622-4e0e-aa09-c040e3940769 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:47.516727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:47.552166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 17/38] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:48:47 2022] POST /identity/v3/projects => generated 301 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:48:47.553516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b9b89-cbb4-4be4-8c2e-4503d0f21516 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:47.553809 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b9b89-cbb4-4be4-8c2e-4503d0f21516 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:47.554141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705b9b89-cbb4-4be4-8c2e-4503d0f21516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:47.575238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-705b9b89-cbb4-4be4-8c2e-4503d0f21516 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:47.582815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-705b9b89-cbb4-4be4-8c2e-4503d0f21516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:47.613953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:47.634428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ec0162-3622-4e0e-aa09-c040e3940769 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:47.672389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 18/39] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:48:47.673824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b9b89-cbb4-4be4-8c2e-4503d0f21516 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:47.685721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05f29d-4804-4f8f-937d-bacd997d480b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:47.686722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05f29d-4804-4f8f-937d-bacd997d480b None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:47.687002 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05f29d-4804-4f8f-937d-bacd997d480b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:47.687285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05f29d-4804-4f8f-937d-bacd997d480b None admin] PATH_INFO: `/v3/domains/default/users/42a7a441efc44b648a036ca3257b9aad/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:47.691711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05f29d-4804-4f8f-937d-bacd997d480b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=42a7a441efc44b648a036ca3257b9aad, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:47.691886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05f29d-4804-4f8f-937d-bacd997d480b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:47.806996 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705b9b89-cbb4-4be4-8c2e-4503d0f21516 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:47.847539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f7116-584b-44ae-be8b-d283ee1f47d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:47.847539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f7116-584b-44ae-be8b-d283ee1f47d9 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:47.847539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f7116-584b-44ae-be8b-d283ee1f47d9 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:47.847539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f7116-584b-44ae-be8b-d283ee1f47d9 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:47.848135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f7116-584b-44ae-be8b-d283ee1f47d9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:47.848135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f7116-584b-44ae-be8b-d283ee1f47d9 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:47.911368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 22/40] 10.222.0.52 () {58 vars in 1361 bytes} [Thu Jun 23 10:48:47 2022] PUT /identity/v3/domains/default/users/42a7a441efc44b648a036ca3257b9aad/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:48:47.912518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05f29d-4804-4f8f-937d-bacd997d480b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:47.922785 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 19/41] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Jun 23 10:48:47 2022] POST /identity/v3/roles => generated 225 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:48:47.925143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1b73e-dfc7-480f-93dc-cef5ec42e145 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:47.925624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1b73e-dfc7-480f-93dc-cef5ec42e145 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:47.930028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca1b73e-dfc7-480f-93dc-cef5ec42e145 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:47.930028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 20/42] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:47.939107 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466edd7-c139-4a4c-aa2c-254502aff5b7 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:47.939753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466edd7-c139-4a4c-aa2c-254502aff5b7 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:47.940308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5466edd7-c139-4a4c-aa2c-254502aff5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:47.978427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5466edd7-c139-4a4c-aa2c-254502aff5b7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:47.980514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5466edd7-c139-4a4c-aa2c-254502aff5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:48.005069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:48.042142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:48.066736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05f29d-4804-4f8f-937d-bacd997d480b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:48.100447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 21/43] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:48:48.114256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9057fc0-87f2-4173-ab41-4a6ac4222d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:48.114950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9057fc0-87f2-4173-ab41-4a6ac4222d51 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:48.115238 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9057fc0-87f2-4173-ab41-4a6ac4222d51 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:48.115534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9057fc0-87f2-4173-ab41-4a6ac4222d51 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:48.116445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9057fc0-87f2-4173-ab41-4a6ac4222d51 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:48.118064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9057fc0-87f2-4173-ab41-4a6ac4222d51 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:48.128569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466edd7-c139-4a4c-aa2c-254502aff5b7 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:48.219434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 23/44] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Jun 23 10:48:47 2022] POST /identity/v3/roles => generated 223 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:48:48.350158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5466edd7-c139-4a4c-aa2c-254502aff5b7 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:48.389238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b489d2-2bcc-4ecb-8746-5e3cefe31af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:48.390115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b489d2-2bcc-4ecb-8746-5e3cefe31af7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:48.390403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b489d2-2bcc-4ecb-8746-5e3cefe31af7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:48.390687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b489d2-2bcc-4ecb-8746-5e3cefe31af7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:48.391927 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b489d2-2bcc-4ecb-8746-5e3cefe31af7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:48.393420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b489d2-2bcc-4ecb-8746-5e3cefe31af7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:48.395227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 22/45] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:48:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:48:48.401130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9057fc0-87f2-4173-ab41-4a6ac4222d51 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:48.525108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9057fc0-87f2-4173-ab41-4a6ac4222d51 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:48.558314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41d33e-84ce-4897-890b-bdfb9668ccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:48.558973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41d33e-84ce-4897-890b-bdfb9668ccec None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:48.559258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41d33e-84ce-4897-890b-bdfb9668ccec None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:48.559537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41d33e-84ce-4897-890b-bdfb9668ccec None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:48.560290 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41d33e-84ce-4897-890b-bdfb9668ccec None admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:48.561795 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f41d33e-84ce-4897-890b-bdfb9668ccec None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:48.663204 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 24/46] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:48:48 2022] POST /identity/v3/projects => generated 312 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:48:49.993270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab811-5e56-4c7b-8c27-03178f9e2c9f None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:49.993786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab811-5e56-4c7b-8c27-03178f9e2c9f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:49.993893 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ab811-5e56-4c7b-8c27-03178f9e2c9f None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:49.995178 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 23/47] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:50.001111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4e97-33f9-4a72-81ce-d2c7d171e97a None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:50.001500 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4e97-33f9-4a72-81ce-d2c7d171e97a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:50.001835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c4e97-33f9-4a72-81ce-d2c7d171e97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:50.007942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:50.018728 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-092c4e97-33f9-4a72-81ce-d2c7d171e97a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:50.020339 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-092c4e97-33f9-4a72-81ce-d2c7d171e97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:50.091733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 25/48] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:48:50.115488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ab811-5e56-4c7b-8c27-03178f9e2c9f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:50.134172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:50.217352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ab811-5e56-4c7b-8c27-03178f9e2c9f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:50.250974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7cfba-45a2-41dc-84d9-77d1dfc8cca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:50.251677 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7cfba-45a2-41dc-84d9-77d1dfc8cca4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:50.251989 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7cfba-45a2-41dc-84d9-77d1dfc8cca4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:50.252274 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7cfba-45a2-41dc-84d9-77d1dfc8cca4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:50.262326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7cfba-45a2-41dc-84d9-77d1dfc8cca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-f8f7cfba-45a2-41dc-84d9-77d1dfc8cca4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:48:50.270428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:48:50.271288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:48:50.272088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 24/49] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:48:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:48:50.278647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c4e97-33f9-4a72-81ce-d2c7d171e97a None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:50.378375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c4e97-33f9-4a72-81ce-d2c7d171e97a None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:50.413261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94cf3-a864-4a9d-9b8e-93af5721608c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:50.413936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94cf3-a864-4a9d-9b8e-93af5721608c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:50.414225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94cf3-a864-4a9d-9b8e-93af5721608c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:50.414505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d94cf3-a864-4a9d-9b8e-93af5721608c None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:50.415259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d94cf3-a864-4a9d-9b8e-93af5721608c None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:50.415569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d94cf3-a864-4a9d-9b8e-93af5721608c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:50.417005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d94cf3-a864-4a9d-9b8e-93af5721608c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:50.418660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:50.431194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 26/50] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:48:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:50.437231 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7cfba-45a2-41dc-84d9-77d1dfc8cca4 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:50.516264 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:50.537489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7cfba-45a2-41dc-84d9-77d1dfc8cca4 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:50.571322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e22a10c-bbf0-4822-bf6d-06208de41ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:50.572254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a10c-bbf0-4822-bf6d-06208de41ca2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:50.572545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a10c-bbf0-4822-bf6d-06208de41ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:50.572827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e22a10c-bbf0-4822-bf6d-06208de41ca2 None admin] PATH_INFO: `/v3/users/42a7a441efc44b648a036ca3257b9aad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:50.576607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22a10c-bbf0-4822-bf6d-06208de41ca2 None admin] RBAC: Authorizing `identity:get_user(user_id=42a7a441efc44b648a036ca3257b9aad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:50.578158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e22a10c-bbf0-4822-bf6d-06208de41ca2 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:50.579905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 25/51] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:48:50 2022] GET /identity/v3/users/42a7a441efc44b648a036ca3257b9aad => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:50.585218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94cf3-a864-4a9d-9b8e-93af5721608c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:50.685186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d94cf3-a864-4a9d-9b8e-93af5721608c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:50.710072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fd595-6737-4f4e-a274-4889f4f6abc4 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:50.710361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fd595-6737-4f4e-a274-4889f4f6abc4 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:50.710653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0fd595-6737-4f4e-a274-4889f4f6abc4 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:50.712068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 26/52] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:48:50.718277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc52bea-148b-4535-be76-6c2f437cded8 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:50.718277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc52bea-148b-4535-be76-6c2f437cded8 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:50.718529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc52bea-148b-4535-be76-6c2f437cded8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:50.721418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077bd8b-dc6c-4c0e-93e1-3113f2708e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:50.722209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077bd8b-dc6c-4c0e-93e1-3113f2708e1d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:50.722493 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077bd8b-dc6c-4c0e-93e1-3113f2708e1d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:50.722770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9077bd8b-dc6c-4c0e-93e1-3113f2708e1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:50.723975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077bd8b-dc6c-4c0e-93e1-3113f2708e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:50.725444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9077bd8b-dc6c-4c0e-93e1-3113f2708e1d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:50.727073 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 27/53] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:48:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:50.732956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077bd8b-dc6c-4c0e-93e1-3113f2708e1d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:50.735692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5fc52bea-148b-4535-be76-6c2f437cded8 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:50.736924 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5fc52bea-148b-4535-be76-6c2f437cded8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:50.809658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 27/54] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:48:50.833704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc52bea-148b-4535-be76-6c2f437cded8 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:50.900517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:50.923672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:50.958894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc52bea-148b-4535-be76-6c2f437cded8 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:50.960305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9077bd8b-dc6c-4c0e-93e1-3113f2708e1d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:50.995547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34559741-0bda-44d5-a8b7-59677c253d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:50.996336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31703298-46bb-41de-9d4e-ba055cbfb38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:50.996450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34559741-0bda-44d5-a8b7-59677c253d3a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:50.996648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34559741-0bda-44d5-a8b7-59677c253d3a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:50.996930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34559741-0bda-44d5-a8b7-59677c253d3a None admin] PATH_INFO: `/v3/domains/default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:50.997022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703298-46bb-41de-9d4e-ba055cbfb38e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:50.997277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703298-46bb-41de-9d4e-ba055cbfb38e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:50.997565 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31703298-46bb-41de-9d4e-ba055cbfb38e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:50.998131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34559741-0bda-44d5-a8b7-59677c253d3a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:50.998404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31703298-46bb-41de-9d4e-ba055cbfb38e None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.domain.id=default, user.id=42a7a441efc44b648a036ca3257b9aad) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:50.998761 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31703298-46bb-41de-9d4e-ba055cbfb38e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:50.999631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34559741-0bda-44d5-a8b7-59677c253d3a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:51.000247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31703298-46bb-41de-9d4e-ba055cbfb38e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:51.001309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 28/55] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:48:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:48:51.007031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34559741-0bda-44d5-a8b7-59677c253d3a None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:51.008975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 28/56] 10.222.0.52 () {56 vars in 1322 bytes} [Thu Jun 23 10:48:50 2022] GET /identity/v3/role_assignments?user.id=42a7a441efc44b648a036ca3257b9aad&scope.domain.id=default&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 530 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:48:51.114543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34559741-0bda-44d5-a8b7-59677c253d3a None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:51.152312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3526cf0-70e0-4664-9346-295b59286869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:51.153420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3526cf0-70e0-4664-9346-295b59286869 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:51.153420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3526cf0-70e0-4664-9346-295b59286869 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:51.153598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3526cf0-70e0-4664-9346-295b59286869 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:51.154241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3526cf0-70e0-4664-9346-295b59286869 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:51.156409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3526cf0-70e0-4664-9346-295b59286869 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:51.171204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:51.233611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 29/57] 10.222.0.52 () {60 vars in 1140 bytes} [Thu Jun 23 10:48:51 2022] POST /identity/v3/projects => generated 298 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:48:53.269384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b444f3-46b5-451d-a571-00ab38f56904 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:53.269904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b444f3-46b5-451d-a571-00ab38f56904 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:53.269988 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b444f3-46b5-451d-a571-00ab38f56904 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:53.271336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 29/58] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:53.276476 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c5c69-5584-4b75-9e71-c2550a54f2e6 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:53.276869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c5c69-5584-4b75-9e71-c2550a54f2e6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:53.277046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515c5c69-5584-4b75-9e71-c2550a54f2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:53.294084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-515c5c69-5584-4b75-9e71-c2550a54f2e6 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:53.295368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-515c5c69-5584-4b75-9e71-c2550a54f2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:53.361995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 30/59] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:48:53.386353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b444f3-46b5-451d-a571-00ab38f56904 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:53.490506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b444f3-46b5-451d-a571-00ab38f56904 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:53.517525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:53.525256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b9934f-6fa7-4848-b1eb-c0844b75c97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:53.526005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9934f-6fa7-4848-b1eb-c0844b75c97e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:53.526298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9934f-6fa7-4848-b1eb-c0844b75c97e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:53.526581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b9934f-6fa7-4848-b1eb-c0844b75c97e None admin] PATH_INFO: `/v3/domains/default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:53.527830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9934f-6fa7-4848-b1eb-c0844b75c97e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:53.529328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b9934f-6fa7-4848-b1eb-c0844b75c97e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:53.530991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 30/60] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:48:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:53.536535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c5c69-5584-4b75-9e71-c2550a54f2e6 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:53.634149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515c5c69-5584-4b75-9e71-c2550a54f2e6 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:53.659484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:53.668530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0837c4-65e8-4309-ad3a-cae7f0fe3a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:53.669203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0837c4-65e8-4309-ad3a-cae7f0fe3a3c None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:53.669492 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0837c4-65e8-4309-ad3a-cae7f0fe3a3c None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:53.669775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0837c4-65e8-4309-ad3a-cae7f0fe3a3c None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:53.671010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0837c4-65e8-4309-ad3a-cae7f0fe3a3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:53.672508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0837c4-65e8-4309-ad3a-cae7f0fe3a3c None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:53.805513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 31/61] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:48:53 2022] POST /identity/v3/users => generated 275 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:48:56.981206 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7805b3a-3c9c-43b2-9bb8-f19495059f79 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:56.982244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7805b3a-3c9c-43b2-9bb8-f19495059f79 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:56.983282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7805b3a-3c9c-43b2-9bb8-f19495059f79 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:56.984936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 31/62] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:56.990595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227d99-6986-4356-92dc-05cdd4f70021 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:56.991063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227d99-6986-4356-92dc-05cdd4f70021 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:56.991143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43227d99-6986-4356-92dc-05cdd4f70021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.012041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-43227d99-6986-4356-92dc-05cdd4f70021 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:57.013362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-43227d99-6986-4356-92dc-05cdd4f70021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:57.025097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b319-b3cd-4a2a-8bec-447185d4183a None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.025734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b319-b3cd-4a2a-8bec-447185d4183a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.026248 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106b319-b3cd-4a2a-8bec-447185d4183a None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.028207 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 32/63] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:57.034423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f07825-1131-4a56-ad8e-df1cb955fedb None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.035015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f07825-1131-4a56-ad8e-df1cb955fedb None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.035509 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f07825-1131-4a56-ad8e-df1cb955fedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.070330 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-63f07825-1131-4a56-ad8e-df1cb955fedb None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:57.071955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-63f07825-1131-4a56-ad8e-df1cb955fedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:57.139032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 32/64] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:48:57.169571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227d99-6986-4356-92dc-05cdd4f70021 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:57.185844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 33/65] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:48:57.217784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f07825-1131-4a56-ad8e-df1cb955fedb None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:57.374749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43227d99-6986-4356-92dc-05cdd4f70021 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:57.386013 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f07825-1131-4a56-ad8e-df1cb955fedb None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:57.389815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:57.413140 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9bb61e-63e3-4714-90c7-1a7b9fc176a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:57.414260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bb61e-63e3-4714-90c7-1a7b9fc176a3 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.415193 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bb61e-63e3-4714-90c7-1a7b9fc176a3 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.415193 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9bb61e-63e3-4714-90c7-1a7b9fc176a3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.419416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:57.428896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9bb61e-63e3-4714-90c7-1a7b9fc176a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:48:57.433121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0313b689-0896-4025-a991-52c9273b4608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:57.434259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b689-0896-4025-a991-52c9273b4608 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.434811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b689-0896-4025-a991-52c9273b4608 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.435312 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0313b689-0896-4025-a991-52c9273b4608 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-1b9bb61e-63e3-4714-90c7-1a7b9fc176a3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:48:57.436866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:48:57.437769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:48:57.438593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 33/66] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:48:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:48:57.440984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f466548-df5f-460e-a957-c79b54fdb5dc None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.441513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f466548-df5f-460e-a957-c79b54fdb5dc None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.442089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f466548-df5f-460e-a957-c79b54fdb5dc None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.443633 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 34/67] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:57.446321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f466548-df5f-460e-a957-c79b54fdb5dc None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:57.459657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0313b689-0896-4025-a991-52c9273b4608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-0313b689-0896-4025-a991-52c9273b4608 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:48:57.470525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:48:57.471436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:48:57.472255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:48:57.472255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:48:57.472255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:48:57.472255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:48:57.472255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:48:57.472255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:48:57.472255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:48:57.472255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:48:57.472255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:48:57.472255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:48:57.472255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:48:57.472255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:48:57.472840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 34/68] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:48:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:48:57.478598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba946b-d7c1-40ad-a796-e00fd3c734aa None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.478598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba946b-d7c1-40ad-a796-e00fd3c734aa None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.478598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba946b-d7c1-40ad-a796-e00fd3c734aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.494828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-aaba946b-d7c1-40ad-a796-e00fd3c734aa None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:57.496256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-aaba946b-d7c1-40ad-a796-e00fd3c734aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:57.574469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f466548-df5f-460e-a957-c79b54fdb5dc None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:57.574674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 35/69] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:48:57.574674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d55842-a049-415e-9eab-b24b626f0b85 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.574674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d55842-a049-415e-9eab-b24b626f0b85 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.575168 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d55842-a049-415e-9eab-b24b626f0b85 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.576715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 36/70] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:57.577835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d55842-a049-415e-9eab-b24b626f0b85 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:57.623032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3734ce-787e-4686-9d3b-c17d2b93a933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:57.624300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3734ce-787e-4686-9d3b-c17d2b93a933 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.624589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3734ce-787e-4686-9d3b-c17d2b93a933 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.624922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3734ce-787e-4686-9d3b-c17d2b93a933 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.625623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3734ce-787e-4686-9d3b-c17d2b93a933 None admin] RBAC: Adding query filter params (name=member) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:57.625934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3734ce-787e-4686-9d3b-c17d2b93a933 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:57.627462 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3734ce-787e-4686-9d3b-c17d2b93a933 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:57.635744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 35/71] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:48:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:48:57.636984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54e08a-e85b-415d-994a-d1eae1dadce1 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.637275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54e08a-e85b-415d-994a-d1eae1dadce1 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.637557 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54e08a-e85b-415d-994a-d1eae1dadce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.653309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-0f54e08a-e85b-415d-994a-d1eae1dadce1 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:57.654534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0f54e08a-e85b-415d-994a-d1eae1dadce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:57.681397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:57.690002 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d55842-a049-415e-9eab-b24b626f0b85 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:57.706217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:57.721378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 36/72] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:48:57.724049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a13b0-bf6a-40d4-a13b-cc7395b2beb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:57.724670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54e08a-e85b-415d-994a-d1eae1dadce1 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:57.724853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a13b0-bf6a-40d4-a13b-cc7395b2beb7 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.725133 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a13b0-bf6a-40d4-a13b-cc7395b2beb7 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.725417 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a13b0-bf6a-40d4-a13b-cc7395b2beb7 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.726180 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a13b0-bf6a-40d4-a13b-cc7395b2beb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:57.726497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a13b0-bf6a-40d4-a13b-cc7395b2beb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:57.729360 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a13b0-bf6a-40d4-a13b-cc7395b2beb7 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:57.740550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 37/73] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:48:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:57.741807 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65c8a9-a5fb-49f1-a8c1-eabaf55a1a12 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.742259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65c8a9-a5fb-49f1-a8c1-eabaf55a1a12 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.742690 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65c8a9-a5fb-49f1-a8c1-eabaf55a1a12 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.744182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 38/74] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:48:57.744766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65c8a9-a5fb-49f1-a8c1-eabaf55a1a12 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:57.828087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54e08a-e85b-415d-994a-d1eae1dadce1 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:57.849456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65c8a9-a5fb-49f1-a8c1-eabaf55a1a12 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:57.862983 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b42e31-7620-4b45-9a8f-6ab609b8657e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:57.863853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b42e31-7620-4b45-9a8f-6ab609b8657e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.864116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b42e31-7620-4b45-9a8f-6ab609b8657e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.864398 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b42e31-7620-4b45-9a8f-6ab609b8657e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.875514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b42e31-7620-4b45-9a8f-6ab609b8657e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-d4b42e31-7620-4b45-9a8f-6ab609b8657e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:48:57.883572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:48:57.884458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:48:57.885205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 37/75] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:48:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:48:57.885935 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b42e31-7620-4b45-9a8f-6ab609b8657e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:57.891297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9cd1-cb93-4336-8cce-4f08820bd327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:57.892216 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9cd1-cb93-4336-8cce-4f08820bd327 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:57.892490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9cd1-cb93-4336-8cce-4f08820bd327 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:57.892771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c9cd1-cb93-4336-8cce-4f08820bd327 None admin] PATH_INFO: `/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:57.909174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c9cd1-cb93-4336-8cce-4f08820bd327 None admin] RBAC: Authorizing `identity:get_user(user_id=46a7431e426c4d01bc6f4ec5de1e2a53)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:57.910652 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c9cd1-cb93-4336-8cce-4f08820bd327 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:57.911762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:57.912675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 39/76] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:48:57 2022] GET /identity/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:57.913167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9cd1-cb93-4336-8cce-4f08820bd327 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:57.952586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:57.989341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b42e31-7620-4b45-9a8f-6ab609b8657e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:58.018175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c9cd1-cb93-4336-8cce-4f08820bd327 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:58.021494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51166c3b-6d38-4f23-9b0f-3cbc34611011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:58.022284 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51166c3b-6d38-4f23-9b0f-3cbc34611011 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:58.022574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51166c3b-6d38-4f23-9b0f-3cbc34611011 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:58.022859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51166c3b-6d38-4f23-9b0f-3cbc34611011 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:58.033957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51166c3b-6d38-4f23-9b0f-3cbc34611011 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-51166c3b-6d38-4f23-9b0f-3cbc34611011 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:48:58.041609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:48:58.042670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:48:58.043450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 38/77] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:48:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:48:58.044438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ed57a-a490-423b-8403-9fbcee4f4c1c None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:58.044534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ed57a-a490-423b-8403-9fbcee4f4c1c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:58.044781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125ed57a-a490-423b-8403-9fbcee4f4c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:58.056522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d5d1b-4247-482a-a4aa-e451f632b6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:58.057390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d5d1b-4247-482a-a4aa-e451f632b6ef None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:58.057673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d5d1b-4247-482a-a4aa-e451f632b6ef None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:58.057948 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388d5d1b-4247-482a-a4aa-e451f632b6ef None admin] PATH_INFO: `/v3/users/42a7a441efc44b648a036ca3257b9aad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:58.059148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d5d1b-4247-482a-a4aa-e451f632b6ef None admin] RBAC: Authorizing `identity:get_user(user_id=42a7a441efc44b648a036ca3257b9aad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:58.060624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388d5d1b-4247-482a-a4aa-e451f632b6ef None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:58.061600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-125ed57a-a490-423b-8403-9fbcee4f4c1c None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:48:58.062245 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 40/78] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:48:57 2022] GET /identity/v3/users/42a7a441efc44b648a036ca3257b9aad => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:58.062794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-125ed57a-a490-423b-8403-9fbcee4f4c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:48:58.062999 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d5d1b-4247-482a-a4aa-e451f632b6ef None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:58.130123 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 39/79] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:48:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:48:58.130894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ed57a-a490-423b-8403-9fbcee4f4c1c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:58.149092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:58.184357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388d5d1b-4247-482a-a4aa-e451f632b6ef None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:58.186991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:58.222199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc498eb-e27e-43a2-8c2b-e1b0b2345825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:58.222878 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc498eb-e27e-43a2-8c2b-e1b0b2345825 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:58.223179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc498eb-e27e-43a2-8c2b-e1b0b2345825 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:58.223462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc498eb-e27e-43a2-8c2b-e1b0b2345825 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:58.224244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc498eb-e27e-43a2-8c2b-e1b0b2345825 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:58.224555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc498eb-e27e-43a2-8c2b-e1b0b2345825 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:58.225981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc498eb-e27e-43a2-8c2b-e1b0b2345825 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:58.236580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 41/80] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:48:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:58.240741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc498eb-e27e-43a2-8c2b-e1b0b2345825 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:58.252724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125ed57a-a490-423b-8403-9fbcee4f4c1c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:58.287800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af432df5-0fa3-46a1-b180-94f6ebd36df8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:58.288480 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af432df5-0fa3-46a1-b180-94f6ebd36df8 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:58.288775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af432df5-0fa3-46a1-b180-94f6ebd36df8 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:58.289053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af432df5-0fa3-46a1-b180-94f6ebd36df8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:58.342935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc498eb-e27e-43a2-8c2b-e1b0b2345825 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:58.355940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af432df5-0fa3-46a1-b180-94f6ebd36df8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:58.358091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af432df5-0fa3-46a1-b180-94f6ebd36df8 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:58.373050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:58.376641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc052dd-da10-4c3e-aa24-f1ccd4d644f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:58.377310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc052dd-da10-4c3e-aa24-f1ccd4d644f1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:58.377597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc052dd-da10-4c3e-aa24-f1ccd4d644f1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:58.377877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc052dd-da10-4c3e-aa24-f1ccd4d644f1 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:58.378617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc052dd-da10-4c3e-aa24-f1ccd4d644f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:58.378927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc052dd-da10-4c3e-aa24-f1ccd4d644f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:58.380405 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc052dd-da10-4c3e-aa24-f1ccd4d644f1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:58.389317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 42/81] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:48:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:58.392431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc052dd-da10-4c3e-aa24-f1ccd4d644f1 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:58.422363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:58.462439 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 40/82] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:48:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:48:58.463292 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af432df5-0fa3-46a1-b180-94f6ebd36df8 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:58.501551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc052dd-da10-4c3e-aa24-f1ccd4d644f1 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:58.538071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc9bc0-f536-418b-9047-bb6708ed7a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:58.538740 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc9bc0-f536-418b-9047-bb6708ed7a81 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:58.539031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc9bc0-f536-418b-9047-bb6708ed7a81 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:58.539315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bc9bc0-f536-418b-9047-bb6708ed7a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:58.577419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af432df5-0fa3-46a1-b180-94f6ebd36df8 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:58.591500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:58.614867 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e4508-aebf-44ba-98d7-86c2167c917d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:58.615695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e4508-aebf-44ba-98d7-86c2167c917d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:58.616049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e4508-aebf-44ba-98d7-86c2167c917d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:58.616337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e4508-aebf-44ba-98d7-86c2167c917d None admin] PATH_INFO: `/v3/domains/default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:58.617552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e4508-aebf-44ba-98d7-86c2167c917d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:58.619032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e4508-aebf-44ba-98d7-86c2167c917d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:58.620403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc9bc0-f536-418b-9047-bb6708ed7a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:58.620706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 41/83] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:48:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:58.621510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e4508-aebf-44ba-98d7-86c2167c917d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:58.621923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bc9bc0-f536-418b-9047-bb6708ed7a81 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:58.652319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:58.726113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e4508-aebf-44ba-98d7-86c2167c917d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:58.730977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 43/84] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:48:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:48:58.731743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc9bc0-f536-418b-9047-bb6708ed7a81 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:58.760489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec9a49-09f2-420c-b75b-1ade56df1644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:58.761362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec9a49-09f2-420c-b75b-1ade56df1644 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:58.761646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec9a49-09f2-420c-b75b-1ade56df1644 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:58.761926 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ec9a49-09f2-420c-b75b-1ade56df1644 None admin] PATH_INFO: `/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:58.763136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec9a49-09f2-420c-b75b-1ade56df1644 None admin] RBAC: Authorizing `identity:get_user(user_id=46a7431e426c4d01bc6f4ec5de1e2a53)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:58.765263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ec9a49-09f2-420c-b75b-1ade56df1644 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:58.767025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 42/85] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:48:58 2022] GET /identity/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:58.767793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec9a49-09f2-420c-b75b-1ade56df1644 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:58.818435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:58.837650 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bc9bc0-f536-418b-9047-bb6708ed7a81 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:58.872667 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:58.872868 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ec9a49-09f2-420c-b75b-1ade56df1644 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:58.882467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cf290-5a21-492a-bcbe-c2684e9d2a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:58.883526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cf290-5a21-492a-bcbe-c2684e9d2a52 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:58.883939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cf290-5a21-492a-bcbe-c2684e9d2a52 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:58.884363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cf290-5a21-492a-bcbe-c2684e9d2a52 None admin] PATH_INFO: `/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:58.889689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cf290-5a21-492a-bcbe-c2684e9d2a52 None admin] RBAC: Authorizing `identity:get_user(user_id=46a7431e426c4d01bc6f4ec5de1e2a53)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:58.889689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cf290-5a21-492a-bcbe-c2684e9d2a52 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:58.889689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 44/86] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:48:58 2022] GET /identity/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:58.890253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cf290-5a21-492a-bcbe-c2684e9d2a52 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:58.909084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a123b-ab34-439d-8421-9a605b0e8e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:58.910191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a123b-ab34-439d-8421-9a605b0e8e13 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:58.910479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a123b-ab34-439d-8421-9a605b0e8e13 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:58.910760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a123b-ab34-439d-8421-9a605b0e8e13 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:58.911999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a123b-ab34-439d-8421-9a605b0e8e13 None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:58.913522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253a123b-ab34-439d-8421-9a605b0e8e13 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:58.915387 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 43/87] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:48:58 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:58.916029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a123b-ab34-439d-8421-9a605b0e8e13 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:58.996586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cf290-5a21-492a-bcbe-c2684e9d2a52 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:59.015696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253a123b-ab34-439d-8421-9a605b0e8e13 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:59.033122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a6f0a-8bb9-4d0a-aa80-c30a150511b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:59.034140 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a6f0a-8bb9-4d0a-aa80-c30a150511b8 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:59.034355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:59.034709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a6f0a-8bb9-4d0a-aa80-c30a150511b8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:59.034786 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a6f0a-8bb9-4d0a-aa80-c30a150511b8 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:59.035528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a6f0a-8bb9-4d0a-aa80-c30a150511b8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:59.037063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a6f0a-8bb9-4d0a-aa80-c30a150511b8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:59.051174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c727a7c-1363-42ba-9e21-194a5fa9ab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:59.052080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c727a7c-1363-42ba-9e21-194a5fa9ab67 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:59.052363 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c727a7c-1363-42ba-9e21-194a5fa9ab67 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:59.052648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c727a7c-1363-42ba-9e21-194a5fa9ab67 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:59.061961 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c727a7c-1363-42ba-9e21-194a5fa9ab67 None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:59.061961 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c727a7c-1363-42ba-9e21-194a5fa9ab67 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:59.061961 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 44/88] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:48:58 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:59.061961 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c727a7c-1363-42ba-9e21-194a5fa9ab67 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:59.157647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 45/89] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:48:58 2022] POST /identity/v3/users => generated 289 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:48:59.158216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c727a7c-1363-42ba-9e21-194a5fa9ab67 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:59.158495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a6f0a-8bb9-4d0a-aa80-c30a150511b8 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:59.203095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52586b-91d2-4b73-af22-4430fca003a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:59.203669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52586b-91d2-4b73-af22-4430fca003a2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:59.203985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52586b-91d2-4b73-af22-4430fca003a2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:59.204265 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52586b-91d2-4b73-af22-4430fca003a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:59.221381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:59.272316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:59.277543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a6f0a-8bb9-4d0a-aa80-c30a150511b8 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:59.287554 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52586b-91d2-4b73-af22-4430fca003a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:59.289582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb52586b-91d2-4b73-af22-4430fca003a2 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:59.319599 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1992b-c39f-4936-85aa-ca240ec5d6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:59.320239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1992b-c39f-4936-85aa-ca240ec5d6c4 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:59.320580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1992b-c39f-4936-85aa-ca240ec5d6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:59.320874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1992b-c39f-4936-85aa-ca240ec5d6c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:59.405386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1992b-c39f-4936-85aa-ca240ec5d6c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:59.407059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1992b-c39f-4936-85aa-ca240ec5d6c4 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:59.418217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 45/90] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:48:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:48:59.419974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52586b-91d2-4b73-af22-4430fca003a2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:59.471401 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:59.520907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:59.532313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 46/91] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:48:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:48:59.533358 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1992b-c39f-4936-85aa-ca240ec5d6c4 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:59.548699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52586b-91d2-4b73-af22-4430fca003a2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:59.641743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383851f-a933-4bf2-b9fe-a9145d167e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:59.642509 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383851f-a933-4bf2-b9fe-a9145d167e01 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:59.642872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383851f-a933-4bf2-b9fe-a9145d167e01 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:59.643222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383851f-a933-4bf2-b9fe-a9145d167e01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:59.644188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383851f-a933-4bf2-b9fe-a9145d167e01 None admin] RBAC: Adding query filter params (role.id=7a7c8cc02f174648b814192cba5506ad, scope.project.id=e6da88ad0e094644bb7b47c1e809bb60, user.id=46a7431e426c4d01bc6f4ec5de1e2a53) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:59.644587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383851f-a933-4bf2-b9fe-a9145d167e01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:59.646151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383851f-a933-4bf2-b9fe-a9145d167e01 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:59.656277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 46/92] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:48:59 2022] GET /identity/v3/role_assignments?user.id=46a7431e426c4d01bc6f4ec5de1e2a53&scope.project.id=e6da88ad0e094644bb7b47c1e809bb60&role.id=7a7c8cc02f174648b814192cba5506ad => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:59.657642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383851f-a933-4bf2-b9fe-a9145d167e01 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:59.680950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1992b-c39f-4936-85aa-ca240ec5d6c4 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:59.767869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53fd73-4110-4595-ba44-9cc04e95685e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:59.768865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53fd73-4110-4595-ba44-9cc04e95685e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:59.769300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53fd73-4110-4595-ba44-9cc04e95685e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:59.769718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b53fd73-4110-4595-ba44-9cc04e95685e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:59.770850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53fd73-4110-4595-ba44-9cc04e95685e None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=e6da88ad0e094644bb7b47c1e809bb60, user.id=42a7a441efc44b648a036ca3257b9aad) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:48:59.771310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53fd73-4110-4595-ba44-9cc04e95685e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:59.774140 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b53fd73-4110-4595-ba44-9cc04e95685e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:59.787223 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 47/93] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:48:59 2022] GET /identity/v3/role_assignments?user.id=42a7a441efc44b648a036ca3257b9aad&scope.project.id=e6da88ad0e094644bb7b47c1e809bb60&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:59.787926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53fd73-4110-4595-ba44-9cc04e95685e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:59.824622 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383851f-a933-4bf2-b9fe-a9145d167e01 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:48:59.834550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:59.902081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff22e8-2880-4f5e-8730-7c5c0bd4419f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:48:59.902967 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff22e8-2880-4f5e-8730-7c5c0bd4419f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:48:59.903250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff22e8-2880-4f5e-8730-7c5c0bd4419f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:48:59.903526 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ff22e8-2880-4f5e-8730-7c5c0bd4419f None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:48:59.906248 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff22e8-2880-4f5e-8730-7c5c0bd4419f None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:48:59.907800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ff22e8-2880-4f5e-8730-7c5c0bd4419f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:48:59.909855 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 47/94] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:48:59 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:48:59.915784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff22e8-2880-4f5e-8730-7c5c0bd4419f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:48:59.941022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:48:59.994191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b53fd73-4110-4595-ba44-9cc04e95685e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:00.043793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ff22e8-2880-4f5e-8730-7c5c0bd4419f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:00.075774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fed0c-ad20-4267-acf5-749b8c9effd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:00.077425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fed0c-ad20-4267-acf5-749b8c9effd6 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:00.077711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fed0c-ad20-4267-acf5-749b8c9effd6 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:00.077989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899fed0c-ad20-4267-acf5-749b8c9effd6 None admin] PATH_INFO: `/v3/projects/d243a81490be49a7bf96f49274a9da61` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:00.079303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fed0c-ad20-4267-acf5-749b8c9effd6 None admin] RBAC: Authorizing `identity:get_project(project_id=d243a81490be49a7bf96f49274a9da61)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:00.080805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899fed0c-ad20-4267-acf5-749b8c9effd6 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:00.082672 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 48/95] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:48:59 2022] GET /identity/v3/projects/d243a81490be49a7bf96f49274a9da61 => generated 312 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:00.088430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fed0c-ad20-4267-acf5-749b8c9effd6 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:00.091970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3855413-515d-42b7-bcf2-8ffccdc9aed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:00.092865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3855413-515d-42b7-bcf2-8ffccdc9aed1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:00.093388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3855413-515d-42b7-bcf2-8ffccdc9aed1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:00.093857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3855413-515d-42b7-bcf2-8ffccdc9aed1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:00.096254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3855413-515d-42b7-bcf2-8ffccdc9aed1 None admin] RBAC: Adding query filter params (role.id=d7474d28a1f24780a0b4c715fdff50b1, scope.project.id=e6da88ad0e094644bb7b47c1e809bb60, user.id=46a7431e426c4d01bc6f4ec5de1e2a53) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:00.096867 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3855413-515d-42b7-bcf2-8ffccdc9aed1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:00.098538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3855413-515d-42b7-bcf2-8ffccdc9aed1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:00.107215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 48/96] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:48:59 2022] GET /identity/v3/role_assignments?user.id=46a7431e426c4d01bc6f4ec5de1e2a53&scope.project.id=e6da88ad0e094644bb7b47c1e809bb60&role.id=d7474d28a1f24780a0b4c715fdff50b1 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:00.246357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:00.267484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899fed0c-ad20-4267-acf5-749b8c9effd6 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:00.316663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9635ba7-9908-4cd3-8dea-50aa1af00201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:00.317268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9635ba7-9908-4cd3-8dea-50aa1af00201 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:00.317558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9635ba7-9908-4cd3-8dea-50aa1af00201 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:00.317839 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9635ba7-9908-4cd3-8dea-50aa1af00201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:00.318691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9635ba7-9908-4cd3-8dea-50aa1af00201 None admin] RBAC: Adding query filter params (role.id=7a7c8cc02f174648b814192cba5506ad, scope.project.id=d243a81490be49a7bf96f49274a9da61, user.id=46a7431e426c4d01bc6f4ec5de1e2a53) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:00.319005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9635ba7-9908-4cd3-8dea-50aa1af00201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:00.320501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9635ba7-9908-4cd3-8dea-50aa1af00201 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:00.326726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 49/97] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:00 2022] GET /identity/v3/role_assignments?user.id=46a7431e426c4d01bc6f4ec5de1e2a53&scope.project.id=d243a81490be49a7bf96f49274a9da61&role.id=7a7c8cc02f174648b814192cba5506ad => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:02.072221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9b509-f4f8-46a7-bbf7-4120da0bf61d None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:02.072733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9b509-f4f8-46a7-bbf7-4120da0bf61d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:02.072842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c9b509-f4f8-46a7-bbf7-4120da0bf61d None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:02.074153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 49/98] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:02.080572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50397fc6-2e63-4a5e-bb2b-ae0ee2654ef4 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:02.081021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50397fc6-2e63-4a5e-bb2b-ae0ee2654ef4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:02.081146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50397fc6-2e63-4a5e-bb2b-ae0ee2654ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:02.099402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-50397fc6-2e63-4a5e-bb2b-ae0ee2654ef4 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:02.100904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-50397fc6-2e63-4a5e-bb2b-ae0ee2654ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:02.186342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 50/99] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:02.219639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9b509-f4f8-46a7-bbf7-4120da0bf61d None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:02.319786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:02.339798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c9b509-f4f8-46a7-bbf7-4120da0bf61d None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:02.376100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef491701-daa7-4ed6-aa07-6ac7f9089049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:02.376905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef491701-daa7-4ed6-aa07-6ac7f9089049 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:02.377194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef491701-daa7-4ed6-aa07-6ac7f9089049 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:02.377469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef491701-daa7-4ed6-aa07-6ac7f9089049 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:02.388453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef491701-daa7-4ed6-aa07-6ac7f9089049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-ef491701-daa7-4ed6-aa07-6ac7f9089049 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:02.396316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:02.397139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:02.397908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 50/100] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:02.403420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50397fc6-2e63-4a5e-bb2b-ae0ee2654ef4 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:02.523252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:02.553550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50397fc6-2e63-4a5e-bb2b-ae0ee2654ef4 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:02.651696 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a727d-bcc1-4f31-9bc5-306eaf5b7839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:02.652762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a727d-bcc1-4f31-9bc5-306eaf5b7839 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:02.653263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a727d-bcc1-4f31-9bc5-306eaf5b7839 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:02.653749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a727d-bcc1-4f31-9bc5-306eaf5b7839 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:02.655235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a727d-bcc1-4f31-9bc5-306eaf5b7839 None admin] RBAC: Adding query filter params (name=reader) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:02.655740 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a727d-bcc1-4f31-9bc5-306eaf5b7839 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:02.657373 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a727d-bcc1-4f31-9bc5-306eaf5b7839 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:02.666826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 51/101] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:02.672063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef491701-daa7-4ed6-aa07-6ac7f9089049 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:02.687834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eea4b-2b2d-4f9f-9125-3ac963e4b33d None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:02.687834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eea4b-2b2d-4f9f-9125-3ac963e4b33d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:02.687834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eea4b-2b2d-4f9f-9125-3ac963e4b33d None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:02.687834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 52/102] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:49:02.693522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a2a44-5d5c-4459-b47d-16b0ede33c08 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:02.693814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a2a44-5d5c-4459-b47d-16b0ede33c08 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:02.694105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7a2a44-5d5c-4459-b47d-16b0ede33c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:02.724360 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-cc7a2a44-5d5c-4459-b47d-16b0ede33c08 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:02.725591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-cc7a2a44-5d5c-4459-b47d-16b0ede33c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:02.827069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef491701-daa7-4ed6-aa07-6ac7f9089049 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:02.828946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 53/103] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:02.830392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac936-f582-4771-b2ff-e5404345c906 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:02.830689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac936-f582-4771-b2ff-e5404345c906 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:02.830973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdac936-f582-4771-b2ff-e5404345c906 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:02.840607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 54/104] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:02.842610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f5658-704d-42c6-940e-1dddf707c3e2 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:02.842900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f5658-704d-42c6-940e-1dddf707c3e2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:02.843181 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106f5658-704d-42c6-940e-1dddf707c3e2 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:02.844686 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 55/105] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:02.850552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09165-943f-4e39-8b49-9ee32eb32401 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:02.850843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09165-943f-4e39-8b49-9ee32eb32401 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:02.851128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d09165-943f-4e39-8b49-9ee32eb32401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:02.874131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c6c5c0-d352-4b7f-add7-bfe38a61e4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:02.874326 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-f5d09165-943f-4e39-8b49-9ee32eb32401 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:02.875021 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6c5c0-d352-4b7f-add7-bfe38a61e4a4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:02.875308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6c5c0-d352-4b7f-add7-bfe38a61e4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:02.875590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c6c5c0-d352-4b7f-add7-bfe38a61e4a4 None admin] PATH_INFO: `/v3/users/4cf6f287a58d4302ab8cca566a79c1b5` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:02.875696 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f5d09165-943f-4e39-8b49-9ee32eb32401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:02.888119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:02.891275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6c5c0-d352-4b7f-add7-bfe38a61e4a4 None admin] RBAC: Authorizing `identity:get_user(user_id=4cf6f287a58d4302ab8cca566a79c1b5)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:02.892823 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c6c5c0-d352-4b7f-add7-bfe38a61e4a4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:02.894573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 51/106] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:02 2022] GET /identity/v3/users/4cf6f287a58d4302ab8cca566a79c1b5 => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:02.896002 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72085cf-1059-4acb-9e8a-f1691ba9e96d None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:02.896298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72085cf-1059-4acb-9e8a-f1691ba9e96d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:02.896582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72085cf-1059-4acb-9e8a-f1691ba9e96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:02.913684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b72085cf-1059-4acb-9e8a-f1691ba9e96d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:02.914872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b72085cf-1059-4acb-9e8a-f1691ba9e96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:02.950418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:02.956043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 56/107] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:02.956994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09165-943f-4e39-8b49-9ee32eb32401 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:02.995742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 52/108] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:03.003126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72085cf-1059-4acb-9e8a-f1691ba9e96d None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:03.068918 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d09165-943f-4e39-8b49-9ee32eb32401 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:03.108486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f827ea-fe4f-4e1b-b2ed-001c38557c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:03.109293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f827ea-fe4f-4e1b-b2ed-001c38557c57 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:03.109581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f827ea-fe4f-4e1b-b2ed-001c38557c57 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:03.109859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f827ea-fe4f-4e1b-b2ed-001c38557c57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:03.121725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f827ea-fe4f-4e1b-b2ed-001c38557c57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:03.121902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72085cf-1059-4acb-9e8a-f1691ba9e96d None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-b3f827ea-fe4f-4e1b-b2ed-001c38557c57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:03.129621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:03.130523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 57/109] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:03.132889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f827ea-fe4f-4e1b-b2ed-001c38557c57 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:03.159292 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:03.165081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc030c6-2242-4b42-8ab1-1f6d00a942c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:03.165672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc030c6-2242-4b42-8ab1-1f6d00a942c6 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:03.165960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc030c6-2242-4b42-8ab1-1f6d00a942c6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:03.166241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc030c6-2242-4b42-8ab1-1f6d00a942c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:03.196602 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:03.238384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc030c6-2242-4b42-8ab1-1f6d00a942c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:03.239889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc030c6-2242-4b42-8ab1-1f6d00a942c6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:03.248642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f827ea-fe4f-4e1b-b2ed-001c38557c57 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:03.304165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f429af-c52b-4869-bf2a-5cc7312b795f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:03.305143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f429af-c52b-4869-bf2a-5cc7312b795f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:03.305440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f429af-c52b-4869-bf2a-5cc7312b795f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:03.305725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f429af-c52b-4869-bf2a-5cc7312b795f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:03.324210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f429af-c52b-4869-bf2a-5cc7312b795f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-f6f429af-c52b-4869-bf2a-5cc7312b795f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:03.328449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:03.329292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 58/110] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:49:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:03.331341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e3152-c13d-4ded-9749-71eb5efef06d None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:03.331699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e3152-c13d-4ded-9749-71eb5efef06d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:03.332011 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e3152-c13d-4ded-9749-71eb5efef06d None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:03.333467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 59/111] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:03.334097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e3152-c13d-4ded-9749-71eb5efef06d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:03.369545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 53/112] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:03.370719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc030c6-2242-4b42-8ab1-1f6d00a942c6 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:03.403366 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:03.461779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e3152-c13d-4ded-9749-71eb5efef06d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:03.483004 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:03.485347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc030c6-2242-4b42-8ab1-1f6d00a942c6 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:03.497443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088d3b9-db80-4c36-9cda-03efe1f7a6b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:03.498387 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088d3b9-db80-4c36-9cda-03efe1f7a6b8 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:03.498676 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088d3b9-db80-4c36-9cda-03efe1f7a6b8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:03.498958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088d3b9-db80-4c36-9cda-03efe1f7a6b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:03.500199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088d3b9-db80-4c36-9cda-03efe1f7a6b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:03.501846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088d3b9-db80-4c36-9cda-03efe1f7a6b8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:03.503513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 60/113] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:03.504338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088d3b9-db80-4c36-9cda-03efe1f7a6b8 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:03.520166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1497c97b-53c6-47b8-a2f4-7a25c4f8ca9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:03.520846 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497c97b-53c6-47b8-a2f4-7a25c4f8ca9e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:03.521132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497c97b-53c6-47b8-a2f4-7a25c4f8ca9e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:03.521417 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1497c97b-53c6-47b8-a2f4-7a25c4f8ca9e None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:03.522226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497c97b-53c6-47b8-a2f4-7a25c4f8ca9e None admin] RBAC: Adding query filter params (name=member) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:03.522539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497c97b-53c6-47b8-a2f4-7a25c4f8ca9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:03.523974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1497c97b-53c6-47b8-a2f4-7a25c4f8ca9e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:03.537753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 54/114] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:03.537753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0da959-8b9d-437e-ae93-2ffceb592449 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:03.537753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0da959-8b9d-437e-ae93-2ffceb592449 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:03.537753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0da959-8b9d-437e-ae93-2ffceb592449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:03.550681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-1d0da959-8b9d-437e-ae93-2ffceb592449 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:03.551892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1d0da959-8b9d-437e-ae93-2ffceb592449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:03.609557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088d3b9-db80-4c36-9cda-03efe1f7a6b8 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:03.624472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 55/115] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:03.625364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0da959-8b9d-437e-ae93-2ffceb592449 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:03.650001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d5710-6c0e-4fd1-9eab-8678ba99654a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:03.650683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d5710-6c0e-4fd1-9eab-8678ba99654a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:03.650977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d5710-6c0e-4fd1-9eab-8678ba99654a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:03.651703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d5710-6c0e-4fd1-9eab-8678ba99654a None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:03.652527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d5710-6c0e-4fd1-9eab-8678ba99654a None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:03.653010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d5710-6c0e-4fd1-9eab-8678ba99654a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:03.654236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:03.654466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d5710-6c0e-4fd1-9eab-8678ba99654a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:03.663694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 61/116] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:03.668764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f876ce-d9a7-43e3-a6d8-6342eadddc4b None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:03.668764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f876ce-d9a7-43e3-a6d8-6342eadddc4b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:03.668764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f876ce-d9a7-43e3-a6d8-6342eadddc4b None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:03.668764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 62/117] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:03.668764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f876ce-d9a7-43e3-a6d8-6342eadddc4b None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:03.726552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:03.733116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0da959-8b9d-437e-ae93-2ffceb592449 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:03.766917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abfd82-db19-42cb-bf16-d7f3e55b846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:03.767767 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abfd82-db19-42cb-bf16-d7f3e55b846d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:03.768091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abfd82-db19-42cb-bf16-d7f3e55b846d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:03.768374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abfd82-db19-42cb-bf16-d7f3e55b846d None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:03.769567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abfd82-db19-42cb-bf16-d7f3e55b846d None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:03.771043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abfd82-db19-42cb-bf16-d7f3e55b846d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:03.772775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 56/118] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:03 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:03.776671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abfd82-db19-42cb-bf16-d7f3e55b846d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:03.779545 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f876ce-d9a7-43e3-a6d8-6342eadddc4b None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:03.813350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5d5da-51da-431a-9220-af0590eee6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:03.814018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5d5da-51da-431a-9220-af0590eee6de None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:03.814306 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5d5da-51da-431a-9220-af0590eee6de None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:03.814587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d5d5da-51da-431a-9220-af0590eee6de None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:03.815304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5d5da-51da-431a-9220-af0590eee6de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:03.816806 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d5d5da-51da-431a-9220-af0590eee6de None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:03.865488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:03.874523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abfd82-db19-42cb-bf16-d7f3e55b846d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:03.907104 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff25743-0ab8-4af7-ad81-640435213e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:03.907283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 63/119] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:49:03 2022] POST /identity/v3/projects => generated 302 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:03.907985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff25743-0ab8-4af7-ad81-640435213e81 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:03.908159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5d5da-51da-431a-9220-af0590eee6de None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:03.908352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff25743-0ab8-4af7-ad81-640435213e81 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:03.908641 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff25743-0ab8-4af7-ad81-640435213e81 None admin] PATH_INFO: `/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:03.909867 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff25743-0ab8-4af7-ad81-640435213e81 None admin] RBAC: Authorizing `identity:get_user(user_id=46a7431e426c4d01bc6f4ec5de1e2a53)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:03.911361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff25743-0ab8-4af7-ad81-640435213e81 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:03.913246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 57/120] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:03 2022] GET /identity/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53 => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:03.914058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff25743-0ab8-4af7-ad81-640435213e81 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:04.033287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d5d5da-51da-431a-9220-af0590eee6de None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:04.036112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:04.036653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff25743-0ab8-4af7-ad81-640435213e81 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:04.076421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484014dd-345f-41bc-8405-7a6dfe22e24d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:04.077358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffaf9c7-280b-43f5-8fd1-f61c2fe15548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:04.077483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484014dd-345f-41bc-8405-7a6dfe22e24d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:04.077755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484014dd-345f-41bc-8405-7a6dfe22e24d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:04.077939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaf9c7-280b-43f5-8fd1-f61c2fe15548 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:04.078034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484014dd-345f-41bc-8405-7a6dfe22e24d None admin] PATH_INFO: `/v3/roles/member` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:04.078270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaf9c7-280b-43f5-8fd1-f61c2fe15548 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:04.078557 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffaf9c7-280b-43f5-8fd1-f61c2fe15548 None admin] PATH_INFO: `/v3/users/42a7a441efc44b648a036ca3257b9aad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:04.079824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaf9c7-280b-43f5-8fd1-f61c2fe15548 None admin] RBAC: Authorizing `identity:get_user(user_id=42a7a441efc44b648a036ca3257b9aad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:04.081298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffaf9c7-280b-43f5-8fd1-f61c2fe15548 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:04.082981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 58/121] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:03 2022] GET /identity/v3/users/42a7a441efc44b648a036ca3257b9aad => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:04.084237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ba2af-ce70-405e-a8b8-e1fb6b966ede None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:04.084533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ba2af-ce70-405e-a8b8-e1fb6b966ede None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:04.084819 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ba2af-ce70-405e-a8b8-e1fb6b966ede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:04.092869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484014dd-345f-41bc-8405-7a6dfe22e24d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-484014dd-345f-41bc-8405-7a6dfe22e24d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:04.102557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:04.103446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:04.104239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 64/122] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:04.105001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-685ba2af-ce70-405e-a8b8-e1fb6b966ede None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:04.105120 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484014dd-345f-41bc-8405-7a6dfe22e24d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:04.105936 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-685ba2af-ce70-405e-a8b8-e1fb6b966ede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:04.130060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:04.180831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 59/123] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:04.188176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ba2af-ce70-405e-a8b8-e1fb6b966ede None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:04.231737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484014dd-345f-41bc-8405-7a6dfe22e24d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:04.266941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18c358-bf25-41b2-afa9-9cc32ec41fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:04.267613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18c358-bf25-41b2-afa9-9cc32ec41fd6 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:04.267925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18c358-bf25-41b2-afa9-9cc32ec41fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:04.268208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18c358-bf25-41b2-afa9-9cc32ec41fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:04.269051 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18c358-bf25-41b2-afa9-9cc32ec41fd6 None admin] RBAC: Adding query filter params (role.id=2ef5a03d73624ab1b355f5ba18d1fe18, scope.project.id=e6da88ad0e094644bb7b47c1e809bb60, user.id=4cf6f287a58d4302ab8cca566a79c1b5) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:04.269365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18c358-bf25-41b2-afa9-9cc32ec41fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:04.271256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae18c358-bf25-41b2-afa9-9cc32ec41fd6 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:04.287923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 65/124] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:04 2022] GET /identity/v3/role_assignments?user.id=4cf6f287a58d4302ab8cca566a79c1b5&scope.project.id=e6da88ad0e094644bb7b47c1e809bb60&role.id=2ef5a03d73624ab1b355f5ba18d1fe18 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:04.287923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18c358-bf25-41b2-afa9-9cc32ec41fd6 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:04.310232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ba2af-ce70-405e-a8b8-e1fb6b966ede None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:04.324507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:04.361465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fbc33-4e1d-4b7d-8a3f-ccaca9342ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:04.362516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fbc33-4e1d-4b7d-8a3f-ccaca9342ee8 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:04.363185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fbc33-4e1d-4b7d-8a3f-ccaca9342ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:04.363465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41fbc33-4e1d-4b7d-8a3f-ccaca9342ee8 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:04.365168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fbc33-4e1d-4b7d-8a3f-ccaca9342ee8 None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:04.366864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41fbc33-4e1d-4b7d-8a3f-ccaca9342ee8 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:04.369472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 60/125] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:04 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:04.370378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fbc33-4e1d-4b7d-8a3f-ccaca9342ee8 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:04.405133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:04.413337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18c358-bf25-41b2-afa9-9cc32ec41fd6 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:04.463869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961f445-02f3-492f-9723-bb1516b155cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:04.463869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f445-02f3-492f-9723-bb1516b155cc None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:04.463869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f445-02f3-492f-9723-bb1516b155cc None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:04.463869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3961f445-02f3-492f-9723-bb1516b155cc None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:04.464290 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961f445-02f3-492f-9723-bb1516b155cc None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:04.464520 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3961f445-02f3-492f-9723-bb1516b155cc None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:04.467318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 66/126] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:04 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:04.467318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961f445-02f3-492f-9723-bb1516b155cc None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:04.503433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41fbc33-4e1d-4b7d-8a3f-ccaca9342ee8 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:04.550072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b124e-8026-402d-826e-91d3163e9776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:04.551122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b124e-8026-402d-826e-91d3163e9776 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:04.551612 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b124e-8026-402d-826e-91d3163e9776 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:04.552187 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b124e-8026-402d-826e-91d3163e9776 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:04.553165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b124e-8026-402d-826e-91d3163e9776 None admin] RBAC: Adding query filter params (name=member) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:04.553673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b124e-8026-402d-826e-91d3163e9776 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:04.555747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b124e-8026-402d-826e-91d3163e9776 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:04.572073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 61/127] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:04.573048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b124e-8026-402d-826e-91d3163e9776 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:04.585678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:04.593746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3961f445-02f3-492f-9723-bb1516b155cc None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:04.641238 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014f0f3-fd69-4cf3-a7a2-bed245694b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:04.642072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f0f3-fd69-4cf3-a7a2-bed245694b5c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:04.642366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f0f3-fd69-4cf3-a7a2-bed245694b5c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:04.642660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d014f0f3-fd69-4cf3-a7a2-bed245694b5c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:04.658976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d014f0f3-fd69-4cf3-a7a2-bed245694b5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-d014f0f3-fd69-4cf3-a7a2-bed245694b5c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:04.670570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:04.671482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:04.672274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:04.672274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:04.672274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:04.672274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:04.672274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:04.672274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:04.672274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:04.672274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:04.672274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:04.672274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:04.672274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:04.672274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:04.677537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 67/128] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:49:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:04.678455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014f0f3-fd69-4cf3-a7a2-bed245694b5c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:04.692749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:04.712170 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b124e-8026-402d-826e-91d3163e9776 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:04.756221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12477413-8988-4ae1-bbf5-1d5bf509a590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:04.758017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477413-8988-4ae1-bbf5-1d5bf509a590 None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:04.758497 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477413-8988-4ae1-bbf5-1d5bf509a590 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:04.759209 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12477413-8988-4ae1-bbf5-1d5bf509a590 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60/users/46a7431e426c4d01bc6f4ec5de1e2a53/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:04.762027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12477413-8988-4ae1-bbf5-1d5bf509a590 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6da88ad0e094644bb7b47c1e809bb60, user_id=46a7431e426c4d01bc6f4ec5de1e2a53, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:04.764247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12477413-8988-4ae1-bbf5-1d5bf509a590 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:04.804516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d014f0f3-fd69-4cf3-a7a2-bed245694b5c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:04.840257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26349-9616-49c2-91bb-94901c9b9799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:04.841160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26349-9616-49c2-91bb-94901c9b9799 None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:04.841457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26349-9616-49c2-91bb-94901c9b9799 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:04.841757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26349-9616-49c2-91bb-94901c9b9799 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60/users/42a7a441efc44b648a036ca3257b9aad/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:04.843774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be26349-9616-49c2-91bb-94901c9b9799 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6da88ad0e094644bb7b47c1e809bb60, user_id=42a7a441efc44b648a036ca3257b9aad, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:04.845451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be26349-9616-49c2-91bb-94901c9b9799 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:04.850687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 62/129] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:49:04 2022] PUT /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60/users/46a7431e426c4d01bc6f4ec5de1e2a53/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:04.851875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12477413-8988-4ae1-bbf5-1d5bf509a590 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:04.970616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 68/130] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:49:04 2022] PUT /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60/users/42a7a441efc44b648a036ca3257b9aad/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:04.971522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26349-9616-49c2-91bb-94901c9b9799 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:04.974583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12477413-8988-4ae1-bbf5-1d5bf509a590 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:05.006051 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:05.017874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32090e66-9771-4df2-babf-d635e100cf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:05.019084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32090e66-9771-4df2-babf-d635e100cf83 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:05.019537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32090e66-9771-4df2-babf-d635e100cf83 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:05.020046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32090e66-9771-4df2-babf-d635e100cf83 None admin] PATH_INFO: `/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:05.021633 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32090e66-9771-4df2-babf-d635e100cf83 None admin] RBAC: Authorizing `identity:get_user(user_id=46a7431e426c4d01bc6f4ec5de1e2a53)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:05.023541 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32090e66-9771-4df2-babf-d635e100cf83 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:05.025905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 63/131] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:04 2022] GET /identity/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:05.033393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32090e66-9771-4df2-babf-d635e100cf83 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:05.065548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:05.180642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26349-9616-49c2-91bb-94901c9b9799 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:05.231280 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32090e66-9771-4df2-babf-d635e100cf83 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:05.249912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95623a44-99e3-4de9-b68b-b9da3ba6697b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:05.250596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95623a44-99e3-4de9-b68b-b9da3ba6697b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:05.250888 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95623a44-99e3-4de9-b68b-b9da3ba6697b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:05.251175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95623a44-99e3-4de9-b68b-b9da3ba6697b None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:05.251968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95623a44-99e3-4de9-b68b-b9da3ba6697b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:05.252286 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95623a44-99e3-4de9-b68b-b9da3ba6697b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:05.253691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95623a44-99e3-4de9-b68b-b9da3ba6697b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:05.278226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 69/132] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:05.283414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95623a44-99e3-4de9-b68b-b9da3ba6697b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:05.288216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328596c2-acf4-4cca-a97d-591bd8ad92aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:05.289093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328596c2-acf4-4cca-a97d-591bd8ad92aa None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:05.289384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328596c2-acf4-4cca-a97d-591bd8ad92aa None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:05.289670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328596c2-acf4-4cca-a97d-591bd8ad92aa None admin] PATH_INFO: `/v3/projects/d243a81490be49a7bf96f49274a9da61` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:05.291992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328596c2-acf4-4cca-a97d-591bd8ad92aa None admin] RBAC: Authorizing `identity:get_project(project_id=d243a81490be49a7bf96f49274a9da61)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:05.293545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328596c2-acf4-4cca-a97d-591bd8ad92aa None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:05.295742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 64/133] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:05 2022] GET /identity/v3/projects/d243a81490be49a7bf96f49274a9da61 => generated 312 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:05.302024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328596c2-acf4-4cca-a97d-591bd8ad92aa None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:05.440825 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:05.454351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:05.460763 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328596c2-acf4-4cca-a97d-591bd8ad92aa None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:05.535047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95623a44-99e3-4de9-b68b-b9da3ba6697b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:05.536061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d89a7-a299-4fda-940c-32cb3dc172f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:05.537166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d89a7-a299-4fda-940c-32cb3dc172f1 None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:05.537608 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d89a7-a299-4fda-940c-32cb3dc172f1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:05.538067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d89a7-a299-4fda-940c-32cb3dc172f1 None admin] PATH_INFO: `/v3/projects/d243a81490be49a7bf96f49274a9da61/users/46a7431e426c4d01bc6f4ec5de1e2a53/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:05.540548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d89a7-a299-4fda-940c-32cb3dc172f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d243a81490be49a7bf96f49274a9da61, user_id=46a7431e426c4d01bc6f4ec5de1e2a53, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:05.542328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59d89a7-a299-4fda-940c-32cb3dc172f1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:05.572190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f1ceb-7df7-4b94-9dcb-9b6aeac8b392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:05.573136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f1ceb-7df7-4b94-9dcb-9b6aeac8b392 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:05.573435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f1ceb-7df7-4b94-9dcb-9b6aeac8b392 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:05.573718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f1ceb-7df7-4b94-9dcb-9b6aeac8b392 None admin] PATH_INFO: `/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:05.574994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f1ceb-7df7-4b94-9dcb-9b6aeac8b392 None admin] RBAC: Authorizing `identity:get_user(user_id=46a7431e426c4d01bc6f4ec5de1e2a53)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:05.577078 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f1ceb-7df7-4b94-9dcb-9b6aeac8b392 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:05.579093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 70/134] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:05 2022] GET /identity/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53 => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:05.585958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f1ceb-7df7-4b94-9dcb-9b6aeac8b392 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:05.632043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 65/135] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:49:05 2022] PUT /identity/v3/projects/d243a81490be49a7bf96f49274a9da61/users/46a7431e426c4d01bc6f4ec5de1e2a53/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:05.720826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f1ceb-7df7-4b94-9dcb-9b6aeac8b392 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:05.768624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0737dff-0b64-4729-8ea9-d95e3a004c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:05.769540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0737dff-0b64-4729-8ea9-d95e3a004c28 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:05.769831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0737dff-0b64-4729-8ea9-d95e3a004c28 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:05.770118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0737dff-0b64-4729-8ea9-d95e3a004c28 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:05.771565 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0737dff-0b64-4729-8ea9-d95e3a004c28 None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:05.773116 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0737dff-0b64-4729-8ea9-d95e3a004c28 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:05.775275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 71/136] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:05 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:05.781261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d89a7-a299-4fda-940c-32cb3dc172f1 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:05.922002 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59d89a7-a299-4fda-940c-32cb3dc172f1 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:05.968968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba31660b-9c6f-4f83-920a-8127ea2e9e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:05.969871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31660b-9c6f-4f83-920a-8127ea2e9e1b None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:05.970161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31660b-9c6f-4f83-920a-8127ea2e9e1b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:05.970444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba31660b-9c6f-4f83-920a-8127ea2e9e1b None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60/users/46a7431e426c4d01bc6f4ec5de1e2a53/roles/d7474d28a1f24780a0b4c715fdff50b1` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:05.973719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31660b-9c6f-4f83-920a-8127ea2e9e1b None admin] RBAC: Authorizing `identity:create_grant(project_id=e6da88ad0e094644bb7b47c1e809bb60, user_id=46a7431e426c4d01bc6f4ec5de1e2a53, role_id=d7474d28a1f24780a0b4c715fdff50b1)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:05.975148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba31660b-9c6f-4f83-920a-8127ea2e9e1b None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:06.078361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 66/137] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:49:05 2022] PUT /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60/users/46a7431e426c4d01bc6f4ec5de1e2a53/roles/d7474d28a1f24780a0b4c715fdff50b1 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:06.574770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414c44b-2d45-49f2-acbc-ceeb6af66459 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:06.574770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414c44b-2d45-49f2-acbc-ceeb6af66459 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:06.574770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8414c44b-2d45-49f2-acbc-ceeb6af66459 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:06.574770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 72/138] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:06.584447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280d45f-86fe-4c9f-9ce4-f2e104984e76 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:06.585263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280d45f-86fe-4c9f-9ce4-f2e104984e76 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:06.585742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280d45f-86fe-4c9f-9ce4-f2e104984e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:06.592690 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:06.612853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-0280d45f-86fe-4c9f-9ce4-f2e104984e76 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:06.614085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0280d45f-86fe-4c9f-9ce4-f2e104984e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:06.692148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 67/139] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:06.716909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414c44b-2d45-49f2-acbc-ceeb6af66459 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:06.734019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:06.825360 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8414c44b-2d45-49f2-acbc-ceeb6af66459 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:06.861063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb995540-cccc-47be-a2bd-a17dcedb3424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:06.861867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb995540-cccc-47be-a2bd-a17dcedb3424 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:06.862162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb995540-cccc-47be-a2bd-a17dcedb3424 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:06.862445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb995540-cccc-47be-a2bd-a17dcedb3424 None admin] PATH_INFO: `/v3/domains/default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:06.863649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb995540-cccc-47be-a2bd-a17dcedb3424 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:06.865205 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb995540-cccc-47be-a2bd-a17dcedb3424 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:06.867149 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 73/140] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:06.873131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280d45f-86fe-4c9f-9ce4-f2e104984e76 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:06.885313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bd05d-7ae7-41b8-b463-58a44ea98e0b None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:06.885612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bd05d-7ae7-41b8-b463-58a44ea98e0b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:06.885885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1bd05d-7ae7-41b8-b463-58a44ea98e0b None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:06.887276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 74/141] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:06.899186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97735bfa-e180-48fe-bc28-6bf07d5b1a8f None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:06.899478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97735bfa-e180-48fe-bc28-6bf07d5b1a8f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:06.899769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97735bfa-e180-48fe-bc28-6bf07d5b1a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:06.919011 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-97735bfa-e180-48fe-bc28-6bf07d5b1a8f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:06.920316 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-97735bfa-e180-48fe-bc28-6bf07d5b1a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:07.000791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 75/142] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:07.038643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97735bfa-e180-48fe-bc28-6bf07d5b1a8f None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:07.051221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280d45f-86fe-4c9f-9ce4-f2e104984e76 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:07.060689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:07.136334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:07.145631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052c885-6a85-42ee-bd5c-300f6cc0ecde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:07.146626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052c885-6a85-42ee-bd5c-300f6cc0ecde None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:07.152259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052c885-6a85-42ee-bd5c-300f6cc0ecde None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:07.153584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9052c885-6a85-42ee-bd5c-300f6cc0ecde None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:07.155685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052c885-6a85-42ee-bd5c-300f6cc0ecde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:07.157071 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9052c885-6a85-42ee-bd5c-300f6cc0ecde None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:07.237577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97735bfa-e180-48fe-bc28-6bf07d5b1a8f None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:07.289452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531865f-2898-42b1-906a-96dac4da151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:07.290654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531865f-2898-42b1-906a-96dac4da151e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:07.291192 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531865f-2898-42b1-906a-96dac4da151e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:07.295537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b531865f-2898-42b1-906a-96dac4da151e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:07.301691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 68/143] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:49:06 2022] POST /identity/v3/users => generated 283 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:07.319244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b531865f-2898-42b1-906a-96dac4da151e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-b531865f-2898-42b1-906a-96dac4da151e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:07.330814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:07.331770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:07.332560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:07.332560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:07.332560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:07.332560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:07.332560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:07.332560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:07.332560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:07.332560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:07.332560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:07.332560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:07.332560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:07.332560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:07.335179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 76/144] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:49:07.341675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052c885-6a85-42ee-bd5c-300f6cc0ecde None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:07.480389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9052c885-6a85-42ee-bd5c-300f6cc0ecde None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:07.525990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf00a00-e33a-435d-9b2f-317199dbb342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:07.527082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf00a00-e33a-435d-9b2f-317199dbb342 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:07.527577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf00a00-e33a-435d-9b2f-317199dbb342 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:07.528102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf00a00-e33a-435d-9b2f-317199dbb342 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:07.529204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf00a00-e33a-435d-9b2f-317199dbb342 None admin] RBAC: Adding query filter params (name=reader) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:07.529719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf00a00-e33a-435d-9b2f-317199dbb342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:07.531378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf00a00-e33a-435d-9b2f-317199dbb342 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:07.544414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 69/145] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:07.550518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531865f-2898-42b1-906a-96dac4da151e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:07.647983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:07.683286 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b531865f-2898-42b1-906a-96dac4da151e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:07.729430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0f58f-1058-4465-8e90-373a4481cb42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:07.730312 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0f58f-1058-4465-8e90-373a4481cb42 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:07.730655 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0f58f-1058-4465-8e90-373a4481cb42 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:07.730875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0f58f-1058-4465-8e90-373a4481cb42 None admin] PATH_INFO: `/v3/users/4cf6f287a58d4302ab8cca566a79c1b5` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:07.732158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0f58f-1058-4465-8e90-373a4481cb42 None admin] RBAC: Authorizing `identity:get_user(user_id=4cf6f287a58d4302ab8cca566a79c1b5)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:07.733625 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0f58f-1058-4465-8e90-373a4481cb42 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:07.735577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 77/146] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:07 2022] GET /identity/v3/users/4cf6f287a58d4302ab8cca566a79c1b5 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:07.741020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf00a00-e33a-435d-9b2f-317199dbb342 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:07.802578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:07.852203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26c0e-0697-4066-83cc-be996c0263c1 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:07.852495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26c0e-0697-4066-83cc-be996c0263c1 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:07.852776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c26c0e-0697-4066-83cc-be996c0263c1 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:07.854299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 78/147] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:07.859964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1f3cd-9ea0-4c8f-8f8d-fbd7b5386c9c None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:07.860253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1f3cd-9ea0-4c8f-8f8d-fbd7b5386c9c None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:07.860533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c1f3cd-9ea0-4c8f-8f8d-fbd7b5386c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:07.892391 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-e2c1f3cd-9ea0-4c8f-8f8d-fbd7b5386c9c None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:07.893611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e2c1f3cd-9ea0-4c8f-8f8d-fbd7b5386c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:07.894434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf00a00-e33a-435d-9b2f-317199dbb342 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:07.943279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ee454-4fd3-4a0f-8009-8ef65b5fc2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:07.944192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee454-4fd3-4a0f-8009-8ef65b5fc2b0 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:07.944476 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee454-4fd3-4a0f-8009-8ef65b5fc2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:07.944757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ee454-4fd3-4a0f-8009-8ef65b5fc2b0 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:07.947103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ee454-4fd3-4a0f-8009-8ef65b5fc2b0 None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:07.948599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378ee454-4fd3-4a0f-8009-8ef65b5fc2b0 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:07.950326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 70/148] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:07 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:07.956603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ee454-4fd3-4a0f-8009-8ef65b5fc2b0 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:07.995256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 79/149] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:08.033471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1f3cd-9ea0-4c8f-8f8d-fbd7b5386c9c None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:08.127852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:08.137241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378ee454-4fd3-4a0f-8009-8ef65b5fc2b0 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:08.171332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:08.172607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c1f3cd-9ea0-4c8f-8f8d-fbd7b5386c9c None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:08.215910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155c04c-7439-4f02-b8d7-f2f8b7353b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:08.217198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155c04c-7439-4f02-b8d7-f2f8b7353b56 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:08.217665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155c04c-7439-4f02-b8d7-f2f8b7353b56 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:08.218209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1155c04c-7439-4f02-b8d7-f2f8b7353b56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:08.226244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd5727-4684-434c-aaae-d1e36716411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:08.227735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd5727-4684-434c-aaae-d1e36716411f None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:08.228030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd5727-4684-434c-aaae-d1e36716411f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:08.228424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd5727-4684-434c-aaae-d1e36716411f None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60/users/4cf6f287a58d4302ab8cca566a79c1b5/roles/2ef5a03d73624ab1b355f5ba18d1fe18` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:08.231233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1155c04c-7439-4f02-b8d7-f2f8b7353b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:08.237170 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd5727-4684-434c-aaae-d1e36716411f None admin] RBAC: Authorizing `identity:create_grant(project_id=e6da88ad0e094644bb7b47c1e809bb60, user_id=4cf6f287a58d4302ab8cca566a79c1b5, role_id=2ef5a03d73624ab1b355f5ba18d1fe18)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:08.238262 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd5727-4684-434c-aaae-d1e36716411f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-1155c04c-7439-4f02-b8d7-f2f8b7353b56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:08.244378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:08.245317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:08.246085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:08.246085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:08.246085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:08.246085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:08.246085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:08.246085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:08.246085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:08.246085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:08.246085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:08.246085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:08.246085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:08.246085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:08.250023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 80/150] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:49:08.256256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155c04c-7439-4f02-b8d7-f2f8b7353b56 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:08.346320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 71/151] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:49:07 2022] PUT /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60/users/4cf6f287a58d4302ab8cca566a79c1b5/roles/2ef5a03d73624ab1b355f5ba18d1fe18 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:49:08.368947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1155c04c-7439-4f02-b8d7-f2f8b7353b56 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:08.401127 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:08.409637 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e9129-78a1-43eb-97d4-cf375d2b3777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:08.410596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e9129-78a1-43eb-97d4-cf375d2b3777 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:08.411030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e9129-78a1-43eb-97d4-cf375d2b3777 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:08.411457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e9129-78a1-43eb-97d4-cf375d2b3777 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:08.412444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e9129-78a1-43eb-97d4-cf375d2b3777 None admin] RBAC: Adding query filter params (name=member) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:08.412904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e9129-78a1-43eb-97d4-cf375d2b3777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:08.414497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e9129-78a1-43eb-97d4-cf375d2b3777 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:08.424690 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 81/152] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:08.430873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd5727-4684-434c-aaae-d1e36716411f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:08.504711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed962-1771-42ab-a3d7-03f6b7abbafa None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:08.505210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed962-1771-42ab-a3d7-03f6b7abbafa None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:08.505658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51ed962-1771-42ab-a3d7-03f6b7abbafa None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:08.507256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 82/153] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:49:08.513131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f836ddb-82a6-4259-9402-9d169f1995e8 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:08.513731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f836ddb-82a6-4259-9402-9d169f1995e8 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:08.514191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f836ddb-82a6-4259-9402-9d169f1995e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:08.541959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0f836ddb-82a6-4259-9402-9d169f1995e8 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:08.546476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0f836ddb-82a6-4259-9402-9d169f1995e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:08.639356 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 83/154] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:08.643404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd5727-4684-434c-aaae-d1e36716411f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:08.679900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfe6d2-365f-4471-b882-f405ba2b3d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:08.680824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe6d2-365f-4471-b882-f405ba2b3d68 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:08.681114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe6d2-365f-4471-b882-f405ba2b3d68 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:08.681399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cfe6d2-365f-4471-b882-f405ba2b3d68 None admin] PATH_INFO: `/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:08.682638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfe6d2-365f-4471-b882-f405ba2b3d68 None admin] RBAC: Authorizing `identity:get_user(user_id=46a7431e426c4d01bc6f4ec5de1e2a53)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:08.684147 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cfe6d2-365f-4471-b882-f405ba2b3d68 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:08.685880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 72/155] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:08 2022] GET /identity/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:08.690353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f836ddb-82a6-4259-9402-9d169f1995e8 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:08.698252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfe6d2-365f-4471-b882-f405ba2b3d68 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:08.789397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:08.812948 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f836ddb-82a6-4259-9402-9d169f1995e8 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:08.836305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:08.855113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9ec6-b06e-4211-8b21-f3773f1f7040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:08.855113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9ec6-b06e-4211-8b21-f3773f1f7040 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:08.855113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9ec6-b06e-4211-8b21-f3773f1f7040 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:08.855113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfc9ec6-b06e-4211-8b21-f3773f1f7040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:08.865493 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfc9ec6-b06e-4211-8b21-f3773f1f7040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:08.867010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cfe6d2-365f-4471-b882-f405ba2b3d68 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-8dfc9ec6-b06e-4211-8b21-f3773f1f7040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:08.873525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:08.874573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:08.876124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 84/156] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:49:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:08.880582 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9ec6-b06e-4211-8b21-f3773f1f7040 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:08.920474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde5fb4-5582-439d-858c-dc74d4c772d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:08.921495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde5fb4-5582-439d-858c-dc74d4c772d4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:08.921992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde5fb4-5582-439d-858c-dc74d4c772d4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:08.922515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde5fb4-5582-439d-858c-dc74d4c772d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:09.010628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde5fb4-5582-439d-858c-dc74d4c772d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:09.012510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fde5fb4-5582-439d-858c-dc74d4c772d4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:09.013673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfc9ec6-b06e-4211-8b21-f3773f1f7040 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:09.058519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa89dfb-3f3a-493a-845d-aa521a959b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:09.059170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa89dfb-3f3a-493a-845d-aa521a959b13 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:09.059462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa89dfb-3f3a-493a-845d-aa521a959b13 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:09.059788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa89dfb-3f3a-493a-845d-aa521a959b13 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:09.061117 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa89dfb-3f3a-493a-845d-aa521a959b13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:09.061481 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa89dfb-3f3a-493a-845d-aa521a959b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:09.062895 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa89dfb-3f3a-493a-845d-aa521a959b13 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:09.073758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 85/157] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:09.075394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e28bf-ae23-4959-b38a-64a23589cd61 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:09.075732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e28bf-ae23-4959-b38a-64a23589cd61 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:09.080199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8e28bf-ae23-4959-b38a-64a23589cd61 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:09.080646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:09.083182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 86/158] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:09.084397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e28bf-ae23-4959-b38a-64a23589cd61 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:09.180199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:09.194905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 73/159] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:09.197407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a09352-c453-42ac-9e95-107e78d9c77b None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:09.197699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a09352-c453-42ac-9e95-107e78d9c77b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:09.197980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a09352-c453-42ac-9e95-107e78d9c77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:09.236966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-28a09352-c453-42ac-9e95-107e78d9c77b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:09.238194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-28a09352-c453-42ac-9e95-107e78d9c77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:09.361707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8e28bf-ae23-4959-b38a-64a23589cd61 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:09.425263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 74/160] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:09.426222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a09352-c453-42ac-9e95-107e78d9c77b None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:09.430178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff4328-75b2-495c-85e2-ca244481e373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:09.431088 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4328-75b2-495c-85e2-ca244481e373 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:09.431372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4328-75b2-495c-85e2-ca244481e373 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:09.431650 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4328-75b2-495c-85e2-ca244481e373 None admin] PATH_INFO: `/v3/users/42a7a441efc44b648a036ca3257b9aad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:09.435303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff4328-75b2-495c-85e2-ca244481e373 None admin] RBAC: Authorizing `identity:get_user(user_id=42a7a441efc44b648a036ca3257b9aad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:09.436965 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff4328-75b2-495c-85e2-ca244481e373 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:09.438915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 87/161] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:09 2022] GET /identity/v3/users/42a7a441efc44b648a036ca3257b9aad => generated 247 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:09.444453 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff4328-75b2-495c-85e2-ca244481e373 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:09.564684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:09.614636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a09352-c453-42ac-9e95-107e78d9c77b None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:09.625522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff4328-75b2-495c-85e2-ca244481e373 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:09.640054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:09.673607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f25545-b67b-4e17-a193-e9245b224897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:09.674278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f25545-b67b-4e17-a193-e9245b224897 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:09.674563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f25545-b67b-4e17-a193-e9245b224897 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:09.674844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f25545-b67b-4e17-a193-e9245b224897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:09.698304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70accfc9-2a17-4114-b413-b13cb87987b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:09.699233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70accfc9-2a17-4114-b413-b13cb87987b5 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:09.699524 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70accfc9-2a17-4114-b413-b13cb87987b5 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:09.699823 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70accfc9-2a17-4114-b413-b13cb87987b5 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:09.703382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70accfc9-2a17-4114-b413-b13cb87987b5 None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:09.707539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70accfc9-2a17-4114-b413-b13cb87987b5 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:09.710885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 75/162] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:09 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:09.711696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70accfc9-2a17-4114-b413-b13cb87987b5 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:09.773608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f25545-b67b-4e17-a193-e9245b224897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:09.775122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f25545-b67b-4e17-a193-e9245b224897 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:09.910121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70accfc9-2a17-4114-b413-b13cb87987b5 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:09.971102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670f47f-8218-44d5-8990-055c5a3eae03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:09.972038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670f47f-8218-44d5-8990-055c5a3eae03 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:09.972322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670f47f-8218-44d5-8990-055c5a3eae03 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:09.972600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670f47f-8218-44d5-8990-055c5a3eae03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:09.991005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 88/163] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:49:09.991987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f25545-b67b-4e17-a193-e9245b224897 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:10.000749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1670f47f-8218-44d5-8990-055c5a3eae03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-1670f47f-8218-44d5-8990-055c5a3eae03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:10.008705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:10.009590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:10.010346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 76/164] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:10.011799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6f558-c30c-411e-8c7c-19d1cadabe17 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:10.011799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6f558-c30c-411e-8c7c-19d1cadabe17 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:10.011994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6f558-c30c-411e-8c7c-19d1cadabe17 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:10.013261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 77/165] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:10.013899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6f558-c30c-411e-8c7c-19d1cadabe17 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:10.014735 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:10.022911 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:10.144651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f25545-b67b-4e17-a193-e9245b224897 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:10.181224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be168b22-ce0f-4a2b-9c3c-f879380ebece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:10.182234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be168b22-ce0f-4a2b-9c3c-f879380ebece None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:10.182718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be168b22-ce0f-4a2b-9c3c-f879380ebece None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:10.183213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be168b22-ce0f-4a2b-9c3c-f879380ebece None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:10.184291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be168b22-ce0f-4a2b-9c3c-f879380ebece None admin] RBAC: Adding query filter params (role.id=7a7c8cc02f174648b814192cba5506ad, scope.project.id=e6da88ad0e094644bb7b47c1e809bb60, user.id=46a7431e426c4d01bc6f4ec5de1e2a53) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:10.184807 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be168b22-ce0f-4a2b-9c3c-f879380ebece None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:10.186505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be168b22-ce0f-4a2b-9c3c-f879380ebece None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:10.193001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 89/166] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:09 2022] GET /identity/v3/role_assignments?user.id=46a7431e426c4d01bc6f4ec5de1e2a53&scope.project.id=e6da88ad0e094644bb7b47c1e809bb60&role.id=7a7c8cc02f174648b814192cba5506ad => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:10.194495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90c27d-a8e0-4512-88ef-96e8e5497caa None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:10.194985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90c27d-a8e0-4512-88ef-96e8e5497caa None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:10.195481 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a90c27d-a8e0-4512-88ef-96e8e5497caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:10.213704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-3a90c27d-a8e0-4512-88ef-96e8e5497caa None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:10.215257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3a90c27d-a8e0-4512-88ef-96e8e5497caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:10.220654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6f558-c30c-411e-8c7c-19d1cadabe17 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:10.285082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6e49-cfd4-4649-9709-9a0e328dbd75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:10.286070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6e49-cfd4-4649-9709-9a0e328dbd75 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:10.286353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6e49-cfd4-4649-9709-9a0e328dbd75 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:10.286623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6e49-cfd4-4649-9709-9a0e328dbd75 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:10.289753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c6e49-cfd4-4649-9709-9a0e328dbd75 None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:10.291445 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c6e49-cfd4-4649-9709-9a0e328dbd75 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:10.293503 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 78/167] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:10 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:10.295145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6e49-cfd4-4649-9709-9a0e328dbd75 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:10.303934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 90/168] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:10.305966 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90c27d-a8e0-4512-88ef-96e8e5497caa None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:10.315076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:10.418454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a90c27d-a8e0-4512-88ef-96e8e5497caa None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:10.435929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:10.466962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6e49-cfd4-4649-9709-9a0e328dbd75 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:10.475397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210a7d5-8248-471c-822c-33c5258dda62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:10.476152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210a7d5-8248-471c-822c-33c5258dda62 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:10.476440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210a7d5-8248-471c-822c-33c5258dda62 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:10.476968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210a7d5-8248-471c-822c-33c5258dda62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:10.477905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210a7d5-8248-471c-822c-33c5258dda62 None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=e6da88ad0e094644bb7b47c1e809bb60, user.id=42a7a441efc44b648a036ca3257b9aad) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:10.478229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210a7d5-8248-471c-822c-33c5258dda62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:10.479733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0210a7d5-8248-471c-822c-33c5258dda62 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:10.491285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 91/169] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:10 2022] GET /identity/v3/role_assignments?user.id=42a7a441efc44b648a036ca3257b9aad&scope.project.id=e6da88ad0e094644bb7b47c1e809bb60&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:10.492082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210a7d5-8248-471c-822c-33c5258dda62 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:10.515283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9799f3-2fd3-4a8a-979b-96840b102798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:10.516778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9799f3-2fd3-4a8a-979b-96840b102798 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:10.517274 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9799f3-2fd3-4a8a-979b-96840b102798 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:10.517914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9799f3-2fd3-4a8a-979b-96840b102798 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:10.519260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9799f3-2fd3-4a8a-979b-96840b102798 None admin] RBAC: Adding query filter params (name=member) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:10.519761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9799f3-2fd3-4a8a-979b-96840b102798 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:10.521453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9799f3-2fd3-4a8a-979b-96840b102798 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:10.533193 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 79/170] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:10.539824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9799f3-2fd3-4a8a-979b-96840b102798 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:10.689928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:10.762418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9799f3-2fd3-4a8a-979b-96840b102798 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:10.771195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210a7d5-8248-471c-822c-33c5258dda62 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:10.813084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d1d5b-ad2e-4cda-a492-a320cf0bc276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:10.813912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d1d5b-ad2e-4cda-a492-a320cf0bc276 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:10.814197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d1d5b-ad2e-4cda-a492-a320cf0bc276 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:10.814478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d1d5b-ad2e-4cda-a492-a320cf0bc276 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:10.815848 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9237fb-1120-45e8-95bc-2ed790cae1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:10.817062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9237fb-1120-45e8-95bc-2ed790cae1cf None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:10.817667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9237fb-1120-45e8-95bc-2ed790cae1cf None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:10.818039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9237fb-1120-45e8-95bc-2ed790cae1cf None admin] PATH_INFO: `/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:10.822198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9237fb-1120-45e8-95bc-2ed790cae1cf None admin] RBAC: Authorizing `identity:get_user(user_id=46a7431e426c4d01bc6f4ec5de1e2a53)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:10.827851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9237fb-1120-45e8-95bc-2ed790cae1cf None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:10.827851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 80/171] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:10 2022] GET /identity/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53 => generated 275 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:10.831335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d1d5b-ad2e-4cda-a492-a320cf0bc276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:10.831682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9237fb-1120-45e8-95bc-2ed790cae1cf None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-907d1d5b-ad2e-4cda-a492-a320cf0bc276 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:10.841953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:10.843062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:10.844175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:10.844175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:10.844175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:10.844175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:10.844175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:10.844175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:10.844175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:10.844175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:10.844175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:10.844175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:10.844175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:10.844175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:10.846831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 92/172] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:49:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:10.848286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:10.853025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d1d5b-ad2e-4cda-a492-a320cf0bc276 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:10.983978 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9237fb-1120-45e8-95bc-2ed790cae1cf None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:11.014198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d1d5b-ad2e-4cda-a492-a320cf0bc276 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:11.034896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d88f3-a12b-4ef9-932e-a594f70b3d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:11.035871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d88f3-a12b-4ef9-932e-a594f70b3d7b None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:11.036304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d88f3-a12b-4ef9-932e-a594f70b3d7b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:11.036738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483d88f3-a12b-4ef9-932e-a594f70b3d7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:11.050216 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:11.061956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1917bf-4909-439b-a8f8-44397b729960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:11.062922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1917bf-4909-439b-a8f8-44397b729960 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:11.063366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1917bf-4909-439b-a8f8-44397b729960 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:11.068329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1917bf-4909-439b-a8f8-44397b729960 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:11.068329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1917bf-4909-439b-a8f8-44397b729960 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:11.068329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1917bf-4909-439b-a8f8-44397b729960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:11.068329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1917bf-4909-439b-a8f8-44397b729960 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:11.078900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 93/173] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:11.083580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1917bf-4909-439b-a8f8-44397b729960 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:11.170904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d88f3-a12b-4ef9-932e-a594f70b3d7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:11.173409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483d88f3-a12b-4ef9-932e-a594f70b3d7b None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:11.178585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:11.252978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1917bf-4909-439b-a8f8-44397b729960 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:11.336552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91357d-3190-490e-9389-728c4201556f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:11.337502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91357d-3190-490e-9389-728c4201556f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:11.337859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91357d-3190-490e-9389-728c4201556f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:11.338139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91357d-3190-490e-9389-728c4201556f None admin] PATH_INFO: `/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:11.339386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 81/174] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 508 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:49:11.339493 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91357d-3190-490e-9389-728c4201556f None admin] RBAC: Authorizing `identity:get_user(user_id=46a7431e426c4d01bc6f4ec5de1e2a53)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:11.343838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df91357d-3190-490e-9389-728c4201556f None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:11.343838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 94/175] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:11 2022] GET /identity/v3/users/46a7431e426c4d01bc6f4ec5de1e2a53 => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:11.345916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d88f3-a12b-4ef9-932e-a594f70b3d7b None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:11.348670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91357d-3190-490e-9389-728c4201556f None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:11.453257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483d88f3-a12b-4ef9-932e-a594f70b3d7b None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:11.455158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:11.460278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:11.498118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd219ab-d4e9-4178-8e89-c5ed886689f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:11.498993 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd219ab-d4e9-4178-8e89-c5ed886689f8 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:11.499273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd219ab-d4e9-4178-8e89-c5ed886689f8 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:11.499550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd219ab-d4e9-4178-8e89-c5ed886689f8 None admin] PATH_INFO: `/v3/projects/d243a81490be49a7bf96f49274a9da61` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:11.502057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd219ab-d4e9-4178-8e89-c5ed886689f8 None admin] RBAC: Authorizing `identity:get_project(project_id=d243a81490be49a7bf96f49274a9da61)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:11.503593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd219ab-d4e9-4178-8e89-c5ed886689f8 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:11.505503 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 82/176] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:11 2022] GET /identity/v3/projects/d243a81490be49a7bf96f49274a9da61 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:11.512798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd219ab-d4e9-4178-8e89-c5ed886689f8 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:11.525425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91357d-3190-490e-9389-728c4201556f None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:11.623535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1843ead5-b1a5-42be-8661-a21747cbc4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:11.624240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843ead5-b1a5-42be-8661-a21747cbc4c2 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:11.624522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843ead5-b1a5-42be-8661-a21747cbc4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:11.624798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1843ead5-b1a5-42be-8661-a21747cbc4c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:11.760537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd219ab-d4e9-4178-8e89-c5ed886689f8 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:11.772636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843ead5-b1a5-42be-8661-a21747cbc4c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:11.774117 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1843ead5-b1a5-42be-8661-a21747cbc4c2 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:11.828190 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7999ed-1aec-4230-9ae5-3c9dc353ca09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:11.829294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7999ed-1aec-4230-9ae5-3c9dc353ca09 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:11.829769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7999ed-1aec-4230-9ae5-3c9dc353ca09 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:11.830234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7999ed-1aec-4230-9ae5-3c9dc353ca09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:11.831263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7999ed-1aec-4230-9ae5-3c9dc353ca09 None admin] RBAC: Adding query filter params (role.id=7a7c8cc02f174648b814192cba5506ad, scope.project.id=d243a81490be49a7bf96f49274a9da61, user.id=46a7431e426c4d01bc6f4ec5de1e2a53) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:11.831778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7999ed-1aec-4230-9ae5-3c9dc353ca09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:11.833609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7999ed-1aec-4230-9ae5-3c9dc353ca09 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:11.843716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 83/177] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:11 2022] GET /identity/v3/role_assignments?user.id=46a7431e426c4d01bc6f4ec5de1e2a53&scope.project.id=d243a81490be49a7bf96f49274a9da61&role.id=7a7c8cc02f174648b814192cba5506ad => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:11.844397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb518f-0e94-4830-85ac-958572209f50 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:11.844686 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb518f-0e94-4830-85ac-958572209f50 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:11.844964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb518f-0e94-4830-85ac-958572209f50 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:11.849468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 84/178] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:11.849468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8b79a-0f99-4fea-b4bd-65ae2e5bd348 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:11.849468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8b79a-0f99-4fea-b4bd-65ae2e5bd348 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:11.849468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8b79a-0f99-4fea-b4bd-65ae2e5bd348 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:11.849468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 85/179] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:11.853846 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193cbf4-b96e-4bf3-ae5b-a7c5fa949b66 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:11.854131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193cbf4-b96e-4bf3-ae5b-a7c5fa949b66 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:11.854405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3193cbf4-b96e-4bf3-ae5b-a7c5fa949b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:11.880728 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:11.889164 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3193cbf4-b96e-4bf3-ae5b-a7c5fa949b66 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:11.890408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3193cbf4-b96e-4bf3-ae5b-a7c5fa949b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:11.928360 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 95/180] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:11.930194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1333a0-448a-4497-89e4-f0b44cf536ce None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:11.930714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1333a0-448a-4497-89e4-f0b44cf536ce None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:11.931188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1333a0-448a-4497-89e4-f0b44cf536ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:11.954210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:11.960985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-6c1333a0-448a-4497-89e4-f0b44cf536ce None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:11.966354 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-6c1333a0-448a-4497-89e4-f0b44cf536ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:12.032536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 86/181] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:12.033211 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193cbf4-b96e-4bf3-ae5b-a7c5fa949b66 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:12.089133 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 96/182] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:12.094367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1333a0-448a-4497-89e4-f0b44cf536ce None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:12.183639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3193cbf4-b96e-4bf3-ae5b-a7c5fa949b66 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:12.222205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12506bf9-fb8e-4176-b770-2eef0a7eebda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:12.223138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12506bf9-fb8e-4176-b770-2eef0a7eebda None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.223424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12506bf9-fb8e-4176-b770-2eef0a7eebda None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.223748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12506bf9-fb8e-4176-b770-2eef0a7eebda None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.224690 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:12.225008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12506bf9-fb8e-4176-b770-2eef0a7eebda None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:12.226897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12506bf9-fb8e-4176-b770-2eef0a7eebda None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:12.229066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 87/183] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:12 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:12.229939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12506bf9-fb8e-4176-b770-2eef0a7eebda None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:12.243183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1333a0-448a-4497-89e4-f0b44cf536ce None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:12.263770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:12.290395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7056d02-5468-4c22-8a5b-a86b2a949e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:12.291626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7056d02-5468-4c22-8a5b-a86b2a949e48 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.292185 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7056d02-5468-4c22-8a5b-a86b2a949e48 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.292705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7056d02-5468-4c22-8a5b-a86b2a949e48 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.309717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7056d02-5468-4c22-8a5b-a86b2a949e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-f7056d02-5468-4c22-8a5b-a86b2a949e48 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:12.318287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:12.319208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:12.320809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 97/184] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:12.322200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7056d02-5468-4c22-8a5b-a86b2a949e48 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:12.345635 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12506bf9-fb8e-4176-b770-2eef0a7eebda None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:12.382246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8a20c-9b5b-4025-b3dd-d1a3bd59aa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:12.383040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8a20c-9b5b-4025-b3dd-d1a3bd59aa26 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.383324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8a20c-9b5b-4025-b3dd-d1a3bd59aa26 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.383603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd8a20c-9b5b-4025-b3dd-d1a3bd59aa26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.394434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd8a20c-9b5b-4025-b3dd-d1a3bd59aa26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-2dd8a20c-9b5b-4025-b3dd-d1a3bd59aa26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:12.402241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:12.403256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:12.404093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 88/185] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:49:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:12.405625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8a20c-9b5b-4025-b3dd-d1a3bd59aa26 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:12.432232 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7056d02-5468-4c22-8a5b-a86b2a949e48 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:12.466987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f71f6-671d-4b4b-a503-00c80bfb74d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:12.467643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f71f6-671d-4b4b-a503-00c80bfb74d4 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.467960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f71f6-671d-4b4b-a503-00c80bfb74d4 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.468238 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f71f6-671d-4b4b-a503-00c80bfb74d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.469069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f71f6-671d-4b4b-a503-00c80bfb74d4 None admin] RBAC: Adding query filter params (role.id=d7474d28a1f24780a0b4c715fdff50b1, scope.project.id=e6da88ad0e094644bb7b47c1e809bb60, user.id=46a7431e426c4d01bc6f4ec5de1e2a53) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:12.469378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f71f6-671d-4b4b-a503-00c80bfb74d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:12.470929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f71f6-671d-4b4b-a503-00c80bfb74d4 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:12.476924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 98/186] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:12 2022] GET /identity/v3/role_assignments?user.id=46a7431e426c4d01bc6f4ec5de1e2a53&scope.project.id=e6da88ad0e094644bb7b47c1e809bb60&role.id=d7474d28a1f24780a0b4c715fdff50b1 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:12.478201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b18d3b-76ce-4399-ba06-7be5008e3bc0 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.478488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b18d3b-76ce-4399-ba06-7be5008e3bc0 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.478764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b18d3b-76ce-4399-ba06-7be5008e3bc0 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.484856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 99/187] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:12.484856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697986b1-0163-4701-8f0c-becea2858fd2 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.484856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697986b1-0163-4701-8f0c-becea2858fd2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.484856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697986b1-0163-4701-8f0c-becea2858fd2 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.484856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 100/188] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:12.484856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697986b1-0163-4701-8f0c-becea2858fd2 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:12.509277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:12.516547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:12.525339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd8a20c-9b5b-4025-b3dd-d1a3bd59aa26 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:12.564564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfb71c7-e443-40de-b294-f4a87534ff6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:12.565168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb71c7-e443-40de-b294-f4a87534ff6c None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.565470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb71c7-e443-40de-b294-f4a87534ff6c None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.565730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfb71c7-e443-40de-b294-f4a87534ff6c None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.566498 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb71c7-e443-40de-b294-f4a87534ff6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:12.566807 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb71c7-e443-40de-b294-f4a87534ff6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:12.568268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfb71c7-e443-40de-b294-f4a87534ff6c None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:12.581165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 89/189] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:12.585920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15b56-9024-46ca-86d9-2ee8b05d69d8 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.585920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15b56-9024-46ca-86d9-2ee8b05d69d8 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.585920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15b56-9024-46ca-86d9-2ee8b05d69d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.602900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-f3c15b56-9024-46ca-86d9-2ee8b05d69d8 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:12.604170 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f3c15b56-9024-46ca-86d9-2ee8b05d69d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:12.628573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697986b1-0163-4701-8f0c-becea2858fd2 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:12.672974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82e292b-3aff-469a-98e8-2d279ccc3b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:12.673656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e292b-3aff-469a-98e8-2d279ccc3b1c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.673942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e292b-3aff-469a-98e8-2d279ccc3b1c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.674227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82e292b-3aff-469a-98e8-2d279ccc3b1c None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.674997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e292b-3aff-469a-98e8-2d279ccc3b1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:12.675308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e292b-3aff-469a-98e8-2d279ccc3b1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:12.676742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82e292b-3aff-469a-98e8-2d279ccc3b1c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:12.688359 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 101/190] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:12.689649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33d66b-37df-4bf8-bc74-e1100e91e606 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.689942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33d66b-37df-4bf8-bc74-e1100e91e606 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.690222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca33d66b-37df-4bf8-bc74-e1100e91e606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.691939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 90/191] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:12.692663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c15b56-9024-46ca-86d9-2ee8b05d69d8 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:12.714506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ca33d66b-37df-4bf8-bc74-e1100e91e606 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:12.715727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ca33d66b-37df-4bf8-bc74-e1100e91e606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:12.785009 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:12.786863 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 102/192] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:12.787629 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33d66b-37df-4bf8-bc74-e1100e91e606 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:12.790941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:12.801898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c15b56-9024-46ca-86d9-2ee8b05d69d8 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:12.838276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863a73-b638-4710-b93c-f503232c665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:12.839065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863a73-b638-4710-b93c-f503232c665c None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.839347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863a73-b638-4710-b93c-f503232c665c None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.839626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84863a73-b638-4710-b93c-f503232c665c None admin] PATH_INFO: `/v3/users/4cf6f287a58d4302ab8cca566a79c1b5` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.840934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863a73-b638-4710-b93c-f503232c665c None admin] RBAC: Authorizing `identity:get_user(user_id=4cf6f287a58d4302ab8cca566a79c1b5)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:12.842892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84863a73-b638-4710-b93c-f503232c665c None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:12.844560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 91/193] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:12 2022] GET /identity/v3/users/4cf6f287a58d4302ab8cca566a79c1b5 => generated 289 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:12.849150 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863a73-b638-4710-b93c-f503232c665c None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:12.887880 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca33d66b-37df-4bf8-bc74-e1100e91e606 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:12.922381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aef9d2-0c0c-4232-a651-82270ffdcbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:12.923322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aef9d2-0c0c-4232-a651-82270ffdcbec None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.923529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aef9d2-0c0c-4232-a651-82270ffdcbec None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.923825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aef9d2-0c0c-4232-a651-82270ffdcbec None admin] PATH_INFO: `/v3/users/5da84eb4afb64b6197bab185eb60133a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.938048 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aef9d2-0c0c-4232-a651-82270ffdcbec None admin] RBAC: Authorizing `identity:get_user(user_id=5da84eb4afb64b6197bab185eb60133a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:12.943913 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84863a73-b638-4710-b93c-f503232c665c None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:12.946319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aef9d2-0c0c-4232-a651-82270ffdcbec None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:12.948195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 103/194] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:12 2022] GET /identity/v3/users/5da84eb4afb64b6197bab185eb60133a => generated 283 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:12.949000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aef9d2-0c0c-4232-a651-82270ffdcbec None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:12.981472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267227a-2a82-40fc-b07d-566b3f197a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:12.982858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267227a-2a82-40fc-b07d-566b3f197a78 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:12.983142 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267227a-2a82-40fc-b07d-566b3f197a78 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:12.983415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267227a-2a82-40fc-b07d-566b3f197a78 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:12.996715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267227a-2a82-40fc-b07d-566b3f197a78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-3267227a-2a82-40fc-b07d-566b3f197a78 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:13.004805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:13.005704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:13.006827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 92/195] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:49:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:13.008060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267227a-2a82-40fc-b07d-566b3f197a78 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:13.022435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:13.024230 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:13.064384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aef9d2-0c0c-4232-a651-82270ffdcbec None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:13.099852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d132-ec06-406c-8233-07a273197809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:13.100543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d132-ec06-406c-8233-07a273197809 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:13.100822 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d132-ec06-406c-8233-07a273197809 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:13.101102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef04d132-ec06-406c-8233-07a273197809 None admin] PATH_INFO: `/v3/domains/default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:13.102507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04d132-ec06-406c-8233-07a273197809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:13.104048 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef04d132-ec06-406c-8233-07a273197809 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:13.105664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 104/196] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:13.106419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d132-ec06-406c-8233-07a273197809 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:13.107128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267227a-2a82-40fc-b07d-566b3f197a78 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:13.143373 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0d0c4-c48b-4a17-81b0-46e0750bb966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:13.144039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d0c4-c48b-4a17-81b0-46e0750bb966 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:13.144321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d0c4-c48b-4a17-81b0-46e0750bb966 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:13.144597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c0d0c4-c48b-4a17-81b0-46e0750bb966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:13.207369 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef04d132-ec06-406c-8233-07a273197809 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:13.214639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0d0c4-c48b-4a17-81b0-46e0750bb966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:13.216745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c0d0c4-c48b-4a17-81b0-46e0750bb966 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:13.230372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:13.239106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:13.244728 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab370c5-6bc7-4b1d-97e6-5859d53508d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:13.245379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab370c5-6bc7-4b1d-97e6-5859d53508d2 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:13.245664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab370c5-6bc7-4b1d-97e6-5859d53508d2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:13.245956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab370c5-6bc7-4b1d-97e6-5859d53508d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:13.314124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab370c5-6bc7-4b1d-97e6-5859d53508d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:13.315618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab370c5-6bc7-4b1d-97e6-5859d53508d2 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:13.316289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 93/197] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:13.317252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0d0c4-c48b-4a17-81b0-46e0750bb966 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:13.424934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 105/198] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:13.425693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab370c5-6bc7-4b1d-97e6-5859d53508d2 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:13.433902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c0d0c4-c48b-4a17-81b0-46e0750bb966 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:13.447568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:13.457478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:13.469644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe0235-d6b0-4f94-af67-62f44176cd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:13.470319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe0235-d6b0-4f94-af67-62f44176cd12 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:13.470600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe0235-d6b0-4f94-af67-62f44176cd12 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:13.470879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffe0235-d6b0-4f94-af67-62f44176cd12 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:13.471629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe0235-d6b0-4f94-af67-62f44176cd12 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:13.471976 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe0235-d6b0-4f94-af67-62f44176cd12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:13.473374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffe0235-d6b0-4f94-af67-62f44176cd12 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:13.482321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 94/199] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:13.483248 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe0235-d6b0-4f94-af67-62f44176cd12 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:13.534620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab370c5-6bc7-4b1d-97e6-5859d53508d2 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:13.569458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5a617-98f5-4e15-a3dd-908617c4834b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:13.570126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5a617-98f5-4e15-a3dd-908617c4834b None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:13.570412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5a617-98f5-4e15-a3dd-908617c4834b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:13.570694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d5a617-98f5-4e15-a3dd-908617c4834b None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:13.571407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5a617-98f5-4e15-a3dd-908617c4834b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:13.572911 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d5a617-98f5-4e15-a3dd-908617c4834b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:13.587713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffe0235-d6b0-4f94-af67-62f44176cd12 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:13.621074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834ca2c-20f2-449f-a152-61cb3fadb448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:13.621923 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834ca2c-20f2-449f-a152-61cb3fadb448 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:13.622202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834ca2c-20f2-449f-a152-61cb3fadb448 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:13.622517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0834ca2c-20f2-449f-a152-61cb3fadb448 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:13.623687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834ca2c-20f2-449f-a152-61cb3fadb448 None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:13.625167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0834ca2c-20f2-449f-a152-61cb3fadb448 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:13.626887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 95/200] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:13 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:13.627638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834ca2c-20f2-449f-a152-61cb3fadb448 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:13.677516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 106/201] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:49:13 2022] POST /identity/v3/users => generated 297 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:13.678286 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5a617-98f5-4e15-a3dd-908617c4834b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:13.694116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:13.763286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0834ca2c-20f2-449f-a152-61cb3fadb448 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:13.783049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:13.800165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d5a617-98f5-4e15-a3dd-908617c4834b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:13.807004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa6df1-cc48-4235-b4a0-630a2db20371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:13.807911 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa6df1-cc48-4235-b4a0-630a2db20371 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:13.808594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa6df1-cc48-4235-b4a0-630a2db20371 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:13.808594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fa6df1-cc48-4235-b4a0-630a2db20371 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:13.809780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa6df1-cc48-4235-b4a0-630a2db20371 None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:13.811276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fa6df1-cc48-4235-b4a0-630a2db20371 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:13.818257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 96/202] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:13 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:13.818257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa6df1-cc48-4235-b4a0-630a2db20371 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:13.846254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc36339-3f74-4bc0-9398-df5a289d171a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:13.848124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc36339-3f74-4bc0-9398-df5a289d171a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:13.848124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc36339-3f74-4bc0-9398-df5a289d171a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:13.848315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc36339-3f74-4bc0-9398-df5a289d171a None admin] PATH_INFO: `/v3/users/5da84eb4afb64b6197bab185eb60133a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:13.849892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc36339-3f74-4bc0-9398-df5a289d171a None admin] RBAC: Authorizing `identity:get_user(user_id=5da84eb4afb64b6197bab185eb60133a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:13.851362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc36339-3f74-4bc0-9398-df5a289d171a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:13.853933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 107/203] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:13 2022] GET /identity/v3/users/5da84eb4afb64b6197bab185eb60133a => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:13.854712 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc36339-3f74-4bc0-9398-df5a289d171a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:13.940651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fa6df1-cc48-4235-b4a0-630a2db20371 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:13.956939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:13.984890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc36339-3f74-4bc0-9398-df5a289d171a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:13.989087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429462-314f-4270-9e31-c5bdfbcba7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:13.990043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429462-314f-4270-9e31-c5bdfbcba7cf None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:13.990550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429462-314f-4270-9e31-c5bdfbcba7cf None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:13.991076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40429462-314f-4270-9e31-c5bdfbcba7cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:13.992097 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40429462-314f-4270-9e31-c5bdfbcba7cf None admin] RBAC: Adding query filter params (role.id=2ef5a03d73624ab1b355f5ba18d1fe18, scope.project.id=e6da88ad0e094644bb7b47c1e809bb60, user.id=4cf6f287a58d4302ab8cca566a79c1b5) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:13.992519 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40429462-314f-4270-9e31-c5bdfbcba7cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:13.994068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40429462-314f-4270-9e31-c5bdfbcba7cf None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:14.001175 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 97/204] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:13 2022] GET /identity/v3/role_assignments?user.id=4cf6f287a58d4302ab8cca566a79c1b5&scope.project.id=e6da88ad0e094644bb7b47c1e809bb60&role.id=2ef5a03d73624ab1b355f5ba18d1fe18 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:14.002192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429462-314f-4270-9e31-c5bdfbcba7cf None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:14.057483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c8849-2737-494e-8c03-225bbc203fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:14.058452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c8849-2737-494e-8c03-225bbc203fc9 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:14.058743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c8849-2737-494e-8c03-225bbc203fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:14.059025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637c8849-2737-494e-8c03-225bbc203fc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:14.060525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c8849-2737-494e-8c03-225bbc203fc9 None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=cba82ffc93674e539b81a5c72b00ebb9, user.id=5da84eb4afb64b6197bab185eb60133a) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:14.060864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c8849-2737-494e-8c03-225bbc203fc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:14.062677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637c8849-2737-494e-8c03-225bbc203fc9 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:14.071330 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 108/205] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:13 2022] GET /identity/v3/role_assignments?user.id=5da84eb4afb64b6197bab185eb60133a&scope.project.id=cba82ffc93674e539b81a5c72b00ebb9&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:14.199977 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40429462-314f-4270-9e31-c5bdfbcba7cf None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:14.249052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826dbae-3530-4c82-b091-c476dd1102b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:14.250115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826dbae-3530-4c82-b091-c476dd1102b0 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:14.250606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826dbae-3530-4c82-b091-c476dd1102b0 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:14.251106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826dbae-3530-4c82-b091-c476dd1102b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:14.306387 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:14.335291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826dbae-3530-4c82-b091-c476dd1102b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:14.336817 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826dbae-3530-4c82-b091-c476dd1102b0 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:14.446414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 98/206] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:14.452470 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c8849-2737-494e-8c03-225bbc203fc9 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:14.473549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:14.561312 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637c8849-2737-494e-8c03-225bbc203fc9 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:14.597111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b36a2f-5b67-495b-ab87-b853ff9fd444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:14.597989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b36a2f-5b67-495b-ab87-b853ff9fd444 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:14.598275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b36a2f-5b67-495b-ab87-b853ff9fd444 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:14.598557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b36a2f-5b67-495b-ab87-b853ff9fd444 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:14.599778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b36a2f-5b67-495b-ab87-b853ff9fd444 None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:14.601298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b36a2f-5b67-495b-ab87-b853ff9fd444 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:14.603580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 109/207] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:14 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:14.612907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826dbae-3530-4c82-b091-c476dd1102b0 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:14.690885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:14.717471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826dbae-3530-4c82-b091-c476dd1102b0 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:14.753745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa765ee5-60cd-478a-bedb-440de60c2fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:14.754698 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa765ee5-60cd-478a-bedb-440de60c2fb0 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:14.755187 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa765ee5-60cd-478a-bedb-440de60c2fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:14.755639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa765ee5-60cd-478a-bedb-440de60c2fb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:14.756681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa765ee5-60cd-478a-bedb-440de60c2fb0 None admin] RBAC: Adding query filter params (role.id=d7474d28a1f24780a0b4c715fdff50b1, scope.project.id=cba82ffc93674e539b81a5c72b00ebb9, user.id=5da84eb4afb64b6197bab185eb60133a) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:14.757173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa765ee5-60cd-478a-bedb-440de60c2fb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:14.758793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa765ee5-60cd-478a-bedb-440de60c2fb0 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:14.765675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 99/208] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:14 2022] GET /identity/v3/role_assignments?user.id=5da84eb4afb64b6197bab185eb60133a&scope.project.id=cba82ffc93674e539b81a5c72b00ebb9&role.id=d7474d28a1f24780a0b4c715fdff50b1 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:15.910109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f3e22-0ab8-4acb-bfe4-217cee8091c3 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:15.910601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f3e22-0ab8-4acb-bfe4-217cee8091c3 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:15.910601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50f3e22-0ab8-4acb-bfe4-217cee8091c3 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:15.912851 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 110/209] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:15.921352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec296810-8891-4233-8b0c-3459c8bf83a5 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:15.921842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec296810-8891-4233-8b0c-3459c8bf83a5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:15.921937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec296810-8891-4233-8b0c-3459c8bf83a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:15.939339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-ec296810-8891-4233-8b0c-3459c8bf83a5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:15.940586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ec296810-8891-4233-8b0c-3459c8bf83a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:16.013253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 100/210] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:16.037620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f3e22-0ab8-4acb-bfe4-217cee8091c3 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:16.080059 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c37496-b494-43a1-bbdb-02dc9cbe2a80 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:16.080360 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c37496-b494-43a1-bbdb-02dc9cbe2a80 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:16.080621 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c37496-b494-43a1-bbdb-02dc9cbe2a80 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:16.082023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 101/211] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:49:16.087180 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088e4c4-3e69-4694-b759-353125a4190b None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:16.087715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088e4c4-3e69-4694-b759-353125a4190b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:16.088253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088e4c4-3e69-4694-b759-353125a4190b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:16.105321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4088e4c4-3e69-4694-b759-353125a4190b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:16.106858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4088e4c4-3e69-4694-b759-353125a4190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:16.133962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:16.151483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50f3e22-0ab8-4acb-bfe4-217cee8091c3 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:16.184080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:16.189540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 102/212] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:16.195801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd6957-fdb3-4fd3-aea2-2d0a3dabec77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:16.198865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd6957-fdb3-4fd3-aea2-2d0a3dabec77 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:16.198865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd6957-fdb3-4fd3-aea2-2d0a3dabec77 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:16.198865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacd6957-fdb3-4fd3-aea2-2d0a3dabec77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:16.209151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacd6957-fdb3-4fd3-aea2-2d0a3dabec77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:16.215564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088e4c4-3e69-4694-b759-353125a4190b None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-dacd6957-fdb3-4fd3-aea2-2d0a3dabec77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:16.217494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:16.218541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:16.219518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:16.219518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:16.219518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:16.219518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:16.219518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:16.219518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:16.219518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:16.219518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:16.219518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:16.219518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:16.219518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:16.219518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:16.222148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 111/213] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:16.227837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd6957-fdb3-4fd3-aea2-2d0a3dabec77 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:16.339096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088e4c4-3e69-4694-b759-353125a4190b None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:16.358290 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacd6957-fdb3-4fd3-aea2-2d0a3dabec77 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:16.374394 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb321e1-b0c1-48fe-b00e-7c4243725985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:16.375186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb321e1-b0c1-48fe-b00e-7c4243725985 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:16.375464 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb321e1-b0c1-48fe-b00e-7c4243725985 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:16.375735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb321e1-b0c1-48fe-b00e-7c4243725985 None admin] PATH_INFO: `/v3/domains/default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:16.376943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb321e1-b0c1-48fe-b00e-7c4243725985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:16.378409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb321e1-b0c1-48fe-b00e-7c4243725985 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:16.380064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 103/214] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:16.385621 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eb590-ca3c-4e05-843d-6b6cdd800691 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:16.385905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eb590-ca3c-4e05-843d-6b6cdd800691 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:16.386180 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251eb590-ca3c-4e05-843d-6b6cdd800691 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:16.387449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 104/215] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:16.388669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eb590-ca3c-4e05-843d-6b6cdd800691 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:16.405293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b7c061-4f1e-488c-bd33-2de38a838ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:16.405939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7c061-4f1e-488c-bd33-2de38a838ed5 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:16.406464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7c061-4f1e-488c-bd33-2de38a838ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:16.406464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b7c061-4f1e-488c-bd33-2de38a838ed5 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:16.407227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7c061-4f1e-488c-bd33-2de38a838ed5 None admin] RBAC: Adding query filter params (name=member) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:16.407528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7c061-4f1e-488c-bd33-2de38a838ed5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:16.408936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b7c061-4f1e-488c-bd33-2de38a838ed5 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:16.417502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 112/216] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:16.423443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba8e59-2862-4915-9157-466878f4c3bf None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:16.423730 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba8e59-2862-4915-9157-466878f4c3bf None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:16.424037 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbba8e59-2862-4915-9157-466878f4c3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:16.441406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-fbba8e59-2862-4915-9157-466878f4c3bf None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:16.443061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-fbba8e59-2862-4915-9157-466878f4c3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:16.446082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:16.470303 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:16.506169 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251eb590-ca3c-4e05-843d-6b6cdd800691 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:16.517242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 113/217] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:16.528884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba8e59-2862-4915-9157-466878f4c3bf None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:16.544141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52575a-2229-46ec-9dc1-f179d5ac237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:16.544816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52575a-2229-46ec-9dc1-f179d5ac237c None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:16.545101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52575a-2229-46ec-9dc1-f179d5ac237c None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:16.545377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d52575a-2229-46ec-9dc1-f179d5ac237c None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:16.546085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52575a-2229-46ec-9dc1-f179d5ac237c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:16.547534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d52575a-2229-46ec-9dc1-f179d5ac237c None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:16.631245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 105/218] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:49:16 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:16.632394 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52575a-2229-46ec-9dc1-f179d5ac237c None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:16.647843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbba8e59-2862-4915-9157-466878f4c3bf None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:16.690598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f512f9-8edb-42d6-9244-54fa8ed0593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:16.692054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f512f9-8edb-42d6-9244-54fa8ed0593e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:16.692590 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f512f9-8edb-42d6-9244-54fa8ed0593e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:16.693042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f512f9-8edb-42d6-9244-54fa8ed0593e None admin] PATH_INFO: `/v3/users/93d8ce46eb88400aa80ccc61e607dad3` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:16.703335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:16.711378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f512f9-8edb-42d6-9244-54fa8ed0593e None admin] RBAC: Authorizing `identity:get_user(user_id=93d8ce46eb88400aa80ccc61e607dad3)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:16.713298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f512f9-8edb-42d6-9244-54fa8ed0593e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:16.715704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 114/219] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:16 2022] GET /identity/v3/users/93d8ce46eb88400aa80ccc61e607dad3 => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:16.721160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f512f9-8edb-42d6-9244-54fa8ed0593e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:16.772553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d52575a-2229-46ec-9dc1-f179d5ac237c None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:16.799441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:16.812864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c927c6-22d2-466b-81eb-78c01736fe60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:16.814050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c927c6-22d2-466b-81eb-78c01736fe60 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:16.814533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c927c6-22d2-466b-81eb-78c01736fe60 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:16.815000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c927c6-22d2-466b-81eb-78c01736fe60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:16.829362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c927c6-22d2-466b-81eb-78c01736fe60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:16.838447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f512f9-8edb-42d6-9244-54fa8ed0593e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-34c927c6-22d2-466b-81eb-78c01736fe60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:16.838796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:16.839854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:16.840663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:16.840663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:16.840663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:16.840663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:16.840663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:16.840663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:16.840663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:16.840663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:16.840663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:16.840663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:16.840663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:16.840663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:16.845973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 106/220] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:49:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:16.845973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c326-6474-41ad-8bfc-ae9c2e8cbdb7 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:16.852424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c326-6474-41ad-8bfc-ae9c2e8cbdb7 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:16.852424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645c326-6474-41ad-8bfc-ae9c2e8cbdb7 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:16.852424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 107/221] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:16.852424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645c326-6474-41ad-8bfc-ae9c2e8cbdb7 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:16.885758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b409f7-e0b7-4444-bce2-cd677e7f7e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:16.886425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b409f7-e0b7-4444-bce2-cd677e7f7e65 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:16.886711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b409f7-e0b7-4444-bce2-cd677e7f7e65 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:16.886997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b409f7-e0b7-4444-bce2-cd677e7f7e65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:16.967957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:16.974673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b409f7-e0b7-4444-bce2-cd677e7f7e65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:16.977171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b409f7-e0b7-4444-bce2-cd677e7f7e65 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:16.983198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645c326-6474-41ad-8bfc-ae9c2e8cbdb7 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:17.027733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caac8a6-adca-43aa-abbb-6b2338e7d6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:17.028836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caac8a6-adca-43aa-abbb-6b2338e7d6dd None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:17.029914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caac8a6-adca-43aa-abbb-6b2338e7d6dd None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:17.030405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caac8a6-adca-43aa-abbb-6b2338e7d6dd None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:17.031396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caac8a6-adca-43aa-abbb-6b2338e7d6dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:17.032266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caac8a6-adca-43aa-abbb-6b2338e7d6dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:17.033735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caac8a6-adca-43aa-abbb-6b2338e7d6dd None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:17.046715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 108/222] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:17.053186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21efea-e2eb-43c2-ae71-dc53a73bb690 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:17.053186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21efea-e2eb-43c2-ae71-dc53a73bb690 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:17.053186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d21efea-e2eb-43c2-ae71-dc53a73bb690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:17.073366 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5d21efea-e2eb-43c2-ae71-dc53a73bb690 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:17.074581 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5d21efea-e2eb-43c2-ae71-dc53a73bb690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:17.118403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:17.122764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 115/223] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:49:17.124253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b409f7-e0b7-4444-bce2-cd677e7f7e65 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:17.157440 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 109/224] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:17.158422 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21efea-e2eb-43c2-ae71-dc53a73bb690 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:17.241450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:17.248243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b409f7-e0b7-4444-bce2-cd677e7f7e65 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:17.265958 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d21efea-e2eb-43c2-ae71-dc53a73bb690 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:17.285880 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be65c39-88c0-43a9-8161-8b8f41b0caac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:17.286998 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be65c39-88c0-43a9-8161-8b8f41b0caac None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:17.287452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be65c39-88c0-43a9-8161-8b8f41b0caac None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:17.287900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be65c39-88c0-43a9-8161-8b8f41b0caac None admin] PATH_INFO: `/v3/users/5da84eb4afb64b6197bab185eb60133a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:17.289353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be65c39-88c0-43a9-8161-8b8f41b0caac None admin] RBAC: Authorizing `identity:get_user(user_id=5da84eb4afb64b6197bab185eb60133a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:17.291041 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be65c39-88c0-43a9-8161-8b8f41b0caac None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:17.292994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 116/225] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:17 2022] GET /identity/v3/users/5da84eb4afb64b6197bab185eb60133a => generated 283 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:17.294093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be65c39-88c0-43a9-8161-8b8f41b0caac None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:17.302924 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43f2e6-0c56-4678-918a-e1be2b5f1560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:17.303879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43f2e6-0c56-4678-918a-e1be2b5f1560 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:17.304160 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43f2e6-0c56-4678-918a-e1be2b5f1560 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:17.304433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a43f2e6-0c56-4678-918a-e1be2b5f1560 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:17.305615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43f2e6-0c56-4678-918a-e1be2b5f1560 None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:17.307077 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a43f2e6-0c56-4678-918a-e1be2b5f1560 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:17.314196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 110/226] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:17 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:17.315027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43f2e6-0c56-4678-918a-e1be2b5f1560 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:17.360980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:17.402990 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be65c39-88c0-43a9-8161-8b8f41b0caac None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:17.421133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a43f2e6-0c56-4678-918a-e1be2b5f1560 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:17.446943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febb1d-98cb-4c95-bec6-c89c56e5c81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:17.446943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febb1d-98cb-4c95-bec6-c89c56e5c81d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:17.446943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febb1d-98cb-4c95-bec6-c89c56e5c81d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:17.446943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febb1d-98cb-4c95-bec6-c89c56e5c81d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:17.457246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3d0ff-27ea-486d-832f-1936565fb8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:17.457766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5febb1d-98cb-4c95-bec6-c89c56e5c81d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:17.458110 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3d0ff-27ea-486d-832f-1936565fb8e2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:17.458390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3d0ff-27ea-486d-832f-1936565fb8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:17.458664 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb3d0ff-27ea-486d-832f-1936565fb8e2 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:17.459968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3d0ff-27ea-486d-832f-1936565fb8e2 None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:17.461472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb3d0ff-27ea-486d-832f-1936565fb8e2 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:17.463550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 111/227] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:17 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:17.464362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3d0ff-27ea-486d-832f-1936565fb8e2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-e5febb1d-98cb-4c95-bec6-c89c56e5c81d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:17.470336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:17.471222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:17.472132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 117/228] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:49:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:17.475112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febb1d-98cb-4c95-bec6-c89c56e5c81d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:17.506142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:17.578413 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb3d0ff-27ea-486d-832f-1936565fb8e2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:17.590247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:17.595675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febb1d-98cb-4c95-bec6-c89c56e5c81d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:17.615391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd20ee3-82db-4437-8795-345acb41c897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:17.616075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd20ee3-82db-4437-8795-345acb41c897 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:17.616353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd20ee3-82db-4437-8795-345acb41c897 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:17.616629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd20ee3-82db-4437-8795-345acb41c897 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:17.617455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd20ee3-82db-4437-8795-345acb41c897 None admin] RBAC: Adding query filter params (role.id=7a7c8cc02f174648b814192cba5506ad, scope.project.id=cba82ffc93674e539b81a5c72b00ebb9, user.id=93d8ce46eb88400aa80ccc61e607dad3) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:17.617761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd20ee3-82db-4437-8795-345acb41c897 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:17.619258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd20ee3-82db-4437-8795-345acb41c897 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:17.625566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 112/229] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:17 2022] GET /identity/v3/role_assignments?user.id=93d8ce46eb88400aa80ccc61e607dad3&scope.project.id=cba82ffc93674e539b81a5c72b00ebb9&role.id=7a7c8cc02f174648b814192cba5506ad => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:17.626539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd20ee3-82db-4437-8795-345acb41c897 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:17.639120 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e2b97-31f1-46bc-8072-f390d135ac8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:17.640337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e2b97-31f1-46bc-8072-f390d135ac8a None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:17.645215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e2b97-31f1-46bc-8072-f390d135ac8a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:17.645775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e2b97-31f1-46bc-8072-f390d135ac8a None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9/users/5da84eb4afb64b6197bab185eb60133a/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:17.648256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e2b97-31f1-46bc-8072-f390d135ac8a None admin] RBAC: Authorizing `identity:create_grant(project_id=cba82ffc93674e539b81a5c72b00ebb9, user_id=5da84eb4afb64b6197bab185eb60133a, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:17.649969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638e2b97-31f1-46bc-8072-f390d135ac8a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:17.745041 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 118/230] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:49:17 2022] PUT /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9/users/5da84eb4afb64b6197bab185eb60133a/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:17.767948 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd20ee3-82db-4437-8795-345acb41c897 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:17.809937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d426cf-390a-4984-9238-4ab702916d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:17.810926 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d426cf-390a-4984-9238-4ab702916d75 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:17.811352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d426cf-390a-4984-9238-4ab702916d75 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:17.811770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d426cf-390a-4984-9238-4ab702916d75 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:17.812741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d426cf-390a-4984-9238-4ab702916d75 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:17.813195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d426cf-390a-4984-9238-4ab702916d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:17.814911 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d426cf-390a-4984-9238-4ab702916d75 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:17.826516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 113/231] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:17.832350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e2b97-31f1-46bc-8072-f390d135ac8a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:17.944557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:17.963907 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e2b97-31f1-46bc-8072-f390d135ac8a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:18.006294 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9a6c3-4dff-4dc7-89fe-585251d3397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:18.007199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9a6c3-4dff-4dc7-89fe-585251d3397f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:18.007485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9a6c3-4dff-4dc7-89fe-585251d3397f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:18.007767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc9a6c3-4dff-4dc7-89fe-585251d3397f None admin] PATH_INFO: `/v3/users/5da84eb4afb64b6197bab185eb60133a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:18.009304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9a6c3-4dff-4dc7-89fe-585251d3397f None admin] RBAC: Authorizing `identity:get_user(user_id=5da84eb4afb64b6197bab185eb60133a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:18.010805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc9a6c3-4dff-4dc7-89fe-585251d3397f None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:18.016577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 119/232] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:17 2022] GET /identity/v3/users/5da84eb4afb64b6197bab185eb60133a => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:18.022840 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d426cf-390a-4984-9238-4ab702916d75 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:18.073992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:18.148575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d426cf-390a-4984-9238-4ab702916d75 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:18.187188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab75f617-8196-4117-b92c-14085db34f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:18.188367 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75f617-8196-4117-b92c-14085db34f21 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:18.188821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75f617-8196-4117-b92c-14085db34f21 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:18.189264 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab75f617-8196-4117-b92c-14085db34f21 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:18.190639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75f617-8196-4117-b92c-14085db34f21 None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:18.192312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab75f617-8196-4117-b92c-14085db34f21 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:18.194184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 114/233] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:18 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:18.200052 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9a6c3-4dff-4dc7-89fe-585251d3397f None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:18.339688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc9a6c3-4dff-4dc7-89fe-585251d3397f None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:18.391333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821abbe5-a8b1-4122-b33f-a59169d4cb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:18.392264 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821abbe5-a8b1-4122-b33f-a59169d4cb40 None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:18.392551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821abbe5-a8b1-4122-b33f-a59169d4cb40 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:18.392835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821abbe5-a8b1-4122-b33f-a59169d4cb40 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9/users/5da84eb4afb64b6197bab185eb60133a/roles/d7474d28a1f24780a0b4c715fdff50b1` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:18.400705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821abbe5-a8b1-4122-b33f-a59169d4cb40 None admin] RBAC: Authorizing `identity:create_grant(project_id=cba82ffc93674e539b81a5c72b00ebb9, user_id=5da84eb4afb64b6197bab185eb60133a, role_id=d7474d28a1f24780a0b4c715fdff50b1)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:18.402203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821abbe5-a8b1-4122-b33f-a59169d4cb40 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:18.517265 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 120/234] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:49:18 2022] PUT /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9/users/5da84eb4afb64b6197bab185eb60133a/roles/d7474d28a1f24780a0b4c715fdff50b1 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:18.925665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aa491-77bb-40da-8419-50b4d3041e1f None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:18.925665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aa491-77bb-40da-8419-50b4d3041e1f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:18.925665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aa491-77bb-40da-8419-50b4d3041e1f None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:18.925665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 115/235] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:18.931342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f7559-3f94-4aff-a3d6-6549dcb767e5 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:18.931636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f7559-3f94-4aff-a3d6-6549dcb767e5 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:18.931946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5f7559-3f94-4aff-a3d6-6549dcb767e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:18.951239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-fe5f7559-3f94-4aff-a3d6-6549dcb767e5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:18.952539 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-fe5f7559-3f94-4aff-a3d6-6549dcb767e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:18.961017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:19.028315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 121/236] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:19.053597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9aa491-77bb-40da-8419-50b4d3041e1f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:19.056070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a192d-4645-4fa9-a2d8-c526529d5bc0 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:19.056362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a192d-4645-4fa9-a2d8-c526529d5bc0 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:19.056643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15a192d-4645-4fa9-a2d8-c526529d5bc0 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:19.058415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 122/237] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:19.065514 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878da93-9995-405a-a898-c2c185762be2 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:19.065806 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878da93-9995-405a-a898-c2c185762be2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:19.066084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d878da93-9995-405a-a898-c2c185762be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:19.083174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-d878da93-9995-405a-a898-c2c185762be2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:19.084394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d878da93-9995-405a-a898-c2c185762be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:19.191348 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9aa491-77bb-40da-8419-50b4d3041e1f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:19.198888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:19.227598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 123/238] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:19.246531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266fa83-a1e6-4ddf-a171-47effe3c05a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:19.247428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266fa83-a1e6-4ddf-a171-47effe3c05a5 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:19.247717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266fa83-a1e6-4ddf-a171-47effe3c05a5 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:19.248072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266fa83-a1e6-4ddf-a171-47effe3c05a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:19.249349 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266fa83-a1e6-4ddf-a171-47effe3c05a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:19.250900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266fa83-a1e6-4ddf-a171-47effe3c05a5 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:19.252919 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 116/239] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:19.258625 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878da93-9995-405a-a898-c2c185762be2 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:19.271136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266fa83-a1e6-4ddf-a171-47effe3c05a5 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:19.363835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:19.398263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d878da93-9995-405a-a898-c2c185762be2 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:19.436739 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396376e-9a37-4c9d-9aac-bfd4fba5eed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:19.437576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396376e-9a37-4c9d-9aac-bfd4fba5eed1 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:19.437868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396376e-9a37-4c9d-9aac-bfd4fba5eed1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:19.438195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6396376e-9a37-4c9d-9aac-bfd4fba5eed1 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:19.438862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396376e-9a37-4c9d-9aac-bfd4fba5eed1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:19.440355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6396376e-9a37-4c9d-9aac-bfd4fba5eed1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:19.482784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266fa83-a1e6-4ddf-a171-47effe3c05a5 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:19.514770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 124/240] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:49:19 2022] POST /identity/v3/users => generated 293 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:49:19.539916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9b1b6-0709-4496-92f6-eeb89e5022f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:19.540801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9b1b6-0709-4496-92f6-eeb89e5022f7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:19.541086 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9b1b6-0709-4496-92f6-eeb89e5022f7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:19.541441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e9b1b6-0709-4496-92f6-eeb89e5022f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:19.565009 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e9b1b6-0709-4496-92f6-eeb89e5022f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-a7e9b1b6-0709-4496-92f6-eeb89e5022f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:19.573085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:19.573984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:19.574804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 117/241] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:19.585758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396376e-9a37-4c9d-9aac-bfd4fba5eed1 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:19.730567 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6396376e-9a37-4c9d-9aac-bfd4fba5eed1 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:19.763943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:19.774744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1f826-351d-47c5-af32-d80fd4a845ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:19.775486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1f826-351d-47c5-af32-d80fd4a845ab None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:19.775884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1f826-351d-47c5-af32-d80fd4a845ab None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:19.776177 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e1f826-351d-47c5-af32-d80fd4a845ab None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:19.776957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1f826-351d-47c5-af32-d80fd4a845ab None admin] RBAC: Adding query filter params (name=reader) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:19.777275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1f826-351d-47c5-af32-d80fd4a845ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:19.778713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e1f826-351d-47c5-af32-d80fd4a845ab None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:19.788650 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 125/242] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:19.794386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9b1b6-0709-4496-92f6-eeb89e5022f7 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:19.838758 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:19.917467 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e9b1b6-0709-4496-92f6-eeb89e5022f7 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:19.956427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa17d2-3d92-4dc9-bdae-18ed6371cbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:19.957308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa17d2-3d92-4dc9-bdae-18ed6371cbc1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:19.957588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa17d2-3d92-4dc9-bdae-18ed6371cbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:19.957870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa17d2-3d92-4dc9-bdae-18ed6371cbc1 None admin] PATH_INFO: `/v3/users/ca15550b519c404c97c72a08e187c227` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:19.974685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa17d2-3d92-4dc9-bdae-18ed6371cbc1 None admin] RBAC: Authorizing `identity:get_user(user_id=ca15550b519c404c97c72a08e187c227)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:19.976213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa17d2-3d92-4dc9-bdae-18ed6371cbc1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:19.978619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 118/243] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:19 2022] GET /identity/v3/users/ca15550b519c404c97c72a08e187c227 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:19.984680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1f826-351d-47c5-af32-d80fd4a845ab None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:20.104469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e1f826-351d-47c5-af32-d80fd4a845ab None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:20.150574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349bb9d-7c03-4ddd-9afc-dfd6e5226c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:20.151253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349bb9d-7c03-4ddd-9afc-dfd6e5226c6b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:20.151540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349bb9d-7c03-4ddd-9afc-dfd6e5226c6b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:20.151846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a349bb9d-7c03-4ddd-9afc-dfd6e5226c6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:20.220180 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:20.230195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349bb9d-7c03-4ddd-9afc-dfd6e5226c6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:20.231749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a349bb9d-7c03-4ddd-9afc-dfd6e5226c6b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:20.250674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c953e-3b8d-4e97-b226-d50733b3bb2b None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:20.251171 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c953e-3b8d-4e97-b226-d50733b3bb2b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:20.251243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c953e-3b8d-4e97-b226-d50733b3bb2b None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:20.252934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 119/244] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:20.257960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4fb7b-c354-4312-9811-5f27ea3dccb8 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:20.258310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4fb7b-c354-4312-9811-5f27ea3dccb8 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:20.258601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd4fb7b-c354-4312-9811-5f27ea3dccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:20.287746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4fd4fb7b-c354-4312-9811-5f27ea3dccb8 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:20.289125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4fd4fb7b-c354-4312-9811-5f27ea3dccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:20.367962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 126/245] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:20.375564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349bb9d-7c03-4ddd-9afc-dfd6e5226c6b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:20.384306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 120/246] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:20.416938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4fb7b-c354-4312-9811-5f27ea3dccb8 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:20.450227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:20.540167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:20.554370 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd4fb7b-c354-4312-9811-5f27ea3dccb8 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:20.568655 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a349bb9d-7c03-4ddd-9afc-dfd6e5226c6b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:20.598307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8250cc-3cea-4618-9efc-b8b51a62ea49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:20.599523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8250cc-3cea-4618-9efc-b8b51a62ea49 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:20.600054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8250cc-3cea-4618-9efc-b8b51a62ea49 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:20.600698 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8250cc-3cea-4618-9efc-b8b51a62ea49 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:20.613500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8250cc-3cea-4618-9efc-b8b51a62ea49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-1b8250cc-3cea-4618-9efc-b8b51a62ea49 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:20.622626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:20.623507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:20.624321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:20.624321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:20.624321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:20.624321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:20.624321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:20.624321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:20.624321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:20.624321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:20.624321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:20.624321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:20.624321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:20.624321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:20.627457 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 121/247] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:49:20.634015 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8250cc-3cea-4618-9efc-b8b51a62ea49 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:20.652027 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162017b-6a57-4751-8878-13edd69c5aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:20.653061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162017b-6a57-4751-8878-13edd69c5aab None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:20.653422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162017b-6a57-4751-8878-13edd69c5aab None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:20.653704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162017b-6a57-4751-8878-13edd69c5aab None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:20.655151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162017b-6a57-4751-8878-13edd69c5aab None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:20.657384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162017b-6a57-4751-8878-13edd69c5aab None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:20.659957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 127/248] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:20 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:20.661251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfe644-2307-4f4e-b18b-f3733d4bca1d None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:20.661542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfe644-2307-4f4e-b18b-f3733d4bca1d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:20.661823 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bfe644-2307-4f4e-b18b-f3733d4bca1d None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:20.663269 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 128/249] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:20.668566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfe644-2307-4f4e-b18b-f3733d4bca1d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:20.745743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:20.767199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8250cc-3cea-4618-9efc-b8b51a62ea49 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:20.806493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f184f-5f0c-4e57-bf6c-f13f84488804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:20.807572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f184f-5f0c-4e57-bf6c-f13f84488804 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:20.807884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f184f-5f0c-4e57-bf6c-f13f84488804 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:20.808177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f184f-5f0c-4e57-bf6c-f13f84488804 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:20.808942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f184f-5f0c-4e57-bf6c-f13f84488804 None admin] RBAC: Adding query filter params (name=member) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:20.809255 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f184f-5f0c-4e57-bf6c-f13f84488804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:20.810736 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f184f-5f0c-4e57-bf6c-f13f84488804 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:20.826541 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 122/250] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:20.826541 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42744d6a-90b2-4890-bedb-f363aa4b0858 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:20.826541 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42744d6a-90b2-4890-bedb-f363aa4b0858 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:20.826541 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42744d6a-90b2-4890-bedb-f363aa4b0858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:20.845916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-42744d6a-90b2-4890-bedb-f363aa4b0858 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:20.847757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-42744d6a-90b2-4890-bedb-f363aa4b0858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:20.897633 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bfe644-2307-4f4e-b18b-f3733d4bca1d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:20.930568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 123/251] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:20.931249 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42744d6a-90b2-4890-bedb-f363aa4b0858 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:21.017136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2b004-32ba-4792-ae9f-fa4b96761dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:21.017825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b004-32ba-4792-ae9f-fa4b96761dac None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:21.018109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b004-32ba-4792-ae9f-fa4b96761dac None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:21.018431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2b004-32ba-4792-ae9f-fa4b96761dac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:21.019238 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2b004-32ba-4792-ae9f-fa4b96761dac None admin] RBAC: Adding query filter params (role.id=2ef5a03d73624ab1b355f5ba18d1fe18, scope.project.id=cba82ffc93674e539b81a5c72b00ebb9, user.id=ca15550b519c404c97c72a08e187c227) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:21.019553 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2b004-32ba-4792-ae9f-fa4b96761dac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:21.021113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2b004-32ba-4792-ae9f-fa4b96761dac None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:21.021594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:21.041972 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 129/252] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:20 2022] GET /identity/v3/role_assignments?user.id=ca15550b519c404c97c72a08e187c227&scope.project.id=cba82ffc93674e539b81a5c72b00ebb9&role.id=2ef5a03d73624ab1b355f5ba18d1fe18 => generated 259 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:21.042848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2b004-32ba-4792-ae9f-fa4b96761dac None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:21.048282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42744d6a-90b2-4890-bedb-f363aa4b0858 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:21.092787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00780bd1-b6ca-4e88-ae0e-0509452ff9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:21.093681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00780bd1-b6ca-4e88-ae0e-0509452ff9c4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:21.093969 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00780bd1-b6ca-4e88-ae0e-0509452ff9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:21.094254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00780bd1-b6ca-4e88-ae0e-0509452ff9c4 None admin] PATH_INFO: `/v3/users/93d8ce46eb88400aa80ccc61e607dad3` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:21.095505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00780bd1-b6ca-4e88-ae0e-0509452ff9c4 None admin] RBAC: Authorizing `identity:get_user(user_id=93d8ce46eb88400aa80ccc61e607dad3)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:21.097337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00780bd1-b6ca-4e88-ae0e-0509452ff9c4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:21.099255 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 124/253] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:20 2022] GET /identity/v3/users/93d8ce46eb88400aa80ccc61e607dad3 => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:21.105116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00780bd1-b6ca-4e88-ae0e-0509452ff9c4 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:21.133687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:21.228088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00780bd1-b6ca-4e88-ae0e-0509452ff9c4 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:21.268622 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539dc9f-bc6d-4ca8-998e-89cb37e82b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:21.270313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539dc9f-bc6d-4ca8-998e-89cb37e82b93 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:21.270800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539dc9f-bc6d-4ca8-998e-89cb37e82b93 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:21.271314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539dc9f-bc6d-4ca8-998e-89cb37e82b93 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:21.273009 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539dc9f-bc6d-4ca8-998e-89cb37e82b93 None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:21.274770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539dc9f-bc6d-4ca8-998e-89cb37e82b93 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:21.277144 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 125/254] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:21 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:21.285201 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539dc9f-bc6d-4ca8-998e-89cb37e82b93 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:21.302392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:21.332950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2b004-32ba-4792-ae9f-fa4b96761dac None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:21.376627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d2520-df22-4ffe-b5be-4f742b8b406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:21.377801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d2520-df22-4ffe-b5be-4f742b8b406f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:21.379952 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d2520-df22-4ffe-b5be-4f742b8b406f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:21.380734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d2520-df22-4ffe-b5be-4f742b8b406f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:21.408092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d2520-df22-4ffe-b5be-4f742b8b406f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-153d2520-df22-4ffe-b5be-4f742b8b406f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:21.423416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:21.424427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:21.425211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:21.425211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:21.425211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:21.425211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:21.425211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:21.425211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:21.425211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:21.425211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:21.425211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:21.425211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:21.425211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:21.425211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:21.431231 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 130/255] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:49:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:21.437327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc45aa0-afba-4f7e-9f3c-8d3f1f31466f None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:21.437890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc45aa0-afba-4f7e-9f3c-8d3f1f31466f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:21.438374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc45aa0-afba-4f7e-9f3c-8d3f1f31466f None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:21.440616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 131/256] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:21.441547 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc45aa0-afba-4f7e-9f3c-8d3f1f31466f None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:21.505798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539dc9f-bc6d-4ca8-998e-89cb37e82b93 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:21.542732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bd6fd3-f761-4002-a238-05cd16aee4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:21.543628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd6fd3-f761-4002-a238-05cd16aee4ab None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:21.544460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd6fd3-f761-4002-a238-05cd16aee4ab None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:21.544739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bd6fd3-f761-4002-a238-05cd16aee4ab None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9/users/93d8ce46eb88400aa80ccc61e607dad3/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:21.546895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd6fd3-f761-4002-a238-05cd16aee4ab None admin] RBAC: Authorizing `identity:create_grant(project_id=cba82ffc93674e539b81a5c72b00ebb9, user_id=93d8ce46eb88400aa80ccc61e607dad3, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:21.548490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bd6fd3-f761-4002-a238-05cd16aee4ab None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:21.608281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:21.620713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc45aa0-afba-4f7e-9f3c-8d3f1f31466f None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:21.622531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 126/257] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:49:21 2022] PUT /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9/users/93d8ce46eb88400aa80ccc61e607dad3/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:21.623846 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e16d7-cc6b-4c89-843f-73b2d20285d3 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:21.627920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e16d7-cc6b-4c89-843f-73b2d20285d3 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:21.627920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99e16d7-cc6b-4c89-843f-73b2d20285d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:21.660858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b99e16d7-cc6b-4c89-843f-73b2d20285d3 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:21.662080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b99e16d7-cc6b-4c89-843f-73b2d20285d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:21.682902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df3e4f-9d6b-4268-a874-96478c2d80c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:21.683746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df3e4f-9d6b-4268-a874-96478c2d80c4 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:21.684176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df3e4f-9d6b-4268-a874-96478c2d80c4 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:21.684566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df3e4f-9d6b-4268-a874-96478c2d80c4 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:21.685422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df3e4f-9d6b-4268-a874-96478c2d80c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:21.685743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df3e4f-9d6b-4268-a874-96478c2d80c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:21.687162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df3e4f-9d6b-4268-a874-96478c2d80c4 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:21.707554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 132/258] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:21.713701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df3e4f-9d6b-4268-a874-96478c2d80c4 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:21.769249 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:21.774506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 127/259] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:21.821004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e16d7-cc6b-4c89-843f-73b2d20285d3 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:21.930049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df3e4f-9d6b-4268-a874-96478c2d80c4 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:21.980575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99e16d7-cc6b-4c89-843f-73b2d20285d3 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:22.016074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c0a26-6fe0-421f-b369-3d1dde4efed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:22.017808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c0a26-6fe0-421f-b369-3d1dde4efed1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:22.018698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c0a26-6fe0-421f-b369-3d1dde4efed1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:22.020498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565c0a26-6fe0-421f-b369-3d1dde4efed1 None admin] PATH_INFO: `/v3/users/5da84eb4afb64b6197bab185eb60133a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:22.021254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8e203-c450-4fff-9287-9ea2112ccc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:22.022874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8e203-c450-4fff-9287-9ea2112ccc11 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:22.023726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c0a26-6fe0-421f-b369-3d1dde4efed1 None admin] RBAC: Authorizing `identity:get_user(user_id=5da84eb4afb64b6197bab185eb60133a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:22.025369 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565c0a26-6fe0-421f-b369-3d1dde4efed1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:22.025810 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8e203-c450-4fff-9287-9ea2112ccc11 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:22.026231 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e8e203-c450-4fff-9287-9ea2112ccc11 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:22.029164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 133/260] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:21 2022] GET /identity/v3/users/5da84eb4afb64b6197bab185eb60133a => generated 283 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:22.035165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c0a26-6fe0-421f-b369-3d1dde4efed1 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:22.049968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e8e203-c450-4fff-9287-9ea2112ccc11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-42e8e203-c450-4fff-9287-9ea2112ccc11 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:22.058393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:22.060076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:22.061048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:22.061048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:22.061048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:22.061048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:22.061048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:22.061048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:22.061048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:22.061048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:22.061048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:22.061048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:22.061048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:22.061048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:22.068881 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 128/261] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:49:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:49:22.069418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:22.075979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8e203-c450-4fff-9287-9ea2112ccc11 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:22.200597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:22.228963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565c0a26-6fe0-421f-b369-3d1dde4efed1 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:22.259647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e8e203-c450-4fff-9287-9ea2112ccc11 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:22.283404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b0c9-c9e3-4341-ac73-2cc6483bf6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:22.284117 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b0c9-c9e3-4341-ac73-2cc6483bf6cc None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:22.284494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b0c9-c9e3-4341-ac73-2cc6483bf6cc None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:22.284776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b60b0c9-c9e3-4341-ac73-2cc6483bf6cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:22.302901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce88c2-e3d6-4a1f-9caf-e01b3264c6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:22.303575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce88c2-e3d6-4a1f-9caf-e01b3264c6d1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:22.303873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce88c2-e3d6-4a1f-9caf-e01b3264c6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:22.304150 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ce88c2-e3d6-4a1f-9caf-e01b3264c6d1 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:22.304905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce88c2-e3d6-4a1f-9caf-e01b3264c6d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:22.305214 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce88c2-e3d6-4a1f-9caf-e01b3264c6d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:22.306627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ce88c2-e3d6-4a1f-9caf-e01b3264c6d1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:22.323936 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 129/262] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:22.332864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce88c2-e3d6-4a1f-9caf-e01b3264c6d1 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:22.363669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60b0c9-c9e3-4341-ac73-2cc6483bf6cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:22.365203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b60b0c9-c9e3-4341-ac73-2cc6483bf6cc None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:22.380514 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:22.522773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 134/263] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:22.532918 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b0c9-c9e3-4341-ac73-2cc6483bf6cc None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:22.542527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ce88c2-e3d6-4a1f-9caf-e01b3264c6d1 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:22.587045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:22.642546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09e334-8401-4e7f-9432-59866f7c9b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:22.645038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09e334-8401-4e7f-9432-59866f7c9b65 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:22.645786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09e334-8401-4e7f-9432-59866f7c9b65 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:22.646083 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09e334-8401-4e7f-9432-59866f7c9b65 None admin] PATH_INFO: `/v3/users/5da84eb4afb64b6197bab185eb60133a` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:22.652636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09e334-8401-4e7f-9432-59866f7c9b65 None admin] RBAC: Authorizing `identity:get_user(user_id=5da84eb4afb64b6197bab185eb60133a)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:22.654656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09e334-8401-4e7f-9432-59866f7c9b65 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:22.656769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 130/264] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:22 2022] GET /identity/v3/users/5da84eb4afb64b6197bab185eb60133a => generated 283 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:22.669298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09e334-8401-4e7f-9432-59866f7c9b65 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:22.802330 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b60b0c9-c9e3-4341-ac73-2cc6483bf6cc None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:22.832467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:22.884119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbe56d-d308-499e-823b-8fdc31f51837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:22.885062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbe56d-d308-499e-823b-8fdc31f51837 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:22.885349 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbe56d-d308-499e-823b-8fdc31f51837 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:22.885629 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bbe56d-d308-499e-823b-8fdc31f51837 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:22.886894 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbe56d-d308-499e-823b-8fdc31f51837 None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:22.896713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bbe56d-d308-499e-823b-8fdc31f51837 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:22.898710 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 135/265] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:22 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:22.905179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbe56d-d308-499e-823b-8fdc31f51837 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:22.915023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09e334-8401-4e7f-9432-59866f7c9b65 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:22.989378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57b1c-7410-4e74-86fc-07b22cd92e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:22.990038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57b1c-7410-4e74-86fc-07b22cd92e80 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:22.990322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57b1c-7410-4e74-86fc-07b22cd92e80 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:22.990599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb57b1c-7410-4e74-86fc-07b22cd92e80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:23.102400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:23.110585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bbe56d-d308-499e-823b-8fdc31f51837 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:23.128873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb57b1c-7410-4e74-86fc-07b22cd92e80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:23.130366 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb57b1c-7410-4e74-86fc-07b22cd92e80 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:23.176371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21275646-fcca-4d40-ba78-dbe4579a550d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:23.177398 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275646-fcca-4d40-ba78-dbe4579a550d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:23.177883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275646-fcca-4d40-ba78-dbe4579a550d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:23.178380 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21275646-fcca-4d40-ba78-dbe4579a550d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:23.179434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21275646-fcca-4d40-ba78-dbe4579a550d None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=cba82ffc93674e539b81a5c72b00ebb9, user.id=5da84eb4afb64b6197bab185eb60133a) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:23.179974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21275646-fcca-4d40-ba78-dbe4579a550d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:23.181663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21275646-fcca-4d40-ba78-dbe4579a550d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:23.189707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 136/266] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:22 2022] GET /identity/v3/role_assignments?user.id=5da84eb4afb64b6197bab185eb60133a&scope.project.id=cba82ffc93674e539b81a5c72b00ebb9&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:23.191415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4726e-00f6-41e7-bb58-e4f283005c95 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:23.191965 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4726e-00f6-41e7-bb58-e4f283005c95 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:23.192444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb4726e-00f6-41e7-bb58-e4f283005c95 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:23.194392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 137/267] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:23.202052 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a7fe7-93b1-4512-a38b-604f764a3549 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:23.202680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a7fe7-93b1-4512-a38b-604f764a3549 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:23.203183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39a7fe7-93b1-4512-a38b-604f764a3549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:23.225387 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-d39a7fe7-93b1-4512-a38b-604f764a3549 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:23.227209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d39a7fe7-93b1-4512-a38b-604f764a3549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:23.277464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:23.310185 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 138/268] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:23.343571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 131/269] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 677 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:23.349145 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a7fe7-93b1-4512-a38b-604f764a3549 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:23.359030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57b1c-7410-4e74-86fc-07b22cd92e80 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:23.526922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:23.544722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39a7fe7-93b1-4512-a38b-604f764a3549 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:23.548529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb57b1c-7410-4e74-86fc-07b22cd92e80 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:23.588873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a45edd0-4a96-4054-a10b-f71e767895fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:23.589744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45edd0-4a96-4054-a10b-f71e767895fe None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:23.590023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45edd0-4a96-4054-a10b-f71e767895fe None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:23.590297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a45edd0-4a96-4054-a10b-f71e767895fe None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:23.591893 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f300ab-6cce-40c6-bc09-573fa1e5357b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:23.592107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45edd0-4a96-4054-a10b-f71e767895fe None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:23.592752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f300ab-6cce-40c6-bc09-573fa1e5357b None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:23.593039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f300ab-6cce-40c6-bc09-573fa1e5357b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:23.593317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f300ab-6cce-40c6-bc09-573fa1e5357b None admin] PATH_INFO: `/v3/roles/member` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:23.593492 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a45edd0-4a96-4054-a10b-f71e767895fe None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:23.596203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 139/270] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:23 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:23.597436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc1e1b-b56f-40b4-a8f8-fba84daba216 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:23.597718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc1e1b-b56f-40b4-a8f8-fba84daba216 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:23.598000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc1e1b-b56f-40b4-a8f8-fba84daba216 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:23.604209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 140/271] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:23.604943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f300ab-6cce-40c6-bc09-573fa1e5357b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:23.605052 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc1e1b-b56f-40b4-a8f8-fba84daba216 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-45f300ab-6cce-40c6-bc09-573fa1e5357b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:23.613507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:23.614382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:23.615149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 132/272] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:23.616300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480e67f-800a-4501-adf4-44e0b451da4b None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:23.619877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480e67f-800a-4501-adf4-44e0b451da4b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:23.619877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9480e67f-800a-4501-adf4-44e0b451da4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:23.633878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-9480e67f-800a-4501-adf4-44e0b451da4b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:23.635090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-9480e67f-800a-4501-adf4-44e0b451da4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:23.657399 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:23.708993 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 133/273] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:23.709718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480e67f-800a-4501-adf4-44e0b451da4b None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:23.718247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc1e1b-b56f-40b4-a8f8-fba84daba216 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:23.756118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922e9de-fbe0-4fc5-bec4-9015287d3e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:23.756784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922e9de-fbe0-4fc5-bec4-9015287d3e3d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:23.757126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922e9de-fbe0-4fc5-bec4-9015287d3e3d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:23.757404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3922e9de-fbe0-4fc5-bec4-9015287d3e3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:23.758244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922e9de-fbe0-4fc5-bec4-9015287d3e3d None admin] RBAC: Adding query filter params (role.id=d7474d28a1f24780a0b4c715fdff50b1, scope.project.id=cba82ffc93674e539b81a5c72b00ebb9, user.id=5da84eb4afb64b6197bab185eb60133a) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:23.758555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922e9de-fbe0-4fc5-bec4-9015287d3e3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:23.760718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3922e9de-fbe0-4fc5-bec4-9015287d3e3d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:23.767899 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 141/274] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:23 2022] GET /identity/v3/role_assignments?user.id=5da84eb4afb64b6197bab185eb60133a&scope.project.id=cba82ffc93674e539b81a5c72b00ebb9&role.id=d7474d28a1f24780a0b4c715fdff50b1 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:23.772838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922e9de-fbe0-4fc5-bec4-9015287d3e3d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:23.797652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:23.822516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9480e67f-800a-4501-adf4-44e0b451da4b None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:23.866676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b83bf-66d1-4eda-8a8e-5de95948ef35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:23.867283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b83bf-66d1-4eda-8a8e-5de95948ef35 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:23.867567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b83bf-66d1-4eda-8a8e-5de95948ef35 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:23.867886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b83bf-66d1-4eda-8a8e-5de95948ef35 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:23.868733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b83bf-66d1-4eda-8a8e-5de95948ef35 None admin] RBAC: Adding query filter params (name=member) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:23.869045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b83bf-66d1-4eda-8a8e-5de95948ef35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:23.870753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b83bf-66d1-4eda-8a8e-5de95948ef35 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:23.881110 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 134/275] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:23.886638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b83bf-66d1-4eda-8a8e-5de95948ef35 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:23.964460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3922e9de-fbe0-4fc5-bec4-9015287d3e3d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:24.002179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42177b2-4362-4b93-80bb-ad2ac8633325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:24.002991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42177b2-4362-4b93-80bb-ad2ac8633325 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.003278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42177b2-4362-4b93-80bb-ad2ac8633325 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.003742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:24.004256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42177b2-4362-4b93-80bb-ad2ac8633325 None admin] PATH_INFO: `/v3/domains/default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:24.005913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42177b2-4362-4b93-80bb-ad2ac8633325 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:24.007589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42177b2-4362-4b93-80bb-ad2ac8633325 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:24.010313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 142/276] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:24.014859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e6443-9a8a-4104-b3b9-66f852012d1b None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.014859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e6443-9a8a-4104-b3b9-66f852012d1b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.014859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e6443-9a8a-4104-b3b9-66f852012d1b None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:24.015423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 143/277] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:24.019248 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b83bf-66d1-4eda-8a8e-5de95948ef35 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:24.021128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1955a40-c458-478d-a472-21748c23e405 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.021590 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1955a40-c458-478d-a472-21748c23e405 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.022028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1955a40-c458-478d-a472-21748c23e405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:24.041951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a1955a40-c458-478d-a472-21748c23e405 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:24.043535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a1955a40-c458-478d-a472-21748c23e405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:24.057967 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8285210-72bb-4a55-8d81-2d138e91600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:24.059514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285210-72bb-4a55-8d81-2d138e91600f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.060033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285210-72bb-4a55-8d81-2d138e91600f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.060648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8285210-72bb-4a55-8d81-2d138e91600f None admin] PATH_INFO: `/v3/users/c99a2cf1ce654faeaa8278c1ab83a1e1` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:24.075365 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:24.079684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8285210-72bb-4a55-8d81-2d138e91600f None admin] RBAC: Authorizing `identity:get_user(user_id=c99a2cf1ce654faeaa8278c1ab83a1e1)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:24.081700 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8285210-72bb-4a55-8d81-2d138e91600f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:24.083777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 135/278] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:23 2022] GET /identity/v3/users/c99a2cf1ce654faeaa8278c1ab83a1e1 => generated 293 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:24.084389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8285210-72bb-4a55-8d81-2d138e91600f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:24.129198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 144/279] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:24.129978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1955a40-c458-478d-a472-21748c23e405 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:24.203203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8285210-72bb-4a55-8d81-2d138e91600f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:24.240706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1955a40-c458-478d-a472-21748c23e405 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:24.241575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25846638-e4d6-45ae-adc2-198443faa841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:24.242237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25846638-e4d6-45ae-adc2-198443faa841 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.242517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25846638-e4d6-45ae-adc2-198443faa841 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.242783 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25846638-e4d6-45ae-adc2-198443faa841 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:24.243491 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25846638-e4d6-45ae-adc2-198443faa841 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:24.243952 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:24.244959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25846638-e4d6-45ae-adc2-198443faa841 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:24.276881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67f01e-a6d5-462b-a290-4035d128baff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:24.277573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67f01e-a6d5-462b-a290-4035d128baff None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.278202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67f01e-a6d5-462b-a290-4035d128baff None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.278202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67f01e-a6d5-462b-a290-4035d128baff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:24.278945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67f01e-a6d5-462b-a290-4035d128baff None admin] RBAC: Adding query filter params (role.id=7a7c8cc02f174648b814192cba5506ad, user.id=c99a2cf1ce654faeaa8278c1ab83a1e1, scope.system=all) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:24.279254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67f01e-a6d5-462b-a290-4035d128baff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:24.280744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67f01e-a6d5-462b-a290-4035d128baff None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:24.285970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 145/280] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Jun 23 10:49:24 2022] GET /identity/v3/role_assignments?user.id=c99a2cf1ce654faeaa8278c1ab83a1e1&scope.system=all&role.id=7a7c8cc02f174648b814192cba5506ad => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:24.286746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67f01e-a6d5-462b-a290-4035d128baff None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:24.359764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 136/281] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:49:24 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:24.429310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67f01e-a6d5-462b-a290-4035d128baff None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:24.438604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7372dd7-2998-47ca-917a-a3d052c96f0d None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.439611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7372dd7-2998-47ca-917a-a3d052c96f0d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.440471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7372dd7-2998-47ca-917a-a3d052c96f0d None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:24.443286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 137/282] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:24.449525 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b0de-a7e2-45c1-ab2a-15022f24f5ba None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.449874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b0de-a7e2-45c1-ab2a-15022f24f5ba None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.450128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c697b0de-a7e2-45c1-ab2a-15022f24f5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:24.468866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-c697b0de-a7e2-45c1-ab2a-15022f24f5ba None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:24.470112 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c697b0de-a7e2-45c1-ab2a-15022f24f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:24.478337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf244a-43d1-4f57-8489-f8e85b45b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:24.479785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf244a-43d1-4f57-8489-f8e85b45b78d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.480111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf244a-43d1-4f57-8489-f8e85b45b78d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.480397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddf244a-43d1-4f57-8489-f8e85b45b78d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:24.496062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddf244a-43d1-4f57-8489-f8e85b45b78d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-8ddf244a-43d1-4f57-8489-f8e85b45b78d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:24.505732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:24.507977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:24.508757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 146/283] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:24.516627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf244a-43d1-4f57-8489-f8e85b45b78d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:24.530784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:24.551914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 138/284] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:24.560323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:24.582134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697b0de-a7e2-45c1-ab2a-15022f24f5ba None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:24.678834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddf244a-43d1-4f57-8489-f8e85b45b78d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:24.717604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c697b0de-a7e2-45c1-ab2a-15022f24f5ba None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:24.738060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb51e4c-baf1-4ecf-aad2-0989c2dc0b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:24.739049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51e4c-baf1-4ecf-aad2-0989c2dc0b56 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.739483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51e4c-baf1-4ecf-aad2-0989c2dc0b56 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.740027 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51e4c-baf1-4ecf-aad2-0989c2dc0b56 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:24.741041 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb51e4c-baf1-4ecf-aad2-0989c2dc0b56 None admin] RBAC: Adding query filter params (name=reader) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:24.741465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb51e4c-baf1-4ecf-aad2-0989c2dc0b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:24.742899 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb51e4c-baf1-4ecf-aad2-0989c2dc0b56 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:24.757010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 147/285] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:24.767373 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb51e4c-baf1-4ecf-aad2-0989c2dc0b56 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:24.774872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad73ce-a4b6-4c41-8b87-36a7249faaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:24.775890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad73ce-a4b6-4c41-8b87-36a7249faaa4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.776242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad73ce-a4b6-4c41-8b87-36a7249faaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.776648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ad73ce-a4b6-4c41-8b87-36a7249faaa4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:24.790077 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ad73ce-a4b6-4c41-8b87-36a7249faaa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-a4ad73ce-a4b6-4c41-8b87-36a7249faaa4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:24.798863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:24.799851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:24.801100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 139/286] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:24.806838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad73ce-a4b6-4c41-8b87-36a7249faaa4 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:24.860585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:24.886141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:24.901979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb51e4c-baf1-4ecf-aad2-0989c2dc0b56 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:24.935766 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ad73ce-a4b6-4c41-8b87-36a7249faaa4 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:24.947929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e34a8-8754-4d4f-b0b0-97b1786afd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:24.949289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e34a8-8754-4d4f-b0b0-97b1786afd4d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.949676 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e34a8-8754-4d4f-b0b0-97b1786afd4d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.950085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6e34a8-8754-4d4f-b0b0-97b1786afd4d None admin] PATH_INFO: `/v3/users/ca15550b519c404c97c72a08e187c227` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:24.951789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e34a8-8754-4d4f-b0b0-97b1786afd4d None admin] RBAC: Authorizing `identity:get_user(user_id=ca15550b519c404c97c72a08e187c227)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:24.953677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6e34a8-8754-4d4f-b0b0-97b1786afd4d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:24.956657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 148/287] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:24 2022] GET /identity/v3/users/ca15550b519c404c97c72a08e187c227 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:24.965016 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e34a8-8754-4d4f-b0b0-97b1786afd4d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:24.997311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbd2b5-6696-4614-bdca-458e16a659d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:24.998227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbd2b5-6696-4614-bdca-458e16a659d4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:24.998659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbd2b5-6696-4614-bdca-458e16a659d4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:24.999081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbd2b5-6696-4614-bdca-458e16a659d4 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:25.000007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbd2b5-6696-4614-bdca-458e16a659d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:25.001883 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbd2b5-6696-4614-bdca-458e16a659d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:25.004578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cbd2b5-6696-4614-bdca-458e16a659d4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:25.021994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 140/288] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:25.028641 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbd2b5-6696-4614-bdca-458e16a659d4 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:25.185203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6e34a8-8754-4d4f-b0b0-97b1786afd4d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:25.223216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cbd2b5-6696-4614-bdca-458e16a659d4 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:25.235356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:25.253406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c59891-bc63-433f-bb3d-e024c51ff553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:25.253406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c59891-bc63-433f-bb3d-e024c51ff553 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:25.253406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c59891-bc63-433f-bb3d-e024c51ff553 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:25.253406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c59891-bc63-433f-bb3d-e024c51ff553 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:25.254808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c59891-bc63-433f-bb3d-e024c51ff553 None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:25.256311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c59891-bc63-433f-bb3d-e024c51ff553 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:25.258372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 149/289] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:24 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:25.269059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c59891-bc63-433f-bb3d-e024c51ff553 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:25.294593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d71f67-33b6-4171-8bcf-c4d40cd95bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:25.296378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d71f67-33b6-4171-8bcf-c4d40cd95bfa None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:25.296816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d71f67-33b6-4171-8bcf-c4d40cd95bfa None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:25.297244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d71f67-33b6-4171-8bcf-c4d40cd95bfa None admin] PATH_INFO: `/v3/users/93d8ce46eb88400aa80ccc61e607dad3` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:25.304868 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d71f67-33b6-4171-8bcf-c4d40cd95bfa None admin] RBAC: Authorizing `identity:get_user(user_id=93d8ce46eb88400aa80ccc61e607dad3)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:25.306356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d71f67-33b6-4171-8bcf-c4d40cd95bfa None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:25.310814 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 141/290] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:25 2022] GET /identity/v3/users/93d8ce46eb88400aa80ccc61e607dad3 => generated 297 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:25.316290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d71f67-33b6-4171-8bcf-c4d40cd95bfa None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:25.337607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:25.421700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c59891-bc63-433f-bb3d-e024c51ff553 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:25.468748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef0c51-ee15-4488-8c38-512ecde2f0b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:25.470637 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef0c51-ee15-4488-8c38-512ecde2f0b9 None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:25.471344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef0c51-ee15-4488-8c38-512ecde2f0b9 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:25.472025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef0c51-ee15-4488-8c38-512ecde2f0b9 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9/users/ca15550b519c404c97c72a08e187c227/roles/2ef5a03d73624ab1b355f5ba18d1fe18` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:25.475657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef0c51-ee15-4488-8c38-512ecde2f0b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=cba82ffc93674e539b81a5c72b00ebb9, user_id=ca15550b519c404c97c72a08e187c227, role_id=2ef5a03d73624ab1b355f5ba18d1fe18)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:25.477724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef0c51-ee15-4488-8c38-512ecde2f0b9 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:25.542729 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d71f67-33b6-4171-8bcf-c4d40cd95bfa None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:25.556607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 150/291] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:49:25 2022] PUT /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9/users/ca15550b519c404c97c72a08e187c227/roles/2ef5a03d73624ab1b355f5ba18d1fe18 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:25.582563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b957f6-468a-4a39-9340-77603ede8bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:25.583228 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b957f6-468a-4a39-9340-77603ede8bc8 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:25.583508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b957f6-468a-4a39-9340-77603ede8bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:25.583784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b957f6-468a-4a39-9340-77603ede8bc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:25.640188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:25.665093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b957f6-468a-4a39-9340-77603ede8bc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:25.666593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b957f6-468a-4a39-9340-77603ede8bc8 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:25.776809 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 142/292] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:49:25.782172 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef0c51-ee15-4488-8c38-512ecde2f0b9 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:25.889935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:25.907840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef0c51-ee15-4488-8c38-512ecde2f0b9 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:25.946029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb8a17a-344e-4623-b09a-8bff60cce87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:25.947274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8a17a-344e-4623-b09a-8bff60cce87c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:25.947773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8a17a-344e-4623-b09a-8bff60cce87c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:25.948295 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb8a17a-344e-4623-b09a-8bff60cce87c None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:25.949761 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8a17a-344e-4623-b09a-8bff60cce87c None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:25.951444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb8a17a-344e-4623-b09a-8bff60cce87c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:25.953448 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 151/293] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:25 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:25.959411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b957f6-468a-4a39-9340-77603ede8bc8 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:26.055670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:26.081360 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b957f6-468a-4a39-9340-77603ede8bc8 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:26.123677 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bda873a-cd93-449c-a105-6180a1d2396e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:26.124393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda873a-cd93-449c-a105-6180a1d2396e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:26.124673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda873a-cd93-449c-a105-6180a1d2396e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:26.124949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bda873a-cd93-449c-a105-6180a1d2396e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:26.125803 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda873a-cd93-449c-a105-6180a1d2396e None admin] RBAC: Adding query filter params (role.id=7a7c8cc02f174648b814192cba5506ad, scope.project.id=cba82ffc93674e539b81a5c72b00ebb9, user.id=93d8ce46eb88400aa80ccc61e607dad3) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:26.126206 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda873a-cd93-449c-a105-6180a1d2396e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:26.127719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bda873a-cd93-449c-a105-6180a1d2396e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:26.134995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 143/294] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:25 2022] GET /identity/v3/role_assignments?user.id=93d8ce46eb88400aa80ccc61e607dad3&scope.project.id=cba82ffc93674e539b81a5c72b00ebb9&role.id=7a7c8cc02f174648b814192cba5506ad => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:26.702833 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315597c-cde6-477f-bef9-1cd3966c78e5 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:26.703864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315597c-cde6-477f-bef9-1cd3966c78e5 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:26.704387 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315597c-cde6-477f-bef9-1cd3966c78e5 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:26.706308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 152/295] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:26.711438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3643-c930-4f0e-b657-6538317256e2 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:26.711887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3643-c930-4f0e-b657-6538317256e2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:26.712081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bf3643-c930-4f0e-b657-6538317256e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:26.729784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-e9bf3643-c930-4f0e-b657-6538317256e2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:26.731553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e9bf3643-c930-4f0e-b657-6538317256e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:26.806418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 144/296] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:26.830029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315597c-cde6-477f-bef9-1cd3966c78e5 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:26.939585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315597c-cde6-477f-bef9-1cd3966c78e5 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:26.975467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26171704-7f32-44fa-b086-ec002b65b6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:26.976566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26171704-7f32-44fa-b086-ec002b65b6a2 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:26.976850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26171704-7f32-44fa-b086-ec002b65b6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:26.977131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26171704-7f32-44fa-b086-ec002b65b6a2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:26.988141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26171704-7f32-44fa-b086-ec002b65b6a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-26171704-7f32-44fa-b086-ec002b65b6a2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:26.995928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:26.996955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:26.997770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 153/297] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:27.005307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf3643-c930-4f0e-b657-6538317256e2 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:27.079885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:27.123113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bf3643-c930-4f0e-b657-6538317256e2 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:27.135069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc475e-b7da-4280-bc1d-1206a5ccf93a None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:27.135365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc475e-b7da-4280-bc1d-1206a5ccf93a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:27.135643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc475e-b7da-4280-bc1d-1206a5ccf93a None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:27.137375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 154/298] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:49:27.142591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d80a02-fe3d-43b4-8534-5d4da909eb8e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:27.143156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d80a02-fe3d-43b4-8534-5d4da909eb8e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:27.143644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d80a02-fe3d-43b4-8534-5d4da909eb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:27.159932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba4c458-00ce-4855-8dc8-018887534c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:27.160593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4c458-00ce-4855-8dc8-018887534c68 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:27.160871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4c458-00ce-4855-8dc8-018887534c68 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:27.161143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba4c458-00ce-4855-8dc8-018887534c68 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:27.161389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a4d80a02-fe3d-43b4-8534-5d4da909eb8e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:27.161881 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4c458-00ce-4855-8dc8-018887534c68 None admin] RBAC: Adding query filter params (name=member) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:27.162183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4c458-00ce-4855-8dc8-018887534c68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:27.162587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a4d80a02-fe3d-43b4-8534-5d4da909eb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:27.163580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba4c458-00ce-4855-8dc8-018887534c68 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:27.173263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:27.173699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 145/299] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:27.177401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b5b16-1b45-42f1-82d3-64bbd54f515c None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:27.178055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b5b16-1b45-42f1-82d3-64bbd54f515c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:27.178540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4b5b16-1b45-42f1-82d3-64bbd54f515c None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:27.180376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 146/300] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:27.181011 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b5b16-1b45-42f1-82d3-64bbd54f515c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:27.259936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 155/301] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:27.259936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4124f-ea66-4c00-a49b-5a32b4d2be91 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:27.259936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4124f-ea66-4c00-a49b-5a32b4d2be91 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:27.259936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4124f-ea66-4c00-a49b-5a32b4d2be91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:27.280634 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b0a4124f-ea66-4c00-a49b-5a32b4d2be91 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:27.282534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b0a4124f-ea66-4c00-a49b-5a32b4d2be91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:27.303155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4b5b16-1b45-42f1-82d3-64bbd54f515c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:27.334888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:27.342047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa66c9-e547-4fa5-a3a5-c42ed3e0a647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:27.348181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa66c9-e547-4fa5-a3a5-c42ed3e0a647 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:27.348181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa66c9-e547-4fa5-a3a5-c42ed3e0a647 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:27.348181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfa66c9-e547-4fa5-a3a5-c42ed3e0a647 None admin] PATH_INFO: `/v3/users/c99a2cf1ce654faeaa8278c1ab83a1e1` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:27.348181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa66c9-e547-4fa5-a3a5-c42ed3e0a647 None admin] RBAC: Authorizing `identity:get_user(user_id=c99a2cf1ce654faeaa8278c1ab83a1e1)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:27.348181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfa66c9-e547-4fa5-a3a5-c42ed3e0a647 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:27.352327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 156/302] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:27.353499 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 147/303] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:27 2022] GET /identity/v3/users/c99a2cf1ce654faeaa8278c1ab83a1e1 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:27.354379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa66c9-e547-4fa5-a3a5-c42ed3e0a647 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:27.356076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4124f-ea66-4c00-a49b-5a32b4d2be91 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:27.445389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:27.471541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4124f-ea66-4c00-a49b-5a32b4d2be91 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:27.482073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfa66c9-e547-4fa5-a3a5-c42ed3e0a647 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:27.517679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceb6f1-2e6e-4e16-bf1b-c50152153d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:27.518434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2ed65-272e-4346-906f-bdc11ea8dd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:27.518580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceb6f1-2e6e-4e16-bf1b-c50152153d85 None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:27.518801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceb6f1-2e6e-4e16-bf1b-c50152153d85 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:27.519076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ceb6f1-2e6e-4e16-bf1b-c50152153d85 None admin] PATH_INFO: `/v3/system/users/c99a2cf1ce654faeaa8278c1ab83a1e1/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:27.519257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2ed65-272e-4346-906f-bdc11ea8dd09 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:27.519525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2ed65-272e-4346-906f-bdc11ea8dd09 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:27.519825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d2ed65-272e-4346-906f-bdc11ea8dd09 None admin] PATH_INFO: `/v3/domains/default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:27.520643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceb6f1-2e6e-4e16-bf1b-c50152153d85 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c99a2cf1ce654faeaa8278c1ab83a1e1, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:27.521152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2ed65-272e-4346-906f-bdc11ea8dd09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:27.522020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ceb6f1-2e6e-4e16-bf1b-c50152153d85 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:27.522593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d2ed65-272e-4346-906f-bdc11ea8dd09 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:27.529451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 157/304] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:27.529451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2ed65-272e-4346-906f-bdc11ea8dd09 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:27.628681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 148/305] 10.222.0.52 () {58 vars in 1334 bytes} [Thu Jun 23 10:49:27 2022] PUT /identity/v3/system/users/c99a2cf1ce654faeaa8278c1ab83a1e1/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:27.629646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceb6f1-2e6e-4e16-bf1b-c50152153d85 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:27.715690 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:27.762050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ceb6f1-2e6e-4e16-bf1b-c50152153d85 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:27.763506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d2ed65-272e-4346-906f-bdc11ea8dd09 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:27.808689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0201e-81ea-4ecb-807b-9beb59a99d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:27.808917 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca9fdb-33a9-4ec7-926d-0eaa1af3621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:27.812226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0201e-81ea-4ecb-807b-9beb59a99d91 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:27.812226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0201e-81ea-4ecb-807b-9beb59a99d91 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:27.812423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca9fdb-33a9-4ec7-926d-0eaa1af3621b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:27.812493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0201e-81ea-4ecb-807b-9beb59a99d91 None admin] PATH_INFO: `/v3/groups` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:27.812569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca9fdb-33a9-4ec7-926d-0eaa1af3621b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:27.812569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca9fdb-33a9-4ec7-926d-0eaa1af3621b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:27.812705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0201e-81ea-4ecb-807b-9beb59a99d91 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:27.813046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0201e-81ea-4ecb-807b-9beb59a99d91 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:27.826622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca9fdb-33a9-4ec7-926d-0eaa1af3621b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-89ca9fdb-33a9-4ec7-926d-0eaa1af3621b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:27.834549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:27.838435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:27.839221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 158/306] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:27.842326 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca9fdb-33a9-4ec7-926d-0eaa1af3621b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:27.845190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:27.911017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 149/307] 10.222.0.52 () {60 vars in 1134 bytes} [Thu Jun 23 10:49:27 2022] POST /identity/v3/groups => generated 229 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:27.962688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca9fdb-33a9-4ec7-926d-0eaa1af3621b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:28.003479 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f08062-3daa-4441-978e-10e3cd4c48cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:28.004130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f08062-3daa-4441-978e-10e3cd4c48cb None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:28.004420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f08062-3daa-4441-978e-10e3cd4c48cb None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:28.004704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f08062-3daa-4441-978e-10e3cd4c48cb None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:28.005472 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f08062-3daa-4441-978e-10e3cd4c48cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:28.005789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f08062-3daa-4441-978e-10e3cd4c48cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:28.007586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f08062-3daa-4441-978e-10e3cd4c48cb None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:28.008168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc252c20-3dd3-4fef-ae01-2201bf5fbe00 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:28.008464 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc252c20-3dd3-4fef-ae01-2201bf5fbe00 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:28.008748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc252c20-3dd3-4fef-ae01-2201bf5fbe00 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:28.010413 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 150/308] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:49:28.019425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5a60-e29e-4d5a-a9ed-cea560c75298 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:28.019425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5a60-e29e-4d5a-a9ed-cea560c75298 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:28.019425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638e5a60-e29e-4d5a-a9ed-cea560c75298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:28.019750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 159/309] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:28.025577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f08062-3daa-4441-978e-10e3cd4c48cb None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:28.043978 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-638e5a60-e29e-4d5a-a9ed-cea560c75298 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:28.045253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-638e5a60-e29e-4d5a-a9ed-cea560c75298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:28.115834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:28.140244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 151/310] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:28.160914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f08062-3daa-4441-978e-10e3cd4c48cb None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:28.167696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5a60-e29e-4d5a-a9ed-cea560c75298 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:28.203364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595eb50-fd0c-4af9-b90b-01f9a98a92c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:28.204621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595eb50-fd0c-4af9-b90b-01f9a98a92c1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:28.205108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595eb50-fd0c-4af9-b90b-01f9a98a92c1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:28.205606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595eb50-fd0c-4af9-b90b-01f9a98a92c1 None admin] PATH_INFO: `/v3/users/9314ef90227142ca830454d2a8e20ace` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:28.221423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595eb50-fd0c-4af9-b90b-01f9a98a92c1 None admin] RBAC: Authorizing `identity:get_user(user_id=9314ef90227142ca830454d2a8e20ace)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:28.223273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595eb50-fd0c-4af9-b90b-01f9a98a92c1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:28.225084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:28.226362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 160/311] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:28 2022] GET /identity/v3/users/9314ef90227142ca830454d2a8e20ace => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:28.231854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595eb50-fd0c-4af9-b90b-01f9a98a92c1 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:28.289089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638e5a60-e29e-4d5a-a9ed-cea560c75298 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:28.329902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5b8ce-4e5f-45b4-a57b-b351e7310681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:28.330848 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5b8ce-4e5f-45b4-a57b-b351e7310681 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:28.331430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5b8ce-4e5f-45b4-a57b-b351e7310681 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:28.331863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5b8ce-4e5f-45b4-a57b-b351e7310681 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:28.338389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595eb50-fd0c-4af9-b90b-01f9a98a92c1 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:28.344191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5b8ce-4e5f-45b4-a57b-b351e7310681 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-afa5b8ce-4e5f-45b4-a57b-b351e7310681 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:28.352864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:28.353768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:28.354539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:28.354539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:28.354539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:28.354539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:28.354539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:28.354539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:28.354539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:28.354539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:28.354539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:28.354539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:28.354539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:28.354539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:28.355443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 152/312] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:49:28.360995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5b8ce-4e5f-45b4-a57b-b351e7310681 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:28.364441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:28.376718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2e940-7074-4e25-aa94-d3519e1d8cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:28.384410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2e940-7074-4e25-aa94-d3519e1d8cf2 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:28.384410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2e940-7074-4e25-aa94-d3519e1d8cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:28.384410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c2e940-7074-4e25-aa94-d3519e1d8cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:28.384410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2e940-7074-4e25-aa94-d3519e1d8cf2 None admin] RBAC: Adding query filter params (role.id=2ef5a03d73624ab1b355f5ba18d1fe18, user.id=9314ef90227142ca830454d2a8e20ace, scope.system=all) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:28.384410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2e940-7074-4e25-aa94-d3519e1d8cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:28.384410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c2e940-7074-4e25-aa94-d3519e1d8cf2 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:28.386219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 161/313] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Jun 23 10:49:28 2022] GET /identity/v3/role_assignments?user.id=9314ef90227142ca830454d2a8e20ace&scope.system=all&role.id=2ef5a03d73624ab1b355f5ba18d1fe18 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:28.483757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5b8ce-4e5f-45b4-a57b-b351e7310681 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:28.503991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:28.529723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73e7da-1ac4-4843-bfba-359af869a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:28.530773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73e7da-1ac4-4843-bfba-359af869a78a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:28.531267 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73e7da-1ac4-4843-bfba-359af869a78a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:28.531727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e73e7da-1ac4-4843-bfba-359af869a78a None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:28.532735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73e7da-1ac4-4843-bfba-359af869a78a None admin] RBAC: Adding query filter params (name=reader) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:28.533242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73e7da-1ac4-4843-bfba-359af869a78a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:28.534985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e73e7da-1ac4-4843-bfba-359af869a78a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:28.545646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 153/314] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:28.551851 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2e940-7074-4e25-aa94-d3519e1d8cf2 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:28.686717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c2e940-7074-4e25-aa94-d3519e1d8cf2 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:28.725003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcf9b6-cde0-4dfd-8118-4b500e11006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:28.726531 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf9b6-cde0-4dfd-8118-4b500e11006e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:28.727016 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf9b6-cde0-4dfd-8118-4b500e11006e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:28.727511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fcf9b6-cde0-4dfd-8118-4b500e11006e None admin] PATH_INFO: `/v3/users/ca15550b519c404c97c72a08e187c227` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:28.729008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcf9b6-cde0-4dfd-8118-4b500e11006e None admin] RBAC: Authorizing `identity:get_user(user_id=ca15550b519c404c97c72a08e187c227)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:28.730792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fcf9b6-cde0-4dfd-8118-4b500e11006e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:28.733632 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 162/315] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:28 2022] GET /identity/v3/users/ca15550b519c404c97c72a08e187c227 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:28.739429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73e7da-1ac4-4843-bfba-359af869a78a None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:28.853618 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e73e7da-1ac4-4843-bfba-359af869a78a None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:28.890857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dfc0c-670a-48f0-9a5c-cd4eb2cbe2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:28.891517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dfc0c-670a-48f0-9a5c-cd4eb2cbe2ef None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:28.891796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dfc0c-670a-48f0-9a5c-cd4eb2cbe2ef None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:28.892091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569dfc0c-670a-48f0-9a5c-cd4eb2cbe2ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:28.938344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:28.972635 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dfc0c-670a-48f0-9a5c-cd4eb2cbe2ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:28.974140 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569dfc0c-670a-48f0-9a5c-cd4eb2cbe2ef None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:29.085900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 154/316] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:29.091859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcf9b6-cde0-4dfd-8118-4b500e11006e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:29.151767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:29.198437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fcf9b6-cde0-4dfd-8118-4b500e11006e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:29.234998 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f80a55-ed5b-4fd7-9d2b-504c9d804b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:29.236273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f80a55-ed5b-4fd7-9d2b-504c9d804b6e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:29.236764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f80a55-ed5b-4fd7-9d2b-504c9d804b6e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:29.237256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f80a55-ed5b-4fd7-9d2b-504c9d804b6e None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:29.238671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f80a55-ed5b-4fd7-9d2b-504c9d804b6e None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:29.240507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f80a55-ed5b-4fd7-9d2b-504c9d804b6e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:29.242725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 163/317] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:29 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:29.249309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dfc0c-670a-48f0-9a5c-cd4eb2cbe2ef None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:29.329168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:29.355004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569dfc0c-670a-48f0-9a5c-cd4eb2cbe2ef None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:29.392269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeeb5b6-1e62-4ef1-ba83-c4f7ebc7e327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:29.392929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeb5b6-1e62-4ef1-ba83-c4f7ebc7e327 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:29.393210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeb5b6-1e62-4ef1-ba83-c4f7ebc7e327 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:29.393490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeeb5b6-1e62-4ef1-ba83-c4f7ebc7e327 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:29.394322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeb5b6-1e62-4ef1-ba83-c4f7ebc7e327 None admin] RBAC: Adding query filter params (role.id=2ef5a03d73624ab1b355f5ba18d1fe18, scope.project.id=cba82ffc93674e539b81a5c72b00ebb9, user.id=ca15550b519c404c97c72a08e187c227) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:29.394636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeb5b6-1e62-4ef1-ba83-c4f7ebc7e327 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:29.396108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeeb5b6-1e62-4ef1-ba83-c4f7ebc7e327 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:29.408359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 155/318] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:29 2022] GET /identity/v3/role_assignments?user.id=ca15550b519c404c97c72a08e187c227&scope.project.id=cba82ffc93674e539b81a5c72b00ebb9&role.id=2ef5a03d73624ab1b355f5ba18d1fe18 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:29.843648 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f501a94-5f93-4138-9bf8-4286d1fb4187 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:29.844050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f501a94-5f93-4138-9bf8-4286d1fb4187 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:29.844236 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f501a94-5f93-4138-9bf8-4286d1fb4187 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:29.845646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 164/319] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:29.851113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdddd3b-da23-45e0-8efa-3968a69281c5 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:29.851579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdddd3b-da23-45e0-8efa-3968a69281c5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:29.851760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdddd3b-da23-45e0-8efa-3968a69281c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:29.869809 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-ebdddd3b-da23-45e0-8efa-3968a69281c5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:29.871014 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ebdddd3b-da23-45e0-8efa-3968a69281c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:29.941221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 156/320] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:29.964233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f501a94-5f93-4138-9bf8-4286d1fb4187 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:30.069422 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0447-9042-4d3a-a270-eb6028548fe7 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:30.069706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0447-9042-4d3a-a270-eb6028548fe7 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:30.069989 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa0447-9042-4d3a-a270-eb6028548fe7 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:30.071486 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 157/321] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:49:30.077154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac694-6f62-4220-b8b7-97222bf8e8b2 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:30.077441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac694-6f62-4220-b8b7-97222bf8e8b2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:30.077723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ac694-6f62-4220-b8b7-97222bf8e8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:30.089047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f501a94-5f93-4138-9bf8-4286d1fb4187 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:30.094234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-fb9ac694-6f62-4220-b8b7-97222bf8e8b2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:30.095351 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-fb9ac694-6f62-4220-b8b7-97222bf8e8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:30.114706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:30.128494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7126a-19ac-4ff3-af8f-ed6e7cf86173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:30.129282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7126a-19ac-4ff3-af8f-ed6e7cf86173 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:30.129565 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7126a-19ac-4ff3-af8f-ed6e7cf86173 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:30.129837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7126a-19ac-4ff3-af8f-ed6e7cf86173 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:30.141534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7126a-19ac-4ff3-af8f-ed6e7cf86173 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-9cb7126a-19ac-4ff3-af8f-ed6e7cf86173 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:30.149805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:30.150701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:30.151512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 165/322] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:30.158422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7126a-19ac-4ff3-af8f-ed6e7cf86173 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:30.163460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:30.169035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 158/323] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:30.191545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ac694-6f62-4220-b8b7-97222bf8e8b2 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:30.273449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7126a-19ac-4ff3-af8f-ed6e7cf86173 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:30.297013 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ac694-6f62-4220-b8b7-97222bf8e8b2 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:30.310497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fe1ae-d2af-406d-b826-3f897a7e2d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:30.311475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe1ae-d2af-406d-b826-3f897a7e2d18 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:30.311902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe1ae-d2af-406d-b826-3f897a7e2d18 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:30.312191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018fe1ae-d2af-406d-b826-3f897a7e2d18 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:30.313204 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fe1ae-d2af-406d-b826-3f897a7e2d18 None admin] RBAC: Adding query filter params (name=member) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:30.313327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fe1ae-d2af-406d-b826-3f897a7e2d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:30.314622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018fe1ae-d2af-406d-b826-3f897a7e2d18 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:30.328355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 166/324] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:30.329271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fe1ae-d2af-406d-b826-3f897a7e2d18 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:30.339375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2724183-e8c6-48b9-b0bf-a0bf04c3b36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:30.340798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724183-e8c6-48b9-b0bf-a0bf04c3b36d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:30.341565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724183-e8c6-48b9-b0bf-a0bf04c3b36d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:30.341738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2724183-e8c6-48b9-b0bf-a0bf04c3b36d None admin] PATH_INFO: `/v3/domains/default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:30.343228 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2724183-e8c6-48b9-b0bf-a0bf04c3b36d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:30.344970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2724183-e8c6-48b9-b0bf-a0bf04c3b36d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:30.346721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 159/325] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:30.352115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2724183-e8c6-48b9-b0bf-a0bf04c3b36d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:30.379058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:30.422158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:30.439656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018fe1ae-d2af-406d-b826-3f897a7e2d18 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:30.461361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2724183-e8c6-48b9-b0bf-a0bf04c3b36d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:30.475683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871aa8d-6894-44ff-9d15-062060e72259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:30.476839 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871aa8d-6894-44ff-9d15-062060e72259 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:30.477135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871aa8d-6894-44ff-9d15-062060e72259 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:30.477427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2871aa8d-6894-44ff-9d15-062060e72259 None admin] PATH_INFO: `/v3/users/c99a2cf1ce654faeaa8278c1ab83a1e1` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:30.478603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871aa8d-6894-44ff-9d15-062060e72259 None admin] RBAC: Authorizing `identity:get_user(user_id=c99a2cf1ce654faeaa8278c1ab83a1e1)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:30.480081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2871aa8d-6894-44ff-9d15-062060e72259 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:30.482247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 167/326] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:30 2022] GET /identity/v3/users/c99a2cf1ce654faeaa8278c1ab83a1e1 => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:30.487947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871aa8d-6894-44ff-9d15-062060e72259 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:30.498659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692ce993-0064-47c8-a065-4db1a4e0af3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:30.499729 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ce993-0064-47c8-a065-4db1a4e0af3e None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:30.500034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ce993-0064-47c8-a065-4db1a4e0af3e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:30.500377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692ce993-0064-47c8-a065-4db1a4e0af3e None admin] PATH_INFO: `/v3/groups` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:30.500992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ce993-0064-47c8-a065-4db1a4e0af3e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:30.502432 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692ce993-0064-47c8-a065-4db1a4e0af3e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:30.602763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2871aa8d-6894-44ff-9d15-062060e72259 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:30.615837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:30.636262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a87ff9-b4fa-41ae-bcaa-82baa0047c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:30.636908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a87ff9-b4fa-41ae-bcaa-82baa0047c62 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:30.637215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a87ff9-b4fa-41ae-bcaa-82baa0047c62 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:30.637493 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a87ff9-b4fa-41ae-bcaa-82baa0047c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:30.638319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a87ff9-b4fa-41ae-bcaa-82baa0047c62 None admin] RBAC: Adding query filter params (role.id=7a7c8cc02f174648b814192cba5506ad, user.id=c99a2cf1ce654faeaa8278c1ab83a1e1, scope.system=all) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:30.638627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a87ff9-b4fa-41ae-bcaa-82baa0047c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:30.640069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a87ff9-b4fa-41ae-bcaa-82baa0047c62 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:30.651966 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 168/327] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Jun 23 10:49:30 2022] GET /identity/v3/role_assignments?user.id=c99a2cf1ce654faeaa8278c1ab83a1e1&scope.system=all&role.id=7a7c8cc02f174648b814192cba5506ad => generated 510 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:30.655681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 160/328] 10.222.0.52 () {60 vars in 1134 bytes} [Thu Jun 23 10:49:30 2022] POST /identity/v3/groups => generated 226 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:49:30.655848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b44e6-1ded-45c6-93f1-96611ace64d7 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:30.655848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b44e6-1ded-45c6-93f1-96611ace64d7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:30.655848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6b44e6-1ded-45c6-93f1-96611ace64d7 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:30.655848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 169/329] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:30.665519 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87825c8-3ec2-4d79-a02f-28188ac9cfab None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:30.665820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87825c8-3ec2-4d79-a02f-28188ac9cfab None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:30.666098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87825c8-3ec2-4d79-a02f-28188ac9cfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:30.687194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-f87825c8-3ec2-4d79-a02f-28188ac9cfab None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:30.688509 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f87825c8-3ec2-4d79-a02f-28188ac9cfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:30.773556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 161/330] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:30.798638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b44e6-1ded-45c6-93f1-96611ace64d7 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:30.915517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6b44e6-1ded-45c6-93f1-96611ace64d7 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:30.952374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38da97a-bdfc-4da1-8ccd-b24d80dcfd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:30.953155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da97a-bdfc-4da1-8ccd-b24d80dcfd4a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:30.953444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da97a-bdfc-4da1-8ccd-b24d80dcfd4a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:30.953723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38da97a-bdfc-4da1-8ccd-b24d80dcfd4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:30.964575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38da97a-bdfc-4da1-8ccd-b24d80dcfd4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-a38da97a-bdfc-4da1-8ccd-b24d80dcfd4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:30.972429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:30.973521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:30.974418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 170/331] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:30.980613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87825c8-3ec2-4d79-a02f-28188ac9cfab None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:31.042820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:31.089549 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87825c8-3ec2-4d79-a02f-28188ac9cfab None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:31.127534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1a62e-5a71-45c1-a6eb-6309c3452c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:31.128238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1a62e-5a71-45c1-a6eb-6309c3452c5d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:31.128522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1a62e-5a71-45c1-a6eb-6309c3452c5d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:31.128798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1a62e-5a71-45c1-a6eb-6309c3452c5d None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:31.129721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1a62e-5a71-45c1-a6eb-6309c3452c5d None admin] RBAC: Adding query filter params (name=reader) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:31.129890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1a62e-5a71-45c1-a6eb-6309c3452c5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:31.131278 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d1a62e-5a71-45c1-a6eb-6309c3452c5d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:31.140779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 162/332] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:31.146028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38da97a-bdfc-4da1-8ccd-b24d80dcfd4a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:31.179999 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:31.258891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38da97a-bdfc-4da1-8ccd-b24d80dcfd4a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:31.301552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ce19a-7832-4d6a-ae34-b18837f3c48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:31.302449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce19a-7832-4d6a-ae34-b18837f3c48f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:31.302736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce19a-7832-4d6a-ae34-b18837f3c48f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:31.303011 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ce19a-7832-4d6a-ae34-b18837f3c48f None admin] PATH_INFO: `/v3/users/9314ef90227142ca830454d2a8e20ace` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:31.304292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ce19a-7832-4d6a-ae34-b18837f3c48f None admin] RBAC: Authorizing `identity:get_user(user_id=9314ef90227142ca830454d2a8e20ace)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:31.305746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ce19a-7832-4d6a-ae34-b18837f3c48f None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:31.311916 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 171/333] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:31 2022] GET /identity/v3/users/9314ef90227142ca830454d2a8e20ace => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:31.313480 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1a62e-5a71-45c1-a6eb-6309c3452c5d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:31.426361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1a62e-5a71-45c1-a6eb-6309c3452c5d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:31.444474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:31.463149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40bd914-b800-493b-8cad-a0a5837726a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:31.464039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bd914-b800-493b-8cad-a0a5837726a6 None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:31.464325 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bd914-b800-493b-8cad-a0a5837726a6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:31.464603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40bd914-b800-493b-8cad-a0a5837726a6 None admin] PATH_INFO: `/v3/system/users/9314ef90227142ca830454d2a8e20ace/roles/2ef5a03d73624ab1b355f5ba18d1fe18` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:31.466696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bd914-b800-493b-8cad-a0a5837726a6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=9314ef90227142ca830454d2a8e20ace, role_id=2ef5a03d73624ab1b355f5ba18d1fe18)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:31.468130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40bd914-b800-493b-8cad-a0a5837726a6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:31.542913 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 163/334] 10.222.0.52 () {58 vars in 1334 bytes} [Thu Jun 23 10:49:31 2022] PUT /identity/v3/system/users/9314ef90227142ca830454d2a8e20ace/roles/2ef5a03d73624ab1b355f5ba18d1fe18 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:33.047404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31ec7a-a86c-4349-864d-2f9127da0ff8 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:33.047945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31ec7a-a86c-4349-864d-2f9127da0ff8 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:33.048029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31ec7a-a86c-4349-864d-2f9127da0ff8 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:33.049375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 172/335] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:33.055903 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715c18b-6f14-4fa1-8fc7-cfd335755a63 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:33.056328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715c18b-6f14-4fa1-8fc7-cfd335755a63 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:33.056504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715c18b-6f14-4fa1-8fc7-cfd335755a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:33.080850 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b715c18b-6f14-4fa1-8fc7-cfd335755a63 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:33.082083 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b715c18b-6f14-4fa1-8fc7-cfd335755a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:33.162823 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 164/336] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:33.206840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31ec7a-a86c-4349-864d-2f9127da0ff8 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:33.318914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:33.325539 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31ec7a-a86c-4349-864d-2f9127da0ff8 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:33.372067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff934713-f57a-4ee5-afa0-67553525fd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:33.373006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff934713-f57a-4ee5-afa0-67553525fd56 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:33.373288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff934713-f57a-4ee5-afa0-67553525fd56 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:33.373561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff934713-f57a-4ee5-afa0-67553525fd56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:33.388734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff934713-f57a-4ee5-afa0-67553525fd56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-ff934713-f57a-4ee5-afa0-67553525fd56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:33.397577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:33.398510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:33.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:33.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:33.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:33.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:33.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:33.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:33.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:33.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:33.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:33.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:33.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:33.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:33.400515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 173/337] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:33.406766 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715c18b-6f14-4fa1-8fc7-cfd335755a63 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:33.556716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715c18b-6f14-4fa1-8fc7-cfd335755a63 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:33.590974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:33.620244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dc6c14-535b-4458-81f2-d9ab394add6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:33.620924 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6c14-535b-4458-81f2-d9ab394add6b None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:33.621259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6c14-535b-4458-81f2-d9ab394add6b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:33.621541 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dc6c14-535b-4458-81f2-d9ab394add6b None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:33.622300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc6c14-535b-4458-81f2-d9ab394add6b None admin] RBAC: Adding query filter params (name=member) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:33.622607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc6c14-535b-4458-81f2-d9ab394add6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:33.624019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dc6c14-535b-4458-81f2-d9ab394add6b None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:33.635744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 165/338] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:33.641679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff934713-f57a-4ee5-afa0-67553525fd56 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:33.796112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff934713-f57a-4ee5-afa0-67553525fd56 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:33.842684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64357093-ef12-49bc-8355-26dbbc4e32b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:33.843264 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64357093-ef12-49bc-8355-26dbbc4e32b1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:33.843553 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64357093-ef12-49bc-8355-26dbbc4e32b1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:33.843847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64357093-ef12-49bc-8355-26dbbc4e32b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:33.855461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f3249-4047-498a-ad61-374a5d8ef606 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:33.856364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f3249-4047-498a-ad61-374a5d8ef606 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:33.856608 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03f3249-4047-498a-ad61-374a5d8ef606 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:33.857992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 166/339] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:33.873538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81251180-5a8e-42ef-812d-6f5a0b66026e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:33.873823 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81251180-5a8e-42ef-812d-6f5a0b66026e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:33.874109 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81251180-5a8e-42ef-812d-6f5a0b66026e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:33.884139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:33.905185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-81251180-5a8e-42ef-812d-6f5a0b66026e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:33.906396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-81251180-5a8e-42ef-812d-6f5a0b66026e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:34.000910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64357093-ef12-49bc-8355-26dbbc4e32b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:34.002394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64357093-ef12-49bc-8355-26dbbc4e32b1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:34.055312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 167/340] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:34.099148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81251180-5a8e-42ef-812d-6f5a0b66026e None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:34.234420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81251180-5a8e-42ef-812d-6f5a0b66026e None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:34.241415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 174/341] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 600 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:34.248827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64357093-ef12-49bc-8355-26dbbc4e32b1 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:34.264203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:34.283556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b40ec-96d7-4387-bb44-89a151f4ddf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:34.284411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b40ec-96d7-4387-bb44-89a151f4ddf8 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:34.284799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b40ec-96d7-4387-bb44-89a151f4ddf8 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:34.285079 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8b40ec-96d7-4387-bb44-89a151f4ddf8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:34.314813 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8b40ec-96d7-4387-bb44-89a151f4ddf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-ee8b40ec-96d7-4387-bb44-89a151f4ddf8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:34.323221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:34.324145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:34.325471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:34.325471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:34.325471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:34.325471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:34.325471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:34.325471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:34.325471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:34.325471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:34.325471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:34.325471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:34.325471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:34.325471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:34.326558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 168/342] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:49:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:34.332863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b40ec-96d7-4387-bb44-89a151f4ddf8 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:34.353848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:34.395466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64357093-ef12-49bc-8355-26dbbc4e32b1 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:34.477490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddec516-e613-4728-ae64-d310d5adb698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:34.478361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec516-e613-4728-ae64-d310d5adb698 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:34.478641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec516-e613-4728-ae64-d310d5adb698 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:34.478916 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddec516-e613-4728-ae64-d310d5adb698 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:34.480325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddec516-e613-4728-ae64-d310d5adb698 None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:34.481913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddec516-e613-4728-ae64-d310d5adb698 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:34.484902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 175/343] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:34 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:34.491887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff52fc2-cd24-4f3f-868f-36cc53629ae4 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:34.492169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff52fc2-cd24-4f3f-868f-36cc53629ae4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:34.492452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff52fc2-cd24-4f3f-868f-36cc53629ae4 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:34.497522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 176/344] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:34 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:34.498293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff52fc2-cd24-4f3f-868f-36cc53629ae4 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:34.550095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8b40ec-96d7-4387-bb44-89a151f4ddf8 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:34.617494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdf542c-cbc9-43f7-b085-b73d741a18e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:34.618099 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf542c-cbc9-43f7-b085-b73d741a18e0 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:34.618378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf542c-cbc9-43f7-b085-b73d741a18e0 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:34.618653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdf542c-cbc9-43f7-b085-b73d741a18e0 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:34.619402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf542c-cbc9-43f7-b085-b73d741a18e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:34.619709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf542c-cbc9-43f7-b085-b73d741a18e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:34.621669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdf542c-cbc9-43f7-b085-b73d741a18e0 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:34.640066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 169/345] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:34.641346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622a083-0eb9-4daa-ad42-b25b1811d17a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:34.641630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622a083-0eb9-4daa-ad42-b25b1811d17a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:34.641905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6622a083-0eb9-4daa-ad42-b25b1811d17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:34.682299 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-6622a083-0eb9-4daa-ad42-b25b1811d17a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:34.683513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6622a083-0eb9-4daa-ad42-b25b1811d17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:34.715976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff52fc2-cd24-4f3f-868f-36cc53629ae4 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:34.732660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:34.791360 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:34.805869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19ddd3-3945-4076-9c2e-51098895d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:34.806744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19ddd3-3945-4076-9c2e-51098895d7ff None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:34.807025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19ddd3-3945-4076-9c2e-51098895d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:34.807298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19ddd3-3945-4076-9c2e-51098895d7ff None admin] PATH_INFO: `/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:34.815756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19ddd3-3945-4076-9c2e-51098895d7ff None admin] RBAC: Authorizing `identity:get_group(group_id=776ff4356c1a4302bea8f6506ceb9f2f)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:34.817293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19ddd3-3945-4076-9c2e-51098895d7ff None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:34.819012 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 177/346] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:34 2022] GET /identity/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:34.819893 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19ddd3-3945-4076-9c2e-51098895d7ff None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:34.826616 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 170/347] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:34.828080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1ce3c-b158-4fdc-a121-5b31528d5c45 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:34.828374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1ce3c-b158-4fdc-a121-5b31528d5c45 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:34.828657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde1ce3c-b158-4fdc-a121-5b31528d5c45 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:34.830071 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 171/348] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:34.830626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1ce3c-b158-4fdc-a121-5b31528d5c45 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:34.962514 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19ddd3-3945-4076-9c2e-51098895d7ff None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:34.974784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde1ce3c-b158-4fdc-a121-5b31528d5c45 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:35.008908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40157b00-fdf3-4298-801f-252881f2d85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:35.009566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40157b00-fdf3-4298-801f-252881f2d85a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.009859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40157b00-fdf3-4298-801f-252881f2d85a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.010139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40157b00-fdf3-4298-801f-252881f2d85a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.014996 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6af3af-83eb-45e5-a1dc-0aac13c215e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:35.015653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6af3af-83eb-45e5-a1dc-0aac13c215e3 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.015964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6af3af-83eb-45e5-a1dc-0aac13c215e3 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.016243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6af3af-83eb-45e5-a1dc-0aac13c215e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.017074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6af3af-83eb-45e5-a1dc-0aac13c215e3 None admin] RBAC: Adding query filter params (group.id=776ff4356c1a4302bea8f6506ceb9f2f, role.id=7a7c8cc02f174648b814192cba5506ad, scope.project.id=e6da88ad0e094644bb7b47c1e809bb60) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:35.017383 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6af3af-83eb-45e5-a1dc-0aac13c215e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:35.018819 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6af3af-83eb-45e5-a1dc-0aac13c215e3 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:35.026020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 172/349] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Jun 23 10:49:34 2022] GET /identity/v3/role_assignments?group.id=776ff4356c1a4302bea8f6506ceb9f2f&scope.project.id=e6da88ad0e094644bb7b47c1e809bb60&role.id=7a7c8cc02f174648b814192cba5506ad => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:35.027195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b1fd9-945d-45c9-9bb7-8f78764c3885 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.027533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b1fd9-945d-45c9-9bb7-8f78764c3885 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.027894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2b1fd9-945d-45c9-9bb7-8f78764c3885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.050800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-ed2b1fd9-945d-45c9-9bb7-8f78764c3885 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:35.052066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ed2b1fd9-945d-45c9-9bb7-8f78764c3885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:35.074397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:35.111768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:35.128992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40157b00-fdf3-4298-801f-252881f2d85a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:35.130519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40157b00-fdf3-4298-801f-252881f2d85a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:35.145080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 173/350] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:35.146427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bad55-f995-4b39-8605-4e73b5899e0a None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.146775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bad55-f995-4b39-8605-4e73b5899e0a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.147161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bad55-f995-4b39-8605-4e73b5899e0a None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.148762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 174/351] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:35.149524 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bad55-f995-4b39-8605-4e73b5899e0a None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:35.251573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 178/352] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:35.252940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7061f55-ac50-4e1b-be66-d0ae6811d1bb None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.253200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7061f55-ac50-4e1b-be66-d0ae6811d1bb None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.253480 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7061f55-ac50-4e1b-be66-d0ae6811d1bb None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.254788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 179/353] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:35.255886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d253e6-638c-4531-a3f7-1d8a78ac652a None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.256180 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d253e6-638c-4531-a3f7-1d8a78ac652a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.256463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d253e6-638c-4531-a3f7-1d8a78ac652a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.274556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bad55-f995-4b39-8605-4e73b5899e0a None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:35.276377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-49d253e6-638c-4531-a3f7-1d8a78ac652a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:35.277700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-49d253e6-638c-4531-a3f7-1d8a78ac652a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:35.324482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f52bc-af7a-40ae-85a1-8b33ec78bd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:35.325617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f52bc-af7a-40ae-85a1-8b33ec78bd33 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.325899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f52bc-af7a-40ae-85a1-8b33ec78bd33 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.326349 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f52bc-af7a-40ae-85a1-8b33ec78bd33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.340793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f52bc-af7a-40ae-85a1-8b33ec78bd33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-420f52bc-af7a-40ae-85a1-8b33ec78bd33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:35.349033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:35.349979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:35.351055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 175/354] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:35.351718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f52bc-af7a-40ae-85a1-8b33ec78bd33 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:35.369022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 180/355] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:35.370976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bcd50-010f-4765-a0c2-4e3030c7d253 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.371086 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:35.372434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bcd50-010f-4765-a0c2-4e3030c7d253 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.372897 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42bcd50-010f-4765-a0c2-4e3030c7d253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.394332 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b42bcd50-010f-4765-a0c2-4e3030c7d253 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:35.395895 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b42bcd50-010f-4765-a0c2-4e3030c7d253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:35.413374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:35.486780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 181/356] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:35.487713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bcd50-010f-4765-a0c2-4e3030c7d253 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:35.497784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f52bc-af7a-40ae-85a1-8b33ec78bd33 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:35.540977 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8dd59-ccc2-497e-a792-f6eed837f81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:35.543527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8dd59-ccc2-497e-a792-f6eed837f81c None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.543833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8dd59-ccc2-497e-a792-f6eed837f81c None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.544139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e8dd59-ccc2-497e-a792-f6eed837f81c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.557210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e8dd59-ccc2-497e-a792-f6eed837f81c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-49e8dd59-ccc2-497e-a792-f6eed837f81c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:35.566259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:35.567162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:35.568024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 176/357] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:35.568655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8dd59-ccc2-497e-a792-f6eed837f81c None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:35.604894 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42bcd50-010f-4765-a0c2-4e3030c7d253 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:35.656971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8e6f9-1757-45e2-9b22-7fb1f6f79a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:35.657844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8e6f9-1757-45e2-9b22-7fb1f6f79a99 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.658129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8e6f9-1757-45e2-9b22-7fb1f6f79a99 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.658413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8e6f9-1757-45e2-9b22-7fb1f6f79a99 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.660452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8e6f9-1757-45e2-9b22-7fb1f6f79a99 None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:35.662061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8e6f9-1757-45e2-9b22-7fb1f6f79a99 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:35.664120 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 182/358] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:35 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:35.664904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8e6f9-1757-45e2-9b22-7fb1f6f79a99 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:35.668058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:35.689653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:35.709851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e8dd59-ccc2-497e-a792-f6eed837f81c None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:35.745746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539284e-7456-41aa-b169-5071f8307604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:35.746484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539284e-7456-41aa-b169-5071f8307604 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.746771 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539284e-7456-41aa-b169-5071f8307604 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.747052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2539284e-7456-41aa-b169-5071f8307604 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.747801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539284e-7456-41aa-b169-5071f8307604 None admin] RBAC: Adding query filter params (name=member) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:35.748130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539284e-7456-41aa-b169-5071f8307604 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:35.749536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2539284e-7456-41aa-b169-5071f8307604 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:35.760038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 177/359] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:35.765808 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539284e-7456-41aa-b169-5071f8307604 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:35.795502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8e6f9-1757-45e2-9b22-7fb1f6f79a99 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:35.841302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6eaf1-719d-4eac-a4a8-956ccb909563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:35.842127 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6eaf1-719d-4eac-a4a8-956ccb909563 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.842418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6eaf1-719d-4eac-a4a8-956ccb909563 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.842703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d6eaf1-719d-4eac-a4a8-956ccb909563 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.856497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d6eaf1-719d-4eac-a4a8-956ccb909563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-16d6eaf1-719d-4eac-a4a8-956ccb909563 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:35.864811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:35.865724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:35.866517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 183/360] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:49:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:35.867186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6eaf1-719d-4eac-a4a8-956ccb909563 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:35.907511 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2539284e-7456-41aa-b169-5071f8307604 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:35.947745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:35.956465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f67e0-1a27-4220-aee6-0275c41cea42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:35.957361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f67e0-1a27-4220-aee6-0275c41cea42 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:35.959026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f67e0-1a27-4220-aee6-0275c41cea42 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:35.959026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f67e0-1a27-4220-aee6-0275c41cea42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:35.968039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:35.971561 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2f67e0-1a27-4220-aee6-0275c41cea42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-ed2f67e0-1a27-4220-aee6-0275c41cea42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:35.979578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:35.981091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:35.981871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 178/361] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:49:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:35.982570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f67e0-1a27-4220-aee6-0275c41cea42 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:36.002795 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d6eaf1-719d-4eac-a4a8-956ccb909563 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:36.054956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5a54c-3310-4d26-b08f-c577c17efab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:36.054956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5a54c-3310-4d26-b08f-c577c17efab8 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:36.054956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5a54c-3310-4d26-b08f-c577c17efab8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:36.055299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5a54c-3310-4d26-b08f-c577c17efab8 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:36.056852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5a54c-3310-4d26-b08f-c577c17efab8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:36.056852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5a54c-3310-4d26-b08f-c577c17efab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:36.057665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5a54c-3310-4d26-b08f-c577c17efab8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:36.067325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 184/362] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:36.068189 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5a54c-3310-4d26-b08f-c577c17efab8 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:36.110604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f67e0-1a27-4220-aee6-0275c41cea42 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:36.166032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5babd3-28bf-47e3-92bb-cee4e34d356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:36.166907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5babd3-28bf-47e3-92bb-cee4e34d356f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:36.167168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5babd3-28bf-47e3-92bb-cee4e34d356f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:36.167444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5babd3-28bf-47e3-92bb-cee4e34d356f None admin] PATH_INFO: `/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:36.170349 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5babd3-28bf-47e3-92bb-cee4e34d356f None admin] RBAC: Authorizing `identity:get_group(group_id=776ff4356c1a4302bea8f6506ceb9f2f)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:36.171796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5babd3-28bf-47e3-92bb-cee4e34d356f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:36.173481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 179/363] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:35 2022] GET /identity/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:36.174246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5babd3-28bf-47e3-92bb-cee4e34d356f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:36.201651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5a54c-3310-4d26-b08f-c577c17efab8 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:36.247452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861db7cb-c41c-4d6e-8a56-44d0bee5be77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:36.247452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861db7cb-c41c-4d6e-8a56-44d0bee5be77 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:36.247452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861db7cb-c41c-4d6e-8a56-44d0bee5be77 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:36.247452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861db7cb-c41c-4d6e-8a56-44d0bee5be77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:36.250812 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:36.260571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:36.302776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5babd3-28bf-47e3-92bb-cee4e34d356f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:36.342011 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861db7cb-c41c-4d6e-8a56-44d0bee5be77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:36.343549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861db7cb-c41c-4d6e-8a56-44d0bee5be77 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:36.344971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9df0df-dfab-459a-b30f-2977c1db10a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:36.345648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9df0df-dfab-459a-b30f-2977c1db10a8 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:36.345930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9df0df-dfab-459a-b30f-2977c1db10a8 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:36.346207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9df0df-dfab-459a-b30f-2977c1db10a8 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:36.346963 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9df0df-dfab-459a-b30f-2977c1db10a8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:36.347269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9df0df-dfab-459a-b30f-2977c1db10a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:36.348668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9df0df-dfab-459a-b30f-2977c1db10a8 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:36.361429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 180/364] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:36.362189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9df0df-dfab-459a-b30f-2977c1db10a8 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:36.482428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 185/365] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:36.484695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861db7cb-c41c-4d6e-8a56-44d0bee5be77 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:36.499601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9df0df-dfab-459a-b30f-2977c1db10a8 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:36.531033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:36.533027 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:36.547978 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02a1a6-fe75-45ec-9021-449cc602f643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:36.548846 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02a1a6-fe75-45ec-9021-449cc602f643 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:36.549227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02a1a6-fe75-45ec-9021-449cc602f643 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:36.549622 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f02a1a6-fe75-45ec-9021-449cc602f643 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:36.550473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02a1a6-fe75-45ec-9021-449cc602f643 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:36.550882 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02a1a6-fe75-45ec-9021-449cc602f643 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:36.552403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f02a1a6-fe75-45ec-9021-449cc602f643 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:36.563556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 181/366] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:36.566430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02a1a6-fe75-45ec-9021-449cc602f643 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:36.609733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861db7cb-c41c-4d6e-8a56-44d0bee5be77 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:36.652452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0ec5e-e6b9-4392-b04a-35ce815cc93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:36.653652 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0ec5e-e6b9-4392-b04a-35ce815cc93a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:36.653942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0ec5e-e6b9-4392-b04a-35ce815cc93a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:36.654221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0ec5e-e6b9-4392-b04a-35ce815cc93a None admin] PATH_INFO: `/v3/users/9314ef90227142ca830454d2a8e20ace` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:36.655719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0ec5e-e6b9-4392-b04a-35ce815cc93a None admin] RBAC: Authorizing `identity:get_user(user_id=9314ef90227142ca830454d2a8e20ace)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:36.657200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b0ec5e-e6b9-4392-b04a-35ce815cc93a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:36.662510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 186/367] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:49:36 2022] GET /identity/v3/users/9314ef90227142ca830454d2a8e20ace => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:36.662745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0ec5e-e6b9-4392-b04a-35ce815cc93a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:36.704926 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f02a1a6-fe75-45ec-9021-449cc602f643 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:36.754980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabb711-2cdc-4a41-a8c2-97dd4bfb817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:36.756097 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabb711-2cdc-4a41-a8c2-97dd4bfb817d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:36.756396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabb711-2cdc-4a41-a8c2-97dd4bfb817d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:36.756673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eabb711-2cdc-4a41-a8c2-97dd4bfb817d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:36.757505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabb711-2cdc-4a41-a8c2-97dd4bfb817d None admin] RBAC: Adding query filter params (group.id=776ff4356c1a4302bea8f6506ceb9f2f, role.id=d7474d28a1f24780a0b4c715fdff50b1, scope.project.id=e6da88ad0e094644bb7b47c1e809bb60) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:36.758183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabb711-2cdc-4a41-a8c2-97dd4bfb817d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:36.763587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eabb711-2cdc-4a41-a8c2-97dd4bfb817d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:36.769885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 182/368] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Jun 23 10:49:36 2022] GET /identity/v3/role_assignments?group.id=776ff4356c1a4302bea8f6506ceb9f2f&scope.project.id=e6da88ad0e094644bb7b47c1e809bb60&role.id=d7474d28a1f24780a0b4c715fdff50b1 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:36.770999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabb711-2cdc-4a41-a8c2-97dd4bfb817d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:36.788478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0ec5e-e6b9-4392-b04a-35ce815cc93a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:36.811201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:36.831741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:36.860611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a1e0d-687b-4f8d-9b78-be681b3c8d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:36.862146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1e0d-687b-4f8d-9b78-be681b3c8d48 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:36.862460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1e0d-687b-4f8d-9b78-be681b3c8d48 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:36.862746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903a1e0d-687b-4f8d-9b78-be681b3c8d48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:36.903459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eabb711-2cdc-4a41-a8c2-97dd4bfb817d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:36.952288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fc86f-1501-4113-b727-4aa50daf3421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:36.953585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fc86f-1501-4113-b727-4aa50daf3421 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:36.954073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fc86f-1501-4113-b727-4aa50daf3421 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:36.954633 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810fc86f-1501-4113-b727-4aa50daf3421 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:36.958030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a1e0d-687b-4f8d-9b78-be681b3c8d48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:36.958531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fc86f-1501-4113-b727-4aa50daf3421 None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:36.959519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903a1e0d-687b-4f8d-9b78-be681b3c8d48 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:36.960444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810fc86f-1501-4113-b727-4aa50daf3421 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:36.964213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 183/369] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:36 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:36.965797 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fc86f-1501-4113-b727-4aa50daf3421 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:37.092890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810fc86f-1501-4113-b727-4aa50daf3421 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:37.105962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 187/370] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:37.108649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a1e0d-687b-4f8d-9b78-be681b3c8d48 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:37.118602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:37.122815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:37.144871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9b554-fa69-45b8-bb17-76370bd529ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:37.145802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9b554-fa69-45b8-bb17-76370bd529ea None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:37.146101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9b554-fa69-45b8-bb17-76370bd529ea None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:37.146451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf9b554-fa69-45b8-bb17-76370bd529ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:37.232902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9b554-fa69-45b8-bb17-76370bd529ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:37.234388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf9b554-fa69-45b8-bb17-76370bd529ea None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:37.234586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903a1e0d-687b-4f8d-9b78-be681b3c8d48 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:37.273242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c88833-1e04-4bea-b131-dfa7c5b0a0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:37.273921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c88833-1e04-4bea-b131-dfa7c5b0a0fe None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:37.274172 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c88833-1e04-4bea-b131-dfa7c5b0a0fe None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:37.274450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c88833-1e04-4bea-b131-dfa7c5b0a0fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:37.275288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c88833-1e04-4bea-b131-dfa7c5b0a0fe None admin] RBAC: Adding query filter params (role.id=2ef5a03d73624ab1b355f5ba18d1fe18, user.id=9314ef90227142ca830454d2a8e20ace, scope.system=all) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:37.275602 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c88833-1e04-4bea-b131-dfa7c5b0a0fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:37.277661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c88833-1e04-4bea-b131-dfa7c5b0a0fe None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:37.290809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 188/371] 10.222.0.52 () {56 vars in 1308 bytes} [Thu Jun 23 10:49:37 2022] GET /identity/v3/role_assignments?user.id=9314ef90227142ca830454d2a8e20ace&scope.system=all&role.id=2ef5a03d73624ab1b355f5ba18d1fe18 => generated 510 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:37.291466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c88833-1e04-4bea-b131-dfa7c5b0a0fe None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:37.353800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 184/372] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:37.355037 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9b554-fa69-45b8-bb17-76370bd529ea None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:37.375967 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:37.408259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:37.467214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c88833-1e04-4bea-b131-dfa7c5b0a0fe None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:37.481627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf9b554-fa69-45b8-bb17-76370bd529ea None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:37.511715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37031574-4f5d-40e4-bd59-35d66d4584d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:37.512620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37031574-4f5d-40e4-bd59-35d66d4584d8 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:37.512894 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37031574-4f5d-40e4-bd59-35d66d4584d8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:37.513172 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37031574-4f5d-40e4-bd59-35d66d4584d8 None admin] PATH_INFO: `/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:37.514701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37031574-4f5d-40e4-bd59-35d66d4584d8 None admin] RBAC: Authorizing `identity:get_group(group_id=776ff4356c1a4302bea8f6506ceb9f2f)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:37.516199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37031574-4f5d-40e4-bd59-35d66d4584d8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:37.518136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 189/373] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:37 2022] GET /identity/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:37.519413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641e810-132f-4626-8a45-c543e4863cd6 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:37.519725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641e810-132f-4626-8a45-c543e4863cd6 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:37.520040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641e810-132f-4626-8a45-c543e4863cd6 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:37.521478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 190/374] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:37.527749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641e810-132f-4626-8a45-c543e4863cd6 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:37.534172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fdc9e-fcc3-49af-b080-e89e8b97a0ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:37.535042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fdc9e-fcc3-49af-b080-e89e8b97a0ee None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:37.535325 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fdc9e-fcc3-49af-b080-e89e8b97a0ee None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:37.535600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44fdc9e-fcc3-49af-b080-e89e8b97a0ee None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:37.540533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fdc9e-fcc3-49af-b080-e89e8b97a0ee None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:37.542149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44fdc9e-fcc3-49af-b080-e89e8b97a0ee None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:37.546776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 185/375] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:37 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:37.546776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fdc9e-fcc3-49af-b080-e89e8b97a0ee None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:37.659999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:37.672536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641e810-132f-4626-8a45-c543e4863cd6 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:37.681630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44fdc9e-fcc3-49af-b080-e89e8b97a0ee None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:37.719549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c201e3b5-048b-4a08-aa39-c9aeafebe403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:37.720450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e3b5-048b-4a08-aa39-c9aeafebe403 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:37.720733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e3b5-048b-4a08-aa39-c9aeafebe403 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:37.721181 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c201e3b5-048b-4a08-aa39-c9aeafebe403 None admin] PATH_INFO: `/v3/projects/38b92a57b84f432b87f291c46bdda9ea` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:37.723590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fe5c1-f86e-47fc-94f2-2af2fd2824e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:37.724080 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201e3b5-048b-4a08-aa39-c9aeafebe403 None admin] RBAC: Authorizing `identity:get_project(project_id=38b92a57b84f432b87f291c46bdda9ea)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:37.724415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fe5c1-f86e-47fc-94f2-2af2fd2824e1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:37.724703 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fe5c1-f86e-47fc-94f2-2af2fd2824e1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:37.724981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27fe5c1-f86e-47fc-94f2-2af2fd2824e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:37.726223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fe5c1-f86e-47fc-94f2-2af2fd2824e1 None admin] RBAC: Adding query filter params (group.id=776ff4356c1a4302bea8f6506ceb9f2f, role.id=7a7c8cc02f174648b814192cba5506ad, scope.project.id=cba82ffc93674e539b81a5c72b00ebb9) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:37.726464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c201e3b5-048b-4a08-aa39-c9aeafebe403 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:37.726694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fe5c1-f86e-47fc-94f2-2af2fd2824e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:37.729274 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27fe5c1-f86e-47fc-94f2-2af2fd2824e1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:37.729820 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 191/376] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:37 2022] GET /identity/v3/projects/38b92a57b84f432b87f291c46bdda9ea => generated 344 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:37.731102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4f9f-63df-4da0-bc3d-649645164a99 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:37.731506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4f9f-63df-4da0-bc3d-649645164a99 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:37.731707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ae4f9f-63df-4da0-bc3d-649645164a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:37.737078 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 186/377] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Jun 23 10:49:37 2022] GET /identity/v3/role_assignments?group.id=776ff4356c1a4302bea8f6506ceb9f2f&scope.project.id=cba82ffc93674e539b81a5c72b00ebb9&role.id=7a7c8cc02f174648b814192cba5506ad => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:37.738249 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fe5c1-f86e-47fc-94f2-2af2fd2824e1 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:37.741427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:37.758227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-c8ae4f9f-63df-4da0-bc3d-649645164a99 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:37.759523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c8ae4f9f-63df-4da0-bc3d-649645164a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:37.854508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 192/378] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:37.855687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae4f9f-63df-4da0-bc3d-649645164a99 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:37.911178 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27fe5c1-f86e-47fc-94f2-2af2fd2824e1 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:37.952518 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109b7ff-9bfc-4eda-a511-1ce56a654e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:37.953674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109b7ff-9bfc-4eda-a511-1ce56a654e92 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:37.954118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109b7ff-9bfc-4eda-a511-1ce56a654e92 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:37.954624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f109b7ff-9bfc-4eda-a511-1ce56a654e92 None admin] PATH_INFO: `/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:37.956385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109b7ff-9bfc-4eda-a511-1ce56a654e92 None admin] RBAC: Authorizing `identity:get_group(group_id=776ff4356c1a4302bea8f6506ceb9f2f)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:37.958090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f109b7ff-9bfc-4eda-a511-1ce56a654e92 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:37.964047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 187/379] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:37 2022] GET /identity/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:37.965355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109b7ff-9bfc-4eda-a511-1ce56a654e92 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:37.979565 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ae4f9f-63df-4da0-bc3d-649645164a99 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:37.988424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:38.012819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:38.017702 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a806d-8e16-4a81-b56d-6c34b287d03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:38.018654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a806d-8e16-4a81-b56d-6c34b287d03b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:38.018935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a806d-8e16-4a81-b56d-6c34b287d03b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:38.019381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a806d-8e16-4a81-b56d-6c34b287d03b None admin] PATH_INFO: `/v3/groups/fce0759944aa400c9d4304af695bcf18` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:38.024876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a806d-8e16-4a81-b56d-6c34b287d03b None admin] RBAC: Authorizing `identity:get_group(group_id=fce0759944aa400c9d4304af695bcf18)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:38.026759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a806d-8e16-4a81-b56d-6c34b287d03b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:38.028886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 193/380] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:37 2022] GET /identity/v3/groups/fce0759944aa400c9d4304af695bcf18 => generated 229 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:38.029892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a806d-8e16-4a81-b56d-6c34b287d03b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:38.083090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f109b7ff-9bfc-4eda-a511-1ce56a654e92 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:38.121683 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c46b60-e460-4442-8292-76fbe2a48e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:38.122809 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c46b60-e460-4442-8292-76fbe2a48e43 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:38.123266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c46b60-e460-4442-8292-76fbe2a48e43 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:38.123771 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c46b60-e460-4442-8292-76fbe2a48e43 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:38.135198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c46b60-e460-4442-8292-76fbe2a48e43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:38.140025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a806d-8e16-4a81-b56d-6c34b287d03b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-f5c46b60-e460-4442-8292-76fbe2a48e43 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:38.144416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:38.145461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:38.146260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:38.146260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:38.146260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:38.146260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:38.146260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:38.146260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:38.146260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:38.146260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:38.146260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:38.146260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:38.146260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:38.146260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:38.153901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 188/381] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:38.155112 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c46b60-e460-4442-8292-76fbe2a48e43 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:38.178045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f53ab-f95d-453a-8dbb-dff421ddc3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:38.178721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f53ab-f95d-453a-8dbb-dff421ddc3fb None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:38.179079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f53ab-f95d-453a-8dbb-dff421ddc3fb None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:38.179452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137f53ab-f95d-453a-8dbb-dff421ddc3fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:38.180396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f53ab-f95d-453a-8dbb-dff421ddc3fb None admin] RBAC: Adding query filter params (group.id=776ff4356c1a4302bea8f6506ceb9f2f, role.id=d7474d28a1f24780a0b4c715fdff50b1, scope.project.id=cba82ffc93674e539b81a5c72b00ebb9) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:38.180782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f53ab-f95d-453a-8dbb-dff421ddc3fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:38.183074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137f53ab-f95d-453a-8dbb-dff421ddc3fb None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:38.195850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 194/382] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Jun 23 10:49:38 2022] GET /identity/v3/role_assignments?group.id=776ff4356c1a4302bea8f6506ceb9f2f&scope.project.id=cba82ffc93674e539b81a5c72b00ebb9&role.id=d7474d28a1f24780a0b4c715fdff50b1 => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:38.195850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f53ab-f95d-453a-8dbb-dff421ddc3fb None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:38.292516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:38.301917 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:38.320881 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c46b60-e460-4442-8292-76fbe2a48e43 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:38.365403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137f53ab-f95d-453a-8dbb-dff421ddc3fb None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:38.372590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73399599-8b2c-40b2-beba-2c8778611d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:38.373271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73399599-8b2c-40b2-beba-2c8778611d8e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:38.373554 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73399599-8b2c-40b2-beba-2c8778611d8e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:38.373828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73399599-8b2c-40b2-beba-2c8778611d8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:38.374735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73399599-8b2c-40b2-beba-2c8778611d8e None admin] RBAC: Adding query filter params (group.id=fce0759944aa400c9d4304af695bcf18, role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=38b92a57b84f432b87f291c46bdda9ea) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:38.375050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73399599-8b2c-40b2-beba-2c8778611d8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:38.376603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73399599-8b2c-40b2-beba-2c8778611d8e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:38.392268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 189/383] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Jun 23 10:49:38 2022] GET /identity/v3/role_assignments?group.id=fce0759944aa400c9d4304af695bcf18&scope.project.id=38b92a57b84f432b87f291c46bdda9ea&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 260 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:38.408826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca263b-9cc8-4fc6-b2f2-f22bfbf08daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:38.409905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca263b-9cc8-4fc6-b2f2-f22bfbf08daf None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:38.410397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca263b-9cc8-4fc6-b2f2-f22bfbf08daf None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:38.410892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca263b-9cc8-4fc6-b2f2-f22bfbf08daf None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:38.411945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca263b-9cc8-4fc6-b2f2-f22bfbf08daf None admin] RBAC: Adding query filter params (name=member) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:38.412491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca263b-9cc8-4fc6-b2f2-f22bfbf08daf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:38.414183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca263b-9cc8-4fc6-b2f2-f22bfbf08daf None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:38.424515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 195/384] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:38.430269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73399599-8b2c-40b2-beba-2c8778611d8e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:38.549213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73399599-8b2c-40b2-beba-2c8778611d8e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:38.594950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e765f06-ad48-4511-aba0-bc9db6296af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:38.595718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e765f06-ad48-4511-aba0-bc9db6296af1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:38.595798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e765f06-ad48-4511-aba0-bc9db6296af1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:38.596081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e765f06-ad48-4511-aba0-bc9db6296af1 None admin] PATH_INFO: `/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:38.597746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e765f06-ad48-4511-aba0-bc9db6296af1 None admin] RBAC: Authorizing `identity:get_group(group_id=776ff4356c1a4302bea8f6506ceb9f2f)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:38.599218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e765f06-ad48-4511-aba0-bc9db6296af1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:38.601224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 190/385] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:38 2022] GET /identity/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:38.610850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca263b-9cc8-4fc6-b2f2-f22bfbf08daf None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:38.750550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca263b-9cc8-4fc6-b2f2-f22bfbf08daf None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:38.779557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:38.791415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90ae89e-a494-4e53-83e1-f24156a518da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:38.792309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ae89e-a494-4e53-83e1-f24156a518da None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:38.801484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ae89e-a494-4e53-83e1-f24156a518da None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:38.801484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90ae89e-a494-4e53-83e1-f24156a518da None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:38.801484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ae89e-a494-4e53-83e1-f24156a518da None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:38.801484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90ae89e-a494-4e53-83e1-f24156a518da None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:38.801484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 196/386] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:38 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:38.803437 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e765f06-ad48-4511-aba0-bc9db6296af1 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:38.821556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:38.970586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e765f06-ad48-4511-aba0-bc9db6296af1 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:38.996899 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3750b-ff9c-47b5-9c2e-c4ec76a1a612 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:38.997538 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3750b-ff9c-47b5-9c2e-c4ec76a1a612 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:38.998023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e3750b-ff9c-47b5-9c2e-c4ec76a1a612 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:38.999834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 197/387] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:39.005351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe36c-2abf-423c-a139-78af6f5ffe2e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:39.005880 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe36c-2abf-423c-a139-78af6f5ffe2e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:39.006374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fe36c-2abf-423c-a139-78af6f5ffe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:39.016539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f0470-575c-4160-acfe-0355f22861eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:39.017436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f0470-575c-4160-acfe-0355f22861eb None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:39.017722 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f0470-575c-4160-acfe-0355f22861eb None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:39.017997 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9f0470-575c-4160-acfe-0355f22861eb None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60/groups/776ff4356c1a4302bea8f6506ceb9f2f/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:39.025778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f0470-575c-4160-acfe-0355f22861eb None admin] RBAC: Authorizing `identity:create_grant(project_id=e6da88ad0e094644bb7b47c1e809bb60, group_id=776ff4356c1a4302bea8f6506ceb9f2f, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:39.025778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9f0470-575c-4160-acfe-0355f22861eb None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:39.032163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-435fe36c-2abf-423c-a139-78af6f5ffe2e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:39.033786 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-435fe36c-2abf-423c-a139-78af6f5ffe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:39.099522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 191/388] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Jun 23 10:49:38 2022] PUT /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60/groups/776ff4356c1a4302bea8f6506ceb9f2f/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:39.124517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 198/389] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:39.159711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f0470-575c-4160-acfe-0355f22861eb None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:39.246558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:39.283173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9f0470-575c-4160-acfe-0355f22861eb None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:39.321737 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890ef10-dcda-49bc-a9f1-f8437e3668ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:39.323362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890ef10-dcda-49bc-a9f1-f8437e3668ed None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:39.323940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890ef10-dcda-49bc-a9f1-f8437e3668ed None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:39.325043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b890ef10-dcda-49bc-a9f1-f8437e3668ed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:39.336237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b890ef10-dcda-49bc-a9f1-f8437e3668ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-b890ef10-dcda-49bc-a9f1-f8437e3668ed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:39.344590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:39.345479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:39.346250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:39.346250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:39.346250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:39.346250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:39.346250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:39.346250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:39.346250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:39.346250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:39.346250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:39.346250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:39.346250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:39.346250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:39.348953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 192/390] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:49:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:39.354934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fe36c-2abf-423c-a139-78af6f5ffe2e None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:39.467301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fe36c-2abf-423c-a139-78af6f5ffe2e None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:39.494057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:39.515117 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60a9d6-a874-4076-ab7c-8695df04d011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:39.516142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60a9d6-a874-4076-ab7c-8695df04d011 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:39.516673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60a9d6-a874-4076-ab7c-8695df04d011 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:39.517154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60a9d6-a874-4076-ab7c-8695df04d011 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:39.518097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60a9d6-a874-4076-ab7c-8695df04d011 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:39.518605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60a9d6-a874-4076-ab7c-8695df04d011 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:39.523955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60a9d6-a874-4076-ab7c-8695df04d011 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:39.534028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 199/391] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:39.539012 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890ef10-dcda-49bc-a9f1-f8437e3668ed None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:39.709702 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b890ef10-dcda-49bc-a9f1-f8437e3668ed None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:39.752850 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:39.761028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e00d3-09d3-4d21-8164-23c6ad40da9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:39.762411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e00d3-09d3-4d21-8164-23c6ad40da9e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:39.762714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e00d3-09d3-4d21-8164-23c6ad40da9e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:39.763007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e00d3-09d3-4d21-8164-23c6ad40da9e None admin] PATH_INFO: `/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:39.765800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e00d3-09d3-4d21-8164-23c6ad40da9e None admin] RBAC: Authorizing `identity:get_group(group_id=776ff4356c1a4302bea8f6506ceb9f2f)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:39.767288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e00d3-09d3-4d21-8164-23c6ad40da9e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:39.772072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 193/392] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:39 2022] GET /identity/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f => generated 226 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:39.775006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60a9d6-a874-4076-ab7c-8695df04d011 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:39.922846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60a9d6-a874-4076-ab7c-8695df04d011 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:39.973575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b61df1-438e-4877-a03c-908f4e2a200e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:39.974824 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b61df1-438e-4877-a03c-908f4e2a200e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:39.975354 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b61df1-438e-4877-a03c-908f4e2a200e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:39.976099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b61df1-438e-4877-a03c-908f4e2a200e None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:39.977537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b61df1-438e-4877-a03c-908f4e2a200e None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:39.979177 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b61df1-438e-4877-a03c-908f4e2a200e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:39.981460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 200/393] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:39 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:39.986715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e00d3-09d3-4d21-8164-23c6ad40da9e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:40.107744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e00d3-09d3-4d21-8164-23c6ad40da9e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:40.147567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa362608-5d24-4310-9835-36da81034c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:40.148483 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa362608-5d24-4310-9835-36da81034c7f None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:40.148766 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa362608-5d24-4310-9835-36da81034c7f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:40.149044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa362608-5d24-4310-9835-36da81034c7f None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60/groups/776ff4356c1a4302bea8f6506ceb9f2f/roles/d7474d28a1f24780a0b4c715fdff50b1` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:40.151311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa362608-5d24-4310-9835-36da81034c7f None admin] RBAC: Authorizing `identity:create_grant(project_id=e6da88ad0e094644bb7b47c1e809bb60, group_id=776ff4356c1a4302bea8f6506ceb9f2f, role_id=d7474d28a1f24780a0b4c715fdff50b1)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:40.153328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa362608-5d24-4310-9835-36da81034c7f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:40.253016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 194/394] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Jun 23 10:49:39 2022] PUT /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60/groups/776ff4356c1a4302bea8f6506ceb9f2f/roles/d7474d28a1f24780a0b4c715fdff50b1 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:40.392890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a731e7-07a3-4b36-a24b-4b4d1e729dea None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:40.392890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a731e7-07a3-4b36-a24b-4b4d1e729dea None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:40.392890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a731e7-07a3-4b36-a24b-4b4d1e729dea None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:40.393981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 201/395] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:40.399968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d7d25-cea3-406e-b668-80930c634a50 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:40.400924 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d7d25-cea3-406e-b668-80930c634a50 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:40.401414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739d7d25-cea3-406e-b668-80930c634a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:40.423337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-739d7d25-cea3-406e-b668-80930c634a50 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:40.425068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-739d7d25-cea3-406e-b668-80930c634a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:40.497788 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:40.518348 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 195/396] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:40.542998 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a731e7-07a3-4b36-a24b-4b4d1e729dea None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:40.605389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:40.660217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a731e7-07a3-4b36-a24b-4b4d1e729dea None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:40.674676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacfd9d-bbaa-4b22-ab99-4e2ea130cce2 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:40.674869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacfd9d-bbaa-4b22-ab99-4e2ea130cce2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:40.674981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcacfd9d-bbaa-4b22-ab99-4e2ea130cce2 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:40.676654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 196/397] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:40.681926 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486be96-6184-4f16-937c-0c2569da2424 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:40.685234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486be96-6184-4f16-937c-0c2569da2424 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:40.685234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f486be96-6184-4f16-937c-0c2569da2424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:40.701900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38811bde-1fe1-4e44-9a58-55ce18e081c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:40.702704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-f486be96-6184-4f16-937c-0c2569da2424 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:40.702915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38811bde-1fe1-4e44-9a58-55ce18e081c7 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:40.703151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38811bde-1fe1-4e44-9a58-55ce18e081c7 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:40.703428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38811bde-1fe1-4e44-9a58-55ce18e081c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:40.705011 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f486be96-6184-4f16-937c-0c2569da2424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:40.724726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38811bde-1fe1-4e44-9a58-55ce18e081c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-38811bde-1fe1-4e44-9a58-55ce18e081c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:40.732941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:40.733852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:40.735142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:40.735142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:40.735142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:40.735142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:40.735142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:40.735142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:40.735142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:40.735142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:40.735142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:40.735142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:40.735142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:40.735142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:40.740281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 202/398] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:40.747592 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38811bde-1fe1-4e44-9a58-55ce18e081c7 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:40.811102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 197/399] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:40.829910 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e393779-d354-4130-965f-5c2f34188fcf None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:40.830106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e393779-d354-4130-965f-5c2f34188fcf None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:40.830356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e393779-d354-4130-965f-5c2f34188fcf None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:40.834579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 198/400] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:49:40.837318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8a9cd-4297-444e-9bdc-b826f27b62e2 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:40.837524 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8a9cd-4297-444e-9bdc-b826f27b62e2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:40.837798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8a9cd-4297-444e-9bdc-b826f27b62e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:40.855197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4eb8a9cd-4297-444e-9bdc-b826f27b62e2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:40.856489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4eb8a9cd-4297-444e-9bdc-b826f27b62e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:40.914308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38811bde-1fe1-4e44-9a58-55ce18e081c7 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:40.931869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:40.957005 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 199/401] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:40.957186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1eb2e-7fd8-4846-9689-26d74c448560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:40.958280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1eb2e-7fd8-4846-9689-26d74c448560 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:40.958750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1eb2e-7fd8-4846-9689-26d74c448560 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:40.959204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8a9cd-4297-444e-9bdc-b826f27b62e2 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:40.959307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1eb2e-7fd8-4846-9689-26d74c448560 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:40.960019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1eb2e-7fd8-4846-9689-26d74c448560 None admin] RBAC: Adding query filter params (name=member) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:40.960334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1eb2e-7fd8-4846-9689-26d74c448560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:40.961735 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1eb2e-7fd8-4846-9689-26d74c448560 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:40.971219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 203/402] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:40.979737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1eb2e-7fd8-4846-9689-26d74c448560 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:41.022777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:41.081648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8a9cd-4297-444e-9bdc-b826f27b62e2 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:41.108076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1eb2e-7fd8-4846-9689-26d74c448560 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:41.120480 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969ecd7-d07c-4f4b-b910-23ec706c5f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:41.121310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969ecd7-d07c-4f4b-b910-23ec706c5f87 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:41.121693 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969ecd7-d07c-4f4b-b910-23ec706c5f87 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:41.122074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4969ecd7-d07c-4f4b-b910-23ec706c5f87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:41.133500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4969ecd7-d07c-4f4b-b910-23ec706c5f87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-4969ecd7-d07c-4f4b-b910-23ec706c5f87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:41.143062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:41.144154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:41.145003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:41.145003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:41.145003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:41.145003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:41.145003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:41.145003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:41.145003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:41.145003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:41.145003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:41.145003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:41.145003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:41.145003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:41.145592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 200/403] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:49:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:41.146653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969ecd7-d07c-4f4b-b910-23ec706c5f87 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:41.150534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dac1e-28e4-4d77-af41-b8e8f73aec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:41.151663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dac1e-28e4-4d77-af41-b8e8f73aec33 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:41.152234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dac1e-28e4-4d77-af41-b8e8f73aec33 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:41.152722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0dac1e-28e4-4d77-af41-b8e8f73aec33 None admin] PATH_INFO: `/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:41.154135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dac1e-28e4-4d77-af41-b8e8f73aec33 None admin] RBAC: Authorizing `identity:get_group(group_id=776ff4356c1a4302bea8f6506ceb9f2f)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:41.155798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0dac1e-28e4-4d77-af41-b8e8f73aec33 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:41.162233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 204/404] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:40 2022] GET /identity/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:41.163416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dac1e-28e4-4d77-af41-b8e8f73aec33 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:41.209617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:41.254987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4969ecd7-d07c-4f4b-b910-23ec706c5f87 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:41.264154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:41.278492 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0dac1e-28e4-4d77-af41-b8e8f73aec33 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:41.294622 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138550e9-0af3-4824-9205-87d13dc9a09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:41.295309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138550e9-0af3-4824-9205-87d13dc9a09a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:41.295599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138550e9-0af3-4824-9205-87d13dc9a09a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:41.295906 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138550e9-0af3-4824-9205-87d13dc9a09a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:41.310918 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138550e9-0af3-4824-9205-87d13dc9a09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:41.319072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35a980-cc36-4025-8d93-18008c434066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-138550e9-0af3-4824-9205-87d13dc9a09a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:41.319619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:41.320533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:41.321390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:41.321390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:41.321390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:41.321390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:41.321390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:41.321390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:41.321390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:41.321390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:41.321390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:41.321390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:41.321390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:41.321390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:41.322868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35a980-cc36-4025-8d93-18008c434066 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:41.323407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35a980-cc36-4025-8d93-18008c434066 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:41.323963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af35a980-cc36-4025-8d93-18008c434066 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:41.324979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35a980-cc36-4025-8d93-18008c434066 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:41.325485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35a980-cc36-4025-8d93-18008c434066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:41.325880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 201/405] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:49:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:41.326742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138550e9-0af3-4824-9205-87d13dc9a09a None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:41.328491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af35a980-cc36-4025-8d93-18008c434066 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:41.344742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 205/406] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:41.345823 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35a980-cc36-4025-8d93-18008c434066 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:41.436371 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138550e9-0af3-4824-9205-87d13dc9a09a None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:41.473934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af35a980-cc36-4025-8d93-18008c434066 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:41.477050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:41.485908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7426a0d-9480-47aa-96a5-4b6784da43ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:41.487133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7426a0d-9480-47aa-96a5-4b6784da43ab None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:41.487508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7426a0d-9480-47aa-96a5-4b6784da43ab None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:41.487799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7426a0d-9480-47aa-96a5-4b6784da43ab None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:41.489380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7426a0d-9480-47aa-96a5-4b6784da43ab None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:41.491195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7426a0d-9480-47aa-96a5-4b6784da43ab None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:41.498904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 202/407] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:41 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:41.498904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7426a0d-9480-47aa-96a5-4b6784da43ab None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:41.520758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa712c-3b81-46d8-8a3a-0b6dcac632d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:41.521437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa712c-3b81-46d8-8a3a-0b6dcac632d4 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:41.521779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa712c-3b81-46d8-8a3a-0b6dcac632d4 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:41.522310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa712c-3b81-46d8-8a3a-0b6dcac632d4 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:41.523084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa712c-3b81-46d8-8a3a-0b6dcac632d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:41.523679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa712c-3b81-46d8-8a3a-0b6dcac632d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:41.525178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa712c-3b81-46d8-8a3a-0b6dcac632d4 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:41.537412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 206/408] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:41.540444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa712c-3b81-46d8-8a3a-0b6dcac632d4 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:41.548206 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:41.623727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7426a0d-9480-47aa-96a5-4b6784da43ab None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:41.650035 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa712c-3b81-46d8-8a3a-0b6dcac632d4 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:41.661500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b04a-5a24-4f1b-a902-79c5c1a141e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:41.662774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b04a-5a24-4f1b-a902-79c5c1a141e1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:41.663262 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b04a-5a24-4f1b-a902-79c5c1a141e1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:41.663740 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0331b04a-5a24-4f1b-a902-79c5c1a141e1 None admin] PATH_INFO: `/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:41.665311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331b04a-5a24-4f1b-a902-79c5c1a141e1 None admin] RBAC: Authorizing `identity:get_group(group_id=776ff4356c1a4302bea8f6506ceb9f2f)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:41.667033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0331b04a-5a24-4f1b-a902-79c5c1a141e1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:41.670002 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 203/409] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:41 2022] GET /identity/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:41.671089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b04a-5a24-4f1b-a902-79c5c1a141e1 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:41.701433 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7aeb1-077d-4433-8add-b1eded5f04c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:41.701969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7aeb1-077d-4433-8add-b1eded5f04c0 None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:41.702257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7aeb1-077d-4433-8add-b1eded5f04c0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:41.702539 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7aeb1-077d-4433-8add-b1eded5f04c0 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9/groups/776ff4356c1a4302bea8f6506ceb9f2f/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:41.707848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7aeb1-077d-4433-8add-b1eded5f04c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=cba82ffc93674e539b81a5c72b00ebb9, group_id=776ff4356c1a4302bea8f6506ceb9f2f, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:41.709306 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf7aeb1-077d-4433-8add-b1eded5f04c0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:41.788310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0331b04a-5a24-4f1b-a902-79c5c1a141e1 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:41.794256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:41.807644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 207/410] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Jun 23 10:49:41 2022] PUT /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9/groups/776ff4356c1a4302bea8f6506ceb9f2f/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:41.808865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7aeb1-077d-4433-8add-b1eded5f04c0 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:41.846105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1464d1-7ff4-43a8-a152-1d7448ad3e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:41.847392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1464d1-7ff4-43a8-a152-1d7448ad3e8d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:41.847931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1464d1-7ff4-43a8-a152-1d7448ad3e8d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:41.848429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1464d1-7ff4-43a8-a152-1d7448ad3e8d None admin] PATH_INFO: `/v3/groups/fce0759944aa400c9d4304af695bcf18` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:41.855857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1464d1-7ff4-43a8-a152-1d7448ad3e8d None admin] RBAC: Authorizing `identity:get_group(group_id=fce0759944aa400c9d4304af695bcf18)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:41.855857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1464d1-7ff4-43a8-a152-1d7448ad3e8d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:41.856880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 204/411] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:41 2022] GET /identity/v3/groups/fce0759944aa400c9d4304af695bcf18 => generated 229 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:41.863107 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1464d1-7ff4-43a8-a152-1d7448ad3e8d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:41.914171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:41.997302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1464d1-7ff4-43a8-a152-1d7448ad3e8d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:42.064953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c858438-2098-4178-8469-3fe569532b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:42.066160 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c858438-2098-4178-8469-3fe569532b8b None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.066443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c858438-2098-4178-8469-3fe569532b8b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.066725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c858438-2098-4178-8469-3fe569532b8b None admin] PATH_INFO: `/v3/projects/38b92a57b84f432b87f291c46bdda9ea` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.068446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c858438-2098-4178-8469-3fe569532b8b None admin] RBAC: Authorizing `identity:get_project(project_id=38b92a57b84f432b87f291c46bdda9ea)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:42.070517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c858438-2098-4178-8469-3fe569532b8b None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:42.072436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 205/412] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:41 2022] GET /identity/v3/projects/38b92a57b84f432b87f291c46bdda9ea => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:42.075858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527878a1-af35-4a8e-a8ea-69184340a4ca None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.075858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527878a1-af35-4a8e-a8ea-69184340a4ca None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.075858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527878a1-af35-4a8e-a8ea-69184340a4ca None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.076089 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7aeb1-077d-4433-8add-b1eded5f04c0 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:42.080125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 206/413] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:42.080945 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527878a1-af35-4a8e-a8ea-69184340a4ca None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:42.119927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5c78b-f4de-412d-906c-73eb3efe0cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:42.121641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c78b-f4de-412d-906c-73eb3efe0cc0 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.121641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c78b-f4de-412d-906c-73eb3efe0cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.121930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c78b-f4de-412d-906c-73eb3efe0cc0 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.123139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5c78b-f4de-412d-906c-73eb3efe0cc0 None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:42.124805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5c78b-f4de-412d-906c-73eb3efe0cc0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:42.133605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 208/414] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:41 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:42.133605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464a359-9f6c-4cf6-b552-e9800ad82b6d None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.133605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464a359-9f6c-4cf6-b552-e9800ad82b6d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.133910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464a359-9f6c-4cf6-b552-e9800ad82b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.153255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-9464a359-9f6c-4cf6-b552-e9800ad82b6d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:42.154521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9464a359-9f6c-4cf6-b552-e9800ad82b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:42.220951 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:42.233424 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 209/415] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:42.234679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464a359-9f6c-4cf6-b552-e9800ad82b6d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:42.275468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:42.335321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527878a1-af35-4a8e-a8ea-69184340a4ca None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:42.372136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464a359-9f6c-4cf6-b552-e9800ad82b6d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:42.375574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bff31-1157-4d3f-823c-12d84d728c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:42.376275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bff31-1157-4d3f-823c-12d84d728c86 None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.376560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bff31-1157-4d3f-823c-12d84d728c86 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.376843 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583bff31-1157-4d3f-823c-12d84d728c86 None admin] PATH_INFO: `/v3/projects/38b92a57b84f432b87f291c46bdda9ea/groups/fce0759944aa400c9d4304af695bcf18/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.378909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bff31-1157-4d3f-823c-12d84d728c86 None admin] RBAC: Authorizing `identity:create_grant(project_id=38b92a57b84f432b87f291c46bdda9ea, group_id=fce0759944aa400c9d4304af695bcf18, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:42.380441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583bff31-1157-4d3f-823c-12d84d728c86 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:42.414866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebb240e-48d4-44b1-86c7-ab6a24fe8899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:42.415771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb240e-48d4-44b1-86c7-ab6a24fe8899 None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.416162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb240e-48d4-44b1-86c7-ab6a24fe8899 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.416515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebb240e-48d4-44b1-86c7-ab6a24fe8899 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9/groups/776ff4356c1a4302bea8f6506ceb9f2f/roles/d7474d28a1f24780a0b4c715fdff50b1` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.419449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb240e-48d4-44b1-86c7-ab6a24fe8899 None admin] RBAC: Authorizing `identity:create_grant(project_id=cba82ffc93674e539b81a5c72b00ebb9, group_id=776ff4356c1a4302bea8f6506ceb9f2f, role_id=d7474d28a1f24780a0b4c715fdff50b1)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:42.421029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebb240e-48d4-44b1-86c7-ab6a24fe8899 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:42.447337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 207/416] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Jun 23 10:49:42 2022] PUT /identity/v3/projects/38b92a57b84f432b87f291c46bdda9ea/groups/fce0759944aa400c9d4304af695bcf18/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:42.452259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bff31-1157-4d3f-823c-12d84d728c86 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:42.503826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 210/417] 10.222.0.52 () {58 vars in 1442 bytes} [Thu Jun 23 10:49:42 2022] PUT /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9/groups/776ff4356c1a4302bea8f6506ceb9f2f/roles/d7474d28a1f24780a0b4c715fdff50b1 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:49:42.620681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:42.629770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583bff31-1157-4d3f-823c-12d84d728c86 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:42.680381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40202d65-aa2b-4687-933d-7755b9a566f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:42.681233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202d65-aa2b-4687-933d-7755b9a566f4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.681515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202d65-aa2b-4687-933d-7755b9a566f4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.681793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40202d65-aa2b-4687-933d-7755b9a566f4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.693928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987ec33-0821-415b-897e-532c8edf91b5 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.694226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987ec33-0821-415b-897e-532c8edf91b5 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.694496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9987ec33-0821-415b-897e-532c8edf91b5 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.695908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 211/418] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:49:42.697773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40202d65-aa2b-4687-933d-7755b9a566f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:42.701705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379794a-684e-466e-a1a9-f12f729530d6 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.702008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379794a-684e-466e-a1a9-f12f729530d6 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.702278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379794a-684e-466e-a1a9-f12f729530d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-40202d65-aa2b-4687-933d-7755b9a566f4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:42.706638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:42.707546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:42.708386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 208/419] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:42.713651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40202d65-aa2b-4687-933d-7755b9a566f4 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:42.729031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-e379794a-684e-466e-a1a9-f12f729530d6 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:42.731006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e379794a-684e-466e-a1a9-f12f729530d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:42.818544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 212/420] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:42.833544 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40202d65-aa2b-4687-933d-7755b9a566f4 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:42.839565 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379794a-684e-466e-a1a9-f12f729530d6 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:42.855201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:42.874328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c382a-65f9-427c-b582-2e3e09f7c98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:42.875234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c382a-65f9-427c-b582-2e3e09f7c98d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:42.875686 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c382a-65f9-427c-b582-2e3e09f7c98d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:42.876129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922c382a-65f9-427c-b582-2e3e09f7c98d None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:42.877015 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c382a-65f9-427c-b582-2e3e09f7c98d None admin] RBAC: Adding query filter params (name=member) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:42.877463 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c382a-65f9-427c-b582-2e3e09f7c98d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:42.878985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922c382a-65f9-427c-b582-2e3e09f7c98d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:42.888931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 209/421] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:42.894620 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c382a-65f9-427c-b582-2e3e09f7c98d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:42.936558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:42.985864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379794a-684e-466e-a1a9-f12f729530d6 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:43.053907 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c15f0-fc6d-48be-98bb-fc0328fb706b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:43.055318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c15f0-fc6d-48be-98bb-fc0328fb706b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:43.056061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c15f0-fc6d-48be-98bb-fc0328fb706b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:43.056546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1c15f0-fc6d-48be-98bb-fc0328fb706b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:43.079066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922c382a-65f9-427c-b582-2e3e09f7c98d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:43.082259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1c15f0-fc6d-48be-98bb-fc0328fb706b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-0a1c15f0-fc6d-48be-98bb-fc0328fb706b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:43.090798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:43.091673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:43.092504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:43.092504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:43.092504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:43.092504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:43.092504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:43.092504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:43.092504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:43.092504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:43.092504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:43.092504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:43.092504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:43.092504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:43.098811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 213/422] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:49:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:43.102576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c15f0-fc6d-48be-98bb-fc0328fb706b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:43.150192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbceaa-0fcf-4aec-86d9-2c3df64a7524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:43.150852 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbceaa-0fcf-4aec-86d9-2c3df64a7524 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:43.151135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbceaa-0fcf-4aec-86d9-2c3df64a7524 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:43.151412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbceaa-0fcf-4aec-86d9-2c3df64a7524 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:43.239385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:43.274494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1c15f0-fc6d-48be-98bb-fc0328fb706b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:43.312909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbceaa-0fcf-4aec-86d9-2c3df64a7524 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:43.314388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbceaa-0fcf-4aec-86d9-2c3df64a7524 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:43.315783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1beb93-35bd-4ee4-84c4-1608af79368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:43.316649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1beb93-35bd-4ee4-84c4-1608af79368d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:43.316942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1beb93-35bd-4ee4-84c4-1608af79368d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:43.317228 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1beb93-35bd-4ee4-84c4-1608af79368d None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:43.317985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1beb93-35bd-4ee4-84c4-1608af79368d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:43.318299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1beb93-35bd-4ee4-84c4-1608af79368d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:43.319678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1beb93-35bd-4ee4-84c4-1608af79368d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:43.336481 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 214/423] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:43.337867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1beb93-35bd-4ee4-84c4-1608af79368d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:43.384137 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:43.459065 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1beb93-35bd-4ee4-84c4-1608af79368d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:43.500058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f3900-bb7a-4955-a1ca-92f7b1aa8d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:43.500733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f3900-bb7a-4955-a1ca-92f7b1aa8d22 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:43.501344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f3900-bb7a-4955-a1ca-92f7b1aa8d22 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:43.501633 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f3900-bb7a-4955-a1ca-92f7b1aa8d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:43.504779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:43.579674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f3900-bb7a-4955-a1ca-92f7b1aa8d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:43.581739 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3f3900-bb7a-4955-a1ca-92f7b1aa8d22 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:43.640514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 210/424] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 743 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:49:43.654588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbceaa-0fcf-4aec-86d9-2c3df64a7524 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:43.762520 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 215/425] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:43.767678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f3900-bb7a-4955-a1ca-92f7b1aa8d22 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:43.813979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:43.816901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbceaa-0fcf-4aec-86d9-2c3df64a7524 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:43.868007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:43.877487 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f3900-bb7a-4955-a1ca-92f7b1aa8d22 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:43.913540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b011bf-f154-49a7-b240-e9c309d3da37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:43.914970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b011bf-f154-49a7-b240-e9c309d3da37 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:43.916296 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1cf5d-c875-42a0-bdf5-e350f68a6524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:43.917540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1cf5d-c875-42a0-bdf5-e350f68a6524 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:43.918519 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b011bf-f154-49a7-b240-e9c309d3da37 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:43.918942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b011bf-f154-49a7-b240-e9c309d3da37 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:43.919962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1cf5d-c875-42a0-bdf5-e350f68a6524 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:43.920385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1cf5d-c875-42a0-bdf5-e350f68a6524 None admin] PATH_INFO: `/v3/projects/e6da88ad0e094644bb7b47c1e809bb60` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:43.921182 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b011bf-f154-49a7-b240-e9c309d3da37 None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:43.923440 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b011bf-f154-49a7-b240-e9c309d3da37 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:43.924288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1cf5d-c875-42a0-bdf5-e350f68a6524 None admin] RBAC: Authorizing `identity:get_project(project_id=e6da88ad0e094644bb7b47c1e809bb60)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:43.927736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1cf5d-c875-42a0-bdf5-e350f68a6524 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:43.935914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 211/426] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:43 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:43.937045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 216/427] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:43 2022] GET /identity/v3/projects/e6da88ad0e094644bb7b47c1e809bb60 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:43.938706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b011bf-f154-49a7-b240-e9c309d3da37 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:43.965266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1cf5d-c875-42a0-bdf5-e350f68a6524 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:44.104720 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1cf5d-c875-42a0-bdf5-e350f68a6524 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:44.106839 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:44.126970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b011bf-f154-49a7-b240-e9c309d3da37 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:44.163453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555c128-e835-41cd-9603-e23121f6ff8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:44.164560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555c128-e835-41cd-9603-e23121f6ff8c None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:44.164880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555c128-e835-41cd-9603-e23121f6ff8c None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:44.165256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555c128-e835-41cd-9603-e23121f6ff8c None admin] PATH_INFO: `/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:44.166579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555c128-e835-41cd-9603-e23121f6ff8c None admin] RBAC: Authorizing `identity:get_group(group_id=776ff4356c1a4302bea8f6506ceb9f2f)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:44.168719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555c128-e835-41cd-9603-e23121f6ff8c None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:44.170753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 212/428] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:43 2022] GET /identity/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:44.175166 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd37bb-77ba-497c-af14-1fe2bcc86a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:44.176181 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd37bb-77ba-497c-af14-1fe2bcc86a55 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:44.176362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd37bb-77ba-497c-af14-1fe2bcc86a55 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:44.176673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddd37bb-77ba-497c-af14-1fe2bcc86a55 None admin] PATH_INFO: `/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:44.177792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555c128-e835-41cd-9603-e23121f6ff8c None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:44.177903 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd37bb-77ba-497c-af14-1fe2bcc86a55 None admin] RBAC: Authorizing `identity:get_group(group_id=776ff4356c1a4302bea8f6506ceb9f2f)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:44.179272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddd37bb-77ba-497c-af14-1fe2bcc86a55 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:44.181180 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 217/429] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:43 2022] GET /identity/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:44.186845 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd37bb-77ba-497c-af14-1fe2bcc86a55 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:44.279033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:44.359532 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555c128-e835-41cd-9603-e23121f6ff8c None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:44.365841 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddd37bb-77ba-497c-af14-1fe2bcc86a55 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:44.404883 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675b05ea-40df-46ef-a320-ae0a17090abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:44.405547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b05ea-40df-46ef-a320-ae0a17090abe None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:44.405830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b05ea-40df-46ef-a320-ae0a17090abe None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:44.406102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675b05ea-40df-46ef-a320-ae0a17090abe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:44.406936 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b05ea-40df-46ef-a320-ae0a17090abe None admin] RBAC: Adding query filter params (group.id=776ff4356c1a4302bea8f6506ceb9f2f, role.id=7a7c8cc02f174648b814192cba5506ad, scope.project.id=e6da88ad0e094644bb7b47c1e809bb60) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:44.407352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b05ea-40df-46ef-a320-ae0a17090abe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:44.408810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24417332-fcdc-4cd3-b75c-56a3359f256f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:44.409017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675b05ea-40df-46ef-a320-ae0a17090abe None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:44.409601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24417332-fcdc-4cd3-b75c-56a3359f256f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:44.409947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24417332-fcdc-4cd3-b75c-56a3359f256f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:44.410291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24417332-fcdc-4cd3-b75c-56a3359f256f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:44.411371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24417332-fcdc-4cd3-b75c-56a3359f256f None admin] RBAC: Adding query filter params (group.id=776ff4356c1a4302bea8f6506ceb9f2f, role.id=d7474d28a1f24780a0b4c715fdff50b1, scope.project.id=e6da88ad0e094644bb7b47c1e809bb60) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:44.411751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24417332-fcdc-4cd3-b75c-56a3359f256f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:44.414059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24417332-fcdc-4cd3-b75c-56a3359f256f None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:44.415878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 213/430] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Jun 23 10:49:44 2022] GET /identity/v3/role_assignments?group.id=776ff4356c1a4302bea8f6506ceb9f2f&scope.project.id=e6da88ad0e094644bb7b47c1e809bb60&role.id=7a7c8cc02f174648b814192cba5506ad => generated 611 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:44.418075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f8fd-4097-483c-b092-e9c5aa25a6dc None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:44.418363 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f8fd-4097-483c-b092-e9c5aa25a6dc None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:44.418646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8818f8fd-4097-483c-b092-e9c5aa25a6dc None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:44.420683 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 214/431] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:44.425728 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 218/432] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Jun 23 10:49:44 2022] GET /identity/v3/role_assignments?group.id=776ff4356c1a4302bea8f6506ceb9f2f&scope.project.id=e6da88ad0e094644bb7b47c1e809bb60&role.id=d7474d28a1f24780a0b4c715fdff50b1 => generated 611 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:44.426759 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fca52-8ab8-4e28-9c72-6b820a42ec6f None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:44.436305 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fca52-8ab8-4e28-9c72-6b820a42ec6f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:44.436638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3fca52-8ab8-4e28-9c72-6b820a42ec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:44.465533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3f3fca52-8ab8-4e28-9c72-6b820a42ec6f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:44.466795 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3f3fca52-8ab8-4e28-9c72-6b820a42ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:44.590783 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 215/433] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:44.617704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24417332-fcdc-4cd3-b75c-56a3359f256f None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:44.684142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:44.762680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24417332-fcdc-4cd3-b75c-56a3359f256f None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:44.806862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803fdee-f72b-45a7-a1fa-cadd5e5a999a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:44.806862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803fdee-f72b-45a7-a1fa-cadd5e5a999a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:44.806862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803fdee-f72b-45a7-a1fa-cadd5e5a999a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:44.806862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803fdee-f72b-45a7-a1fa-cadd5e5a999a None admin] PATH_INFO: `/v3/roles/member` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:44.819981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803fdee-f72b-45a7-a1fa-cadd5e5a999a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:44.831886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b95e5-c7ee-4462-a673-e1f922b5a20f None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:44.832396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b95e5-c7ee-4462-a673-e1f922b5a20f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:44.832473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901b95e5-c7ee-4462-a673-e1f922b5a20f None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:44.833972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 216/434] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-5803fdee-f72b-45a7-a1fa-cadd5e5a999a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:44.836766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:44.837737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:44.839008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 219/435] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:44.846173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b95e5-c7ee-4462-a673-e1f922b5a20f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:44.846762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e041945-54bb-471b-a9cb-b917518f4459 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:44.847055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e041945-54bb-471b-a9cb-b917518f4459 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:44.847343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e041945-54bb-471b-a9cb-b917518f4459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:44.867592 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-5e041945-54bb-471b-a9cb-b917518f4459 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:44.868924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5e041945-54bb-471b-a9cb-b917518f4459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:44.924052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:44.958410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 220/436] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:44.982682 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e041945-54bb-471b-a9cb-b917518f4459 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:44.984923 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901b95e5-c7ee-4462-a673-e1f922b5a20f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:45.014800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:45.032435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c658397-8e0a-487b-bad5-7d65a1301ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:45.033109 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c658397-8e0a-487b-bad5-7d65a1301ee4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:45.033387 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c658397-8e0a-487b-bad5-7d65a1301ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:45.033647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c658397-8e0a-487b-bad5-7d65a1301ee4 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:45.034399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c658397-8e0a-487b-bad5-7d65a1301ee4 None admin] RBAC: Adding query filter params (name=member) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:45.034702 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c658397-8e0a-487b-bad5-7d65a1301ee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:45.037452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c658397-8e0a-487b-bad5-7d65a1301ee4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:45.053047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 217/437] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:49:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:45.054467 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c658397-8e0a-487b-bad5-7d65a1301ee4 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:45.124239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e041945-54bb-471b-a9cb-b917518f4459 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:45.165950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9159f56b-ac11-4384-a3b9-a5f50cf15309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:45.166771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159f56b-ac11-4384-a3b9-a5f50cf15309 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:45.167583 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159f56b-ac11-4384-a3b9-a5f50cf15309 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:45.167583 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9159f56b-ac11-4384-a3b9-a5f50cf15309 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:45.181646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9159f56b-ac11-4384-a3b9-a5f50cf15309 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-9159f56b-ac11-4384-a3b9-a5f50cf15309 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:45.193030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:45.194670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 221/438] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:45.196343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4de12-9fff-4979-9c90-c0285d05784b None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:45.198110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4de12-9fff-4979-9c90-c0285d05784b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:45.198110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e4de12-9fff-4979-9c90-c0285d05784b None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:45.198110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 222/439] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:45.198459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c658397-8e0a-487b-bad5-7d65a1301ee4 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:45.207254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b699c7-f975-405f-a9ad-248a8bae91f4 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:45.207553 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b699c7-f975-405f-a9ad-248a8bae91f4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:45.209100 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b699c7-f975-405f-a9ad-248a8bae91f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:45.219843 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:45.227243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b8b699c7-f975-405f-a9ad-248a8bae91f4 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:45.228479 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b8b699c7-f975-405f-a9ad-248a8bae91f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:45.239422 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c24705-e5e8-47b8-aabd-172c60aa80fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:45.240099 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c24705-e5e8-47b8-aabd-172c60aa80fb None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:45.240377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c24705-e5e8-47b8-aabd-172c60aa80fb None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:45.240654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c24705-e5e8-47b8-aabd-172c60aa80fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:45.301590 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 223/440] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:45.302438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b699c7-f975-405f-a9ad-248a8bae91f4 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:45.308943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c24705-e5e8-47b8-aabd-172c60aa80fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:45.310404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c24705-e5e8-47b8-aabd-172c60aa80fb None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:45.325483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:45.419475 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 218/441] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:45.420359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c24705-e5e8-47b8-aabd-172c60aa80fb None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:45.430348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b699c7-f975-405f-a9ad-248a8bae91f4 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:45.437449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:45.467517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6264efa-4438-40a8-be01-a995db9efd2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:45.468141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6264efa-4438-40a8-be01-a995db9efd2e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:45.468420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6264efa-4438-40a8-be01-a995db9efd2e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:45.468693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6264efa-4438-40a8-be01-a995db9efd2e None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:45.469444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6264efa-4438-40a8-be01-a995db9efd2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:45.469746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6264efa-4438-40a8-be01-a995db9efd2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:45.471147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6264efa-4438-40a8-be01-a995db9efd2e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:45.480492 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 224/442] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:45.481318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6264efa-4438-40a8-be01-a995db9efd2e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:45.530611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c24705-e5e8-47b8-aabd-172c60aa80fb None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:45.568501 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc485-6196-499d-88ea-f8cdd52ef704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:45.569297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc485-6196-499d-88ea-f8cdd52ef704 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:45.569574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:45.569694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc485-6196-499d-88ea-f8cdd52ef704 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:45.569835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625dc485-6196-499d-88ea-f8cdd52ef704 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:45.585495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625dc485-6196-499d-88ea-f8cdd52ef704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-625dc485-6196-499d-88ea-f8cdd52ef704 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:45.593537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:45.594420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:45.595224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 219/443] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:49:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:45.595935 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc485-6196-499d-88ea-f8cdd52ef704 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:45.596002 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6264efa-4438-40a8-be01-a995db9efd2e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:45.631704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2a6ba-5d33-4d48-bae6-ec37f213bec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:45.632589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2a6ba-5d33-4d48-bae6-ec37f213bec7 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:45.632871 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2a6ba-5d33-4d48-bae6-ec37f213bec7 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:45.633146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2a6ba-5d33-4d48-bae6-ec37f213bec7 None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:45.634339 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2a6ba-5d33-4d48-bae6-ec37f213bec7 None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:45.635778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b2a6ba-5d33-4d48-bae6-ec37f213bec7 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:45.637531 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 225/444] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:45 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:45.638286 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2a6ba-5d33-4d48-bae6-ec37f213bec7 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:45.666004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:45.695988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625dc485-6196-499d-88ea-f8cdd52ef704 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:45.728825 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747817-11c2-4e14-adee-f88667556540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:45.729388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747817-11c2-4e14-adee-f88667556540 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:45.729667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747817-11c2-4e14-adee-f88667556540 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:45.729941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8747817-11c2-4e14-adee-f88667556540 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:45.743337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b2a6ba-5d33-4d48-bae6-ec37f213bec7 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:45.777205 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470d22d-d8a0-4003-b157-f95936013ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:45.777939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470d22d-d8a0-4003-b157-f95936013ab1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:45.778335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470d22d-d8a0-4003-b157-f95936013ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:45.778692 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5470d22d-d8a0-4003-b157-f95936013ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:45.779518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470d22d-d8a0-4003-b157-f95936013ab1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:45.779926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470d22d-d8a0-4003-b157-f95936013ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:45.781293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5470d22d-d8a0-4003-b157-f95936013ab1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:45.789170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 226/445] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:45.789956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470d22d-d8a0-4003-b157-f95936013ab1 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:45.797334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8747817-11c2-4e14-adee-f88667556540 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:45.798723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:45.798837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8747817-11c2-4e14-adee-f88667556540 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:45.867663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:45.899243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5470d22d-d8a0-4003-b157-f95936013ab1 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:45.906540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 220/446] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:45.907393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747817-11c2-4e14-adee-f88667556540 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:45.935984 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c3afa-cd24-4473-b835-e5a238cdcc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:45.936847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c3afa-cd24-4473-b835-e5a238cdcc56 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:45.937127 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c3afa-cd24-4473-b835-e5a238cdcc56 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:45.937409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072c3afa-cd24-4473-b835-e5a238cdcc56 None admin] PATH_INFO: `/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:45.938596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c3afa-cd24-4473-b835-e5a238cdcc56 None admin] RBAC: Authorizing `identity:get_group(group_id=776ff4356c1a4302bea8f6506ceb9f2f)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:45.940083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072c3afa-cd24-4473-b835-e5a238cdcc56 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:45.941711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 227/447] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:45 2022] GET /identity/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f => generated 226 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:45.942466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c3afa-cd24-4473-b835-e5a238cdcc56 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:46.013880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8747817-11c2-4e14-adee-f88667556540 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:46.024055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:46.047883 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa6fc0-f64c-49fb-bbd3-d6f37a1d22e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:46.048534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa6fc0-f64c-49fb-bbd3-d6f37a1d22e6 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:46.048834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa6fc0-f64c-49fb-bbd3-d6f37a1d22e6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:46.049024 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072c3afa-cd24-4473-b835-e5a238cdcc56 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:46.049118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa6fc0-f64c-49fb-bbd3-d6f37a1d22e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:46.083883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640077b-5fea-449e-9ec6-de173b1b1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:46.084741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640077b-5fea-449e-9ec6-de173b1b1c66 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:46.085056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640077b-5fea-449e-9ec6-de173b1b1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:46.085338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640077b-5fea-449e-9ec6-de173b1b1c66 None admin] PATH_INFO: `/v3/projects/38b92a57b84f432b87f291c46bdda9ea` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:46.086603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640077b-5fea-449e-9ec6-de173b1b1c66 None admin] RBAC: Authorizing `identity:get_project(project_id=38b92a57b84f432b87f291c46bdda9ea)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:46.088116 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640077b-5fea-449e-9ec6-de173b1b1c66 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:46.094480 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 228/448] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:45 2022] GET /identity/v3/projects/38b92a57b84f432b87f291c46bdda9ea => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:46.094630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:46.094717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640077b-5fea-449e-9ec6-de173b1b1c66 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:46.116901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa6fc0-f64c-49fb-bbd3-d6f37a1d22e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:46.118390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa6fc0-f64c-49fb-bbd3-d6f37a1d22e6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:46.191051 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640077b-5fea-449e-9ec6-de173b1b1c66 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:46.216965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 221/449] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:46.217802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa6fc0-f64c-49fb-bbd3-d6f37a1d22e6 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:46.224297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef1c44-b844-4271-a168-cd9617d5a5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:46.224954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef1c44-b844-4271-a168-cd9617d5a5f5 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:46.225508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef1c44-b844-4271-a168-cd9617d5a5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:46.225792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaef1c44-b844-4271-a168-cd9617d5a5f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:46.226732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef1c44-b844-4271-a168-cd9617d5a5f5 None admin] RBAC: Adding query filter params (group.id=776ff4356c1a4302bea8f6506ceb9f2f, role.id=7a7c8cc02f174648b814192cba5506ad, scope.project.id=cba82ffc93674e539b81a5c72b00ebb9) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:46.227054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef1c44-b844-4271-a168-cd9617d5a5f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:46.228525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaef1c44-b844-4271-a168-cd9617d5a5f5 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:46.234986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 229/450] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Jun 23 10:49:46 2022] GET /identity/v3/role_assignments?group.id=776ff4356c1a4302bea8f6506ceb9f2f&scope.project.id=cba82ffc93674e539b81a5c72b00ebb9&role.id=7a7c8cc02f174648b814192cba5506ad => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:46.235755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef1c44-b844-4271-a168-cd9617d5a5f5 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:46.245418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:46.310835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:46.345683 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa6fc0-f64c-49fb-bbd3-d6f37a1d22e6 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:46.353632 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaef1c44-b844-4271-a168-cd9617d5a5f5 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:46.388983 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31301d5-2c23-4f94-b0cf-bd89e4b92caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:46.389826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31301d5-2c23-4f94-b0cf-bd89e4b92caa None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:46.390104 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31301d5-2c23-4f94-b0cf-bd89e4b92caa None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:46.390376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31301d5-2c23-4f94-b0cf-bd89e4b92caa None admin] PATH_INFO: `/v3/groups/fce0759944aa400c9d4304af695bcf18` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:46.391551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31301d5-2c23-4f94-b0cf-bd89e4b92caa None admin] RBAC: Authorizing `identity:get_group(group_id=fce0759944aa400c9d4304af695bcf18)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:46.393034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31301d5-2c23-4f94-b0cf-bd89e4b92caa None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:46.393138 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795c33f-cf09-4414-989d-22b25b3f387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:46.393995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795c33f-cf09-4414-989d-22b25b3f387d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:46.394281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795c33f-cf09-4414-989d-22b25b3f387d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:46.394566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0795c33f-cf09-4414-989d-22b25b3f387d None admin] PATH_INFO: `/v3/projects/cba82ffc93674e539b81a5c72b00ebb9` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:46.394691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 222/451] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:46 2022] GET /identity/v3/groups/fce0759944aa400c9d4304af695bcf18 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:46.395751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795c33f-cf09-4414-989d-22b25b3f387d None admin] RBAC: Authorizing `identity:get_project(project_id=cba82ffc93674e539b81a5c72b00ebb9)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:46.397295 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0795c33f-cf09-4414-989d-22b25b3f387d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:46.399131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 230/452] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:49:46 2022] GET /identity/v3/projects/cba82ffc93674e539b81a5c72b00ebb9 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:46.400597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31301d5-2c23-4f94-b0cf-bd89e4b92caa None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:46.404845 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795c33f-cf09-4414-989d-22b25b3f387d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:46.491268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:46.521464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0795c33f-cf09-4414-989d-22b25b3f387d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:46.525017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31301d5-2c23-4f94-b0cf-bd89e4b92caa None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:46.566031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387b97a-d401-4ae1-87f9-182bd0e37998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:46.567180 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68642ca-3989-4da6-bb55-57d5143929d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:46.567446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387b97a-d401-4ae1-87f9-182bd0e37998 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:46.567844 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68642ca-3989-4da6-bb55-57d5143929d8 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:46.568054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387b97a-d401-4ae1-87f9-182bd0e37998 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:46.568153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68642ca-3989-4da6-bb55-57d5143929d8 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:46.568299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387b97a-d401-4ae1-87f9-182bd0e37998 None admin] PATH_INFO: `/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:46.568389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68642ca-3989-4da6-bb55-57d5143929d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:46.569202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68642ca-3989-4da6-bb55-57d5143929d8 None admin] RBAC: Adding query filter params (group.id=fce0759944aa400c9d4304af695bcf18, role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=38b92a57b84f432b87f291c46bdda9ea) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:46.569501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387b97a-d401-4ae1-87f9-182bd0e37998 None admin] RBAC: Authorizing `identity:get_group(group_id=776ff4356c1a4302bea8f6506ceb9f2f)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:46.569619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68642ca-3989-4da6-bb55-57d5143929d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:46.570940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68642ca-3989-4da6-bb55-57d5143929d8 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:46.571056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2387b97a-d401-4ae1-87f9-182bd0e37998 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:46.573086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 231/453] 10.222.0.52 () {56 vars in 1180 bytes} [Thu Jun 23 10:49:46 2022] GET /identity/v3/groups/776ff4356c1a4302bea8f6506ceb9f2f => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:46.580912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387b97a-d401-4ae1-87f9-182bd0e37998 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:46.581032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 223/454] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Jun 23 10:49:46 2022] GET /identity/v3/role_assignments?group.id=fce0759944aa400c9d4304af695bcf18&scope.project.id=38b92a57b84f432b87f291c46bdda9ea&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:46.697124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2387b97a-d401-4ae1-87f9-182bd0e37998 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:46.734875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccfe1e5-4f13-476e-83e6-e90a81761078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:46.735547 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe1e5-4f13-476e-83e6-e90a81761078 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:46.735853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe1e5-4f13-476e-83e6-e90a81761078 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:46.736142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccfe1e5-4f13-476e-83e6-e90a81761078 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:46.736978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfe1e5-4f13-476e-83e6-e90a81761078 None admin] RBAC: Adding query filter params (group.id=776ff4356c1a4302bea8f6506ceb9f2f, role.id=d7474d28a1f24780a0b4c715fdff50b1, scope.project.id=cba82ffc93674e539b81a5c72b00ebb9) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:46.737291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfe1e5-4f13-476e-83e6-e90a81761078 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:46.738744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccfe1e5-4f13-476e-83e6-e90a81761078 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:46.745113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 232/455] 10.222.0.52 () {56 vars in 1376 bytes} [Thu Jun 23 10:49:46 2022] GET /identity/v3/role_assignments?group.id=776ff4356c1a4302bea8f6506ceb9f2f&scope.project.id=cba82ffc93674e539b81a5c72b00ebb9&role.id=d7474d28a1f24780a0b4c715fdff50b1 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:49.244161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3e381-cddd-478a-839d-603a8725dd86 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.244682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3e381-cddd-478a-839d-603a8725dd86 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.244758 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3e381-cddd-478a-839d-603a8725dd86 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.246459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 224/456] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:49.251528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e835cd-e804-41d4-a225-4367fc6082ab None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.251956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e835cd-e804-41d4-a225-4367fc6082ab None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.252148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e835cd-e804-41d4-a225-4367fc6082ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.267292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:49.273700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-74e835cd-e804-41d4-a225-4367fc6082ab None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.274919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-74e835cd-e804-41d4-a225-4367fc6082ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.369541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 233/457] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:49.412642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3e381-cddd-478a-839d-603a8725dd86 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.418297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:49.557384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3e381-cddd-478a-839d-603a8725dd86 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.611994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8458868-b703-413f-b27d-f3a6d1a5f665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.612787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8458868-b703-413f-b27d-f3a6d1a5f665 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.613070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8458868-b703-413f-b27d-f3a6d1a5f665 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.613354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8458868-b703-413f-b27d-f3a6d1a5f665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.625888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8458868-b703-413f-b27d-f3a6d1a5f665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.627843 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8458868-b703-413f-b27d-f3a6d1a5f665 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.646219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a656d0c-5235-424b-afcf-dbe0e175a8a4 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.647028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a656d0c-5235-424b-afcf-dbe0e175a8a4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.647511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a656d0c-5235-424b-afcf-dbe0e175a8a4 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.649404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 234/458] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-e8458868-b703-413f-b27d-f3a6d1a5f665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:49.653746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:49.654619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:49.655461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:49.655461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:49.655461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:49.655461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:49.655792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fe3fd-29cd-4c10-a1fd-cd08a25ee68f None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.655906 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 225/459] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:49.655974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fe3fd-29cd-4c10-a1fd-cd08a25ee68f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.655974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fe3fd-29cd-4c10-a1fd-cd08a25ee68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.660604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8458868-b703-413f-b27d-f3a6d1a5f665 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.691234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-514fe3fd-29cd-4c10-a1fd-cd08a25ee68f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.692451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-514fe3fd-29cd-4c10-a1fd-cd08a25ee68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.737301 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:49.767916 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 235/460] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:49.769686 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d250b-6aaf-4183-85da-75604135d4de None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.770342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d250b-6aaf-4183-85da-75604135d4de None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.770997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d250b-6aaf-4183-85da-75604135d4de None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.773049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 236/461] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:49.778728 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16f276-9295-49b7-b15a-70a774ad2cc4 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.779209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16f276-9295-49b7-b15a-70a774ad2cc4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.779660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16f276-9295-49b7-b15a-70a774ad2cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.793220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8458868-b703-413f-b27d-f3a6d1a5f665 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:49.814042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-5a16f276-9295-49b7-b15a-70a774ad2cc4 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:49.815568 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5a16f276-9295-49b7-b15a-70a774ad2cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:49.830351 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c369567-ab0a-4f4f-a3ec-069aaaf32de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:49.831294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369567-ab0a-4f4f-a3ec-069aaaf32de5 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:49.831578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369567-ab0a-4f4f-a3ec-069aaaf32de5 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:49.831968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c369567-ab0a-4f4f-a3ec-069aaaf32de5 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:49.832853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c369567-ab0a-4f4f-a3ec-069aaaf32de5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:49.833227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c369567-ab0a-4f4f-a3ec-069aaaf32de5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:49.834670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c369567-ab0a-4f4f-a3ec-069aaaf32de5 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:49.860035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 226/462] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:49.861076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c369567-ab0a-4f4f-a3ec-069aaaf32de5 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:49.892291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:49.904775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 237/463] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:49.908599 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16f276-9295-49b7-b15a-70a774ad2cc4 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.012323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c369567-ab0a-4f4f-a3ec-069aaaf32de5 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.030684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:50.055424 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16f276-9295-49b7-b15a-70a774ad2cc4 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.056044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e648450-a85d-4b01-8bc9-d490d3a3c568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.056849 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e648450-a85d-4b01-8bc9-d490d3a3c568 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.057134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e648450-a85d-4b01-8bc9-d490d3a3c568 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.057416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e648450-a85d-4b01-8bc9-d490d3a3c568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.070573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e648450-a85d-4b01-8bc9-d490d3a3c568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.072492 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e648450-a85d-4b01-8bc9-d490d3a3c568 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-7e648450-a85d-4b01-8bc9-d490d3a3c568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:50.092429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:50.093302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:50.094143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:50.094143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:50.094143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:50.094143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:50.096338 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 227/464] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:50.097319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e648450-a85d-4b01-8bc9-d490d3a3c568 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.102995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ed7e4-6f7b-4f56-8b9d-e6d5890fd66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.104121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ed7e4-6f7b-4f56-8b9d-e6d5890fd66f None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.105242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ed7e4-6f7b-4f56-8b9d-e6d5890fd66f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.105731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823ed7e4-6f7b-4f56-8b9d-e6d5890fd66f None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.106635 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ed7e4-6f7b-4f56-8b9d-e6d5890fd66f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.108319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823ed7e4-6f7b-4f56-8b9d-e6d5890fd66f None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.206379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e648450-a85d-4b01-8bc9-d490d3a3c568 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.229431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 238/465] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:49:49 2022] POST /identity/v3/users => generated 246 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:50.230990 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ed7e4-6f7b-4f56-8b9d-e6d5890fd66f None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.258164 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292bedbd-0c90-40fa-a15d-7c1e5af793ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.258987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bedbd-0c90-40fa-a15d-7c1e5af793ec None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.259323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bedbd-0c90-40fa-a15d-7c1e5af793ec None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.259611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292bedbd-0c90-40fa-a15d-7c1e5af793ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.275913 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bedbd-0c90-40fa-a15d-7c1e5af793ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.278828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292bedbd-0c90-40fa-a15d-7c1e5af793ec None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-292bedbd-0c90-40fa-a15d-7c1e5af793ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:50.305116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:50.306055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:50.307753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:50.307753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:50.307753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:50.307753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:50.311995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 228/466] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:50.313828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333b9ac-44bc-4dc4-9cf0-9157f62c0175 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.314400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333b9ac-44bc-4dc4-9cf0-9157f62c0175 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.314900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333b9ac-44bc-4dc4-9cf0-9157f62c0175 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.316899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 229/467] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:50.317033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:50.318472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333b9ac-44bc-4dc4-9cf0-9157f62c0175 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.344946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:50.392493 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823ed7e4-6f7b-4f56-8b9d-e6d5890fd66f None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.437706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396932d4-32a0-44b2-8808-d10ed555782a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.438470 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396932d4-32a0-44b2-8808-d10ed555782a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.438760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396932d4-32a0-44b2-8808-d10ed555782a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.439042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396932d4-32a0-44b2-8808-d10ed555782a None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.439772 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396932d4-32a0-44b2-8808-d10ed555782a None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:50.440412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396932d4-32a0-44b2-8808-d10ed555782a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.442427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396932d4-32a0-44b2-8808-d10ed555782a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.449195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333b9ac-44bc-4dc4-9cf0-9157f62c0175 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.457630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 239/468] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:50.457630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d792de-3049-469f-9ca3-8aa26c30c57f None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.457999 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d792de-3049-469f-9ca3-8aa26c30c57f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.458598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d792de-3049-469f-9ca3-8aa26c30c57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.482097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-44d792de-3049-469f-9ca3-8aa26c30c57f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:50.482097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-44d792de-3049-469f-9ca3-8aa26c30c57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:50.498137 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a0f14-9efe-43e9-9ac0-9978b5e65163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.498823 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a0f14-9efe-43e9-9ac0-9978b5e65163 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.499107 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a0f14-9efe-43e9-9ac0-9978b5e65163 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.499564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a0f14-9efe-43e9-9ac0-9978b5e65163 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.500333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a0f14-9efe-43e9-9ac0-9978b5e65163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:50.501067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a0f14-9efe-43e9-9ac0-9978b5e65163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.502468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a0f14-9efe-43e9-9ac0-9978b5e65163 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.515168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 230/469] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:50.518959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a0f14-9efe-43e9-9ac0-9978b5e65163 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.581611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 240/470] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:50.582494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d792de-3049-469f-9ca3-8aa26c30c57f None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.655116 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:50.664364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:50.696164 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a0f14-9efe-43e9-9ac0-9978b5e65163 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.734462 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd358f6-18f5-449e-b1c5-c799b945b7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.735031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd358f6-18f5-449e-b1c5-c799b945b7f1 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.735313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd358f6-18f5-449e-b1c5-c799b945b7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.735586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd358f6-18f5-449e-b1c5-c799b945b7f1 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.736315 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd358f6-18f5-449e-b1c5-c799b945b7f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.737851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd358f6-18f5-449e-b1c5-c799b945b7f1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.744991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d792de-3049-469f-9ca3-8aa26c30c57f None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.785516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e220bbee-3fbe-433d-ba8d-db6510f7ac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.786240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220bbee-3fbe-433d-ba8d-db6510f7ac05 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.786583 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220bbee-3fbe-433d-ba8d-db6510f7ac05 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.786776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e220bbee-3fbe-433d-ba8d-db6510f7ac05 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.787446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220bbee-3fbe-433d-ba8d-db6510f7ac05 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:50.789008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e220bbee-3fbe-433d-ba8d-db6510f7ac05 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:50.818595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 231/471] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/users => generated 248 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:50.819871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd358f6-18f5-449e-b1c5-c799b945b7f1 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:50.910747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 241/472] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/users => generated 248 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:50.912155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133c8fb-b247-4392-ab95-a6e01d138252 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.912446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133c8fb-b247-4392-ab95-a6e01d138252 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.912722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e133c8fb-b247-4392-ab95-a6e01d138252 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.921255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 242/473] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:50 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:50.927476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216126d-d524-4546-88a4-ec71603eae5b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.927937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216126d-d524-4546-88a4-ec71603eae5b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.932649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216126d-d524-4546-88a4-ec71603eae5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.947877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd358f6-18f5-449e-b1c5-c799b945b7f1 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:50.961202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-6216126d-d524-4546-88a4-ec71603eae5b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:50.962726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-6216126d-d524-4546-88a4-ec71603eae5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:50.992376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927ae87-8c3e-4512-9dd0-ee07bbcdb6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:50.993195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927ae87-8c3e-4512-9dd0-ee07bbcdb6f9 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:50.993483 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927ae87-8c3e-4512-9dd0-ee07bbcdb6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:50.993763 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927ae87-8c3e-4512-9dd0-ee07bbcdb6f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:50.997423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.006841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927ae87-8c3e-4512-9dd0-ee07bbcdb6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.008590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927ae87-8c3e-4512-9dd0-ee07bbcdb6f9 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-e927ae87-8c3e-4512-9dd0-ee07bbcdb6f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:51.029039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:51.029962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:51.030830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:51.030830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:51.030830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:51.030830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:51.032007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 232/474] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:51.037330 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927ae87-8c3e-4512-9dd0-ee07bbcdb6f9 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.106144 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 243/475] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:51.132318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216126d-d524-4546-88a4-ec71603eae5b None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.171521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.174380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927ae87-8c3e-4512-9dd0-ee07bbcdb6f9 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.217458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9914ac8-a7c5-498d-8cf0-193fb4b77f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.218129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9914ac8-a7c5-498d-8cf0-193fb4b77f99 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.218413 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9914ac8-a7c5-498d-8cf0-193fb4b77f99 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.218692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9914ac8-a7c5-498d-8cf0-193fb4b77f99 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.219428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9914ac8-a7c5-498d-8cf0-193fb4b77f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:51.219744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9914ac8-a7c5-498d-8cf0-193fb4b77f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.221181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9914ac8-a7c5-498d-8cf0-193fb4b77f99 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.239722 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 233/476] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:51.249008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9914ac8-a7c5-498d-8cf0-193fb4b77f99 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.280853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6216126d-d524-4546-88a4-ec71603eae5b None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.326476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b8051-9d7b-4c1e-9c9e-bc768dae76e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.327127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.329166 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b8051-9d7b-4c1e-9c9e-bc768dae76e9 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.329647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b8051-9d7b-4c1e-9c9e-bc768dae76e9 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.330106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6b8051-9d7b-4c1e-9c9e-bc768dae76e9 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.331079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b8051-9d7b-4c1e-9c9e-bc768dae76e9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.332695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6b8051-9d7b-4c1e-9c9e-bc768dae76e9 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.362089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9914ac8-a7c5-498d-8cf0-193fb4b77f99 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.400850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.sql.core [None req-9c6b8051-9d7b-4c1e-9c9e-bc768dae76e9 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 10:49:51.400850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 10:49:51.400850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [parameters: {'id': 'fc7ae90bc52442428abfa95e29eeeec8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 10:49:51.400850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=75629) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 10:49:51.401246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4a417-c50b-4534-8c68-577fad4b938b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.402114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4a417-c50b-4534-8c68-577fad4b938b None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.402400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4a417-c50b-4534-8c68-577fad4b938b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.402726 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff4a417-c50b-4534-8c68-577fad4b938b None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.403441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4a417-c50b-4534-8c68-577fad4b938b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.405026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff4a417-c50b-4534-8c68-577fad4b938b None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-9c6b8051-9d7b-4c1e-9c9e-bc768dae76e9 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result.read() Jun 23 10:49:51.429749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return ref.to_dict() Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:49:51.430643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application yield resource Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise self.value Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application session.commit() Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 10:49:51.431546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.session.flush() Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application compat.raise_( Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 10:49:51.432431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:49:51.433333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result.read() Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:49:51.434156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [parameters: {'id': 'fc7ae90bc52442428abfa95e29eeeec8', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:51.436914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 23 10:49:51.438831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:51.442488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 244/477] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Jun 23 10:49:51 2022] POST /identity/v3/roles => generated 144 bytes in 309 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:51.442488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b8051-9d7b-4c1e-9c9e-bc768dae76e9 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.521253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 234/478] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:49:51 2022] POST /identity/v3/users => generated 249 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:51.598760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.611260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6b8051-9d7b-4c1e-9c9e-bc768dae76e9 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.665455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b670f0-bae1-495f-a0d1-da65c1551935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.666285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b670f0-bae1-495f-a0d1-da65c1551935 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.666572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b670f0-bae1-495f-a0d1-da65c1551935 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.666848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b670f0-bae1-495f-a0d1-da65c1551935 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.681734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b670f0-bae1-495f-a0d1-da65c1551935 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-e3b670f0-bae1-495f-a0d1-da65c1551935 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:51.689981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:51.690919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:51.691743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:51.691743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:51.691743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:51.691743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:51.691743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:51.691743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:51.691743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:51.691743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:51.691743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:51.691743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:51.691743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 23 10:49:51.691743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:51.697006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4a417-c50b-4534-8c68-577fad4b938b None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:51.699885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 245/479] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:49:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:51.805419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff4a417-c50b-4534-8c68-577fad4b938b None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:51.808604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:51.846643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa383f0f-0252-4283-a087-7744626c61a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:51.847319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa383f0f-0252-4283-a087-7744626c61a4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:51.847603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa383f0f-0252-4283-a087-7744626c61a4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:51.847948 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa383f0f-0252-4283-a087-7744626c61a4 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:51.848706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa383f0f-0252-4283-a087-7744626c61a4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:51.849014 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa383f0f-0252-4283-a087-7744626c61a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:51.868567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa383f0f-0252-4283-a087-7744626c61a4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:51.868567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 235/480] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:52.622280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585d047-ece0-4f2b-a8cf-dd7b721be929 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.622807 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585d047-ece0-4f2b-a8cf-dd7b721be929 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.622807 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585d047-ece0-4f2b-a8cf-dd7b721be929 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.624516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 246/481] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:52.629811 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2f3a-607c-4051-b711-f4c1b30d49ab None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.630213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2f3a-607c-4051-b711-f4c1b30d49ab None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.630376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7c2f3a-607c-4051-b711-f4c1b30d49ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.647319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3e7c2f3a-607c-4051-b711-f4c1b30d49ab None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:52.648549 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3e7c2f3a-607c-4051-b711-f4c1b30d49ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:52.744385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 236/482] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:52.781433 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585d047-ece0-4f2b-a8cf-dd7b721be929 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:52.913669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585d047-ece0-4f2b-a8cf-dd7b721be929 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:52.958284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a5746-173a-4daf-b72b-5dd12d8842eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:52.959454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a5746-173a-4daf-b72b-5dd12d8842eb None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:52.959968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a5746-173a-4daf-b72b-5dd12d8842eb None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:52.960628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7a5746-173a-4daf-b72b-5dd12d8842eb None admin] PATH_INFO: `/v3/roles/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:52.977326 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7a5746-173a-4daf-b72b-5dd12d8842eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-5a7a5746-173a-4daf-b72b-5dd12d8842eb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:52.985732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:52.986621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:52.987397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:52.987397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:52.987397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:52.987397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:52.987397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:52.987397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:52.987397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:52.987397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:52.987397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:52.987397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:52.987397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:49:52.987397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:52.990125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 247/483] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:49:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:52.995709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c2f3a-607c-4051-b711-f4c1b30d49ab None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:53.125768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:53.131650 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7c2f3a-607c-4051-b711-f4c1b30d49ab None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:53.185175 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8faa64-5a0f-4cc1-9f56-a750575566bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:53.185818 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8faa64-5a0f-4cc1-9f56-a750575566bc None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:53.186110 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8faa64-5a0f-4cc1-9f56-a750575566bc None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:53.186387 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8faa64-5a0f-4cc1-9f56-a750575566bc None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:53.187184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8faa64-5a0f-4cc1-9f56-a750575566bc None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:53.187494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8faa64-5a0f-4cc1-9f56-a750575566bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:53.188937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8faa64-5a0f-4cc1-9f56-a750575566bc None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:53.199782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 237/484] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:49:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:53.205438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a5746-173a-4daf-b72b-5dd12d8842eb None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:53.231261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:53.333642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715200e3-6c91-43bc-8287-66e4211a1beb None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:53.333965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715200e3-6c91-43bc-8287-66e4211a1beb None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:53.334207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715200e3-6c91-43bc-8287-66e4211a1beb None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:53.336878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 238/485] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:49:53.341561 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca463789-6aff-4c49-a44d-e4d7d62ed2eb None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:53.341848 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca463789-6aff-4c49-a44d-e4d7d62ed2eb None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:53.342124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca463789-6aff-4c49-a44d-e4d7d62ed2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:53.360271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-ca463789-6aff-4c49-a44d-e4d7d62ed2eb None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:53.361470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ca463789-6aff-4c49-a44d-e4d7d62ed2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:53.366626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7a5746-173a-4daf-b72b-5dd12d8842eb None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:53.435964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9c09d-a9aa-49dc-a443-66d53b6ae80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:53.436522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9c09d-a9aa-49dc-a443-66d53b6ae80e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:53.436900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9c09d-a9aa-49dc-a443-66d53b6ae80e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:53.437182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d9c09d-a9aa-49dc-a443-66d53b6ae80e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:53.457718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9c09d-a9aa-49dc-a443-66d53b6ae80e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:53.459492 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d9c09d-a9aa-49dc-a443-66d53b6ae80e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-f9d9c09d-a9aa-49dc-a443-66d53b6ae80e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:53.492355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:53.493257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:53.494103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:53.494103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:53.494103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:53.494103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:53.494103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 248/486] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:53.503827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 239/487] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:53.503993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9c09d-a9aa-49dc-a443-66d53b6ae80e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:53.549312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca463789-6aff-4c49-a44d-e4d7d62ed2eb None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:53.579774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:53.621714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d9c09d-a9aa-49dc-a443-66d53b6ae80e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:53.657688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b689af0-f0ba-401a-804f-2e6d820271b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:53.658336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b689af0-f0ba-401a-804f-2e6d820271b8 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:53.658667 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b689af0-f0ba-401a-804f-2e6d820271b8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:53.658890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b689af0-f0ba-401a-804f-2e6d820271b8 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:53.659800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b689af0-f0ba-401a-804f-2e6d820271b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:53.659941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b689af0-f0ba-401a-804f-2e6d820271b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:53.661318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b689af0-f0ba-401a-804f-2e6d820271b8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:53.674021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 249/488] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:53.682539 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b689af0-f0ba-401a-804f-2e6d820271b8 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:53.726350 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:53.744845 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca463789-6aff-4c49-a44d-e4d7d62ed2eb None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:53.783969 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3014d2f-3ea3-4ef3-b373-8b192b88624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:53.784764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3014d2f-3ea3-4ef3-b373-8b192b88624b None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:53.785052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3014d2f-3ea3-4ef3-b373-8b192b88624b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:53.785326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3014d2f-3ea3-4ef3-b373-8b192b88624b None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:53.797748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3014d2f-3ea3-4ef3-b373-8b192b88624b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-c3014d2f-3ea3-4ef3-b373-8b192b88624b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:53.805972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:53.806874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:53.807692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 240/489] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:49:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:53.808921 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26958cb-5529-41da-8670-838a346c4bff None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:53.809209 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26958cb-5529-41da-8670-838a346c4bff None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:53.809500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26958cb-5529-41da-8670-838a346c4bff None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:53.811066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 241/490] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:53.812689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26958cb-5529-41da-8670-838a346c4bff None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:53.850297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b689af0-f0ba-401a-804f-2e6d820271b8 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:53.881993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:53.898062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c042ea-afd3-48a6-a5b2-63f1822434ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:53.899450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c042ea-afd3-48a6-a5b2-63f1822434ae None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:53.900421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c042ea-afd3-48a6-a5b2-63f1822434ae None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:53.900850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c042ea-afd3-48a6-a5b2-63f1822434ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:53.910575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c042ea-afd3-48a6-a5b2-63f1822434ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:53.912962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c042ea-afd3-48a6-a5b2-63f1822434ae None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-21c042ea-afd3-48a6-a5b2-63f1822434ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:49:53.935544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:53.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:53.937668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:53.937668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:53.937668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:49:53.937668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:49:53.937668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:49:53.937668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:49:53.937668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:49:53.937668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:49:53.937668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:49:53.937668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:53.938255 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26958cb-5529-41da-8670-838a346c4bff None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:53.945160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 250/491] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Jun 23 10:49:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:49:53.945160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407529d-1676-4029-aaae-3c032d30f2fc None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:53.945393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407529d-1676-4029-aaae-3c032d30f2fc None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:53.945604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407529d-1676-4029-aaae-3c032d30f2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:53.968885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0407529d-1676-4029-aaae-3c032d30f2fc None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:53.970988 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0407529d-1676-4029-aaae-3c032d30f2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:53.978070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a33be-4f64-4d10-8cc2-e3cec6bc5f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:53.979074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a33be-4f64-4d10-8cc2-e3cec6bc5f4e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:53.980232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a33be-4f64-4d10-8cc2-e3cec6bc5f4e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:53.980782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a33be-4f64-4d10-8cc2-e3cec6bc5f4e None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:53.982411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a33be-4f64-4d10-8cc2-e3cec6bc5f4e None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:53.982934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a33be-4f64-4d10-8cc2-e3cec6bc5f4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:53.985506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22a33be-4f64-4d10-8cc2-e3cec6bc5f4e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:53.997781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 242/492] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:49:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:53.999165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a33be-4f64-4d10-8cc2-e3cec6bc5f4e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:54.015294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:54.057201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 251/493] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:54.058710 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407529d-1676-4029-aaae-3c032d30f2fc None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:54.132417 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a33be-4f64-4d10-8cc2-e3cec6bc5f4e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:54.180517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d9a6e-7a1e-4f73-92f8-d22cdafcb32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:54.182452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d9a6e-7a1e-4f73-92f8-d22cdafcb32f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.183468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d9a6e-7a1e-4f73-92f8-d22cdafcb32f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.184001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d9a6e-7a1e-4f73-92f8-d22cdafcb32f None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.184426 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407529d-1676-4029-aaae-3c032d30f2fc None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:54.185357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d9a6e-7a1e-4f73-92f8-d22cdafcb32f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:54.186139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d9a6e-7a1e-4f73-92f8-d22cdafcb32f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:54.188842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d9a6e-7a1e-4f73-92f8-d22cdafcb32f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:54.200461 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:54.235191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 243/494] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Jun 23 10:49:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:54.235191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d9a6e-7a1e-4f73-92f8-d22cdafcb32f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:54.237515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6488e-2cb9-43f2-93be-91187a74a6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:54.238561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6488e-2cb9-43f2-93be-91187a74a6ce None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.240124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6488e-2cb9-43f2-93be-91187a74a6ce None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.240609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef6488e-2cb9-43f2-93be-91187a74a6ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.256883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6488e-2cb9-43f2-93be-91187a74a6ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:54.259544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef6488e-2cb9-43f2-93be-91187a74a6ce None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-8ef6488e-2cb9-43f2-93be-91187a74a6ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:54.288747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:54.289651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:54.290471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:54.290471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:54.290471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:54.290471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:54.293169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 252/495] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:54.294167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6488e-2cb9-43f2-93be-91187a74a6ce None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:54.310593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:54.357213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d9a6e-7a1e-4f73-92f8-d22cdafcb32f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:54.394517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a215fb-3d37-4e3c-9740-2c226227c9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:54.395312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a215fb-3d37-4e3c-9740-2c226227c9f0 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.395600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a215fb-3d37-4e3c-9740-2c226227c9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.395908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a215fb-3d37-4e3c-9740-2c226227c9f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.406627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a215fb-3d37-4e3c-9740-2c226227c9f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:54.407922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef6488e-2cb9-43f2-93be-91187a74a6ce None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-34a215fb-3d37-4e3c-9740-2c226227c9f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:54.414971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:54.415905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 244/496] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:49:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:54.417038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a215fb-3d37-4e3c-9740-2c226227c9f0 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:54.447346 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1489607-3a60-43b5-addc-49b946fb7f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:54.448025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1489607-3a60-43b5-addc-49b946fb7f31 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.448818 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1489607-3a60-43b5-addc-49b946fb7f31 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.449095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1489607-3a60-43b5-addc-49b946fb7f31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.483203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:54.517539 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1489607-3a60-43b5-addc-49b946fb7f31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:54.518936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1489607-3a60-43b5-addc-49b946fb7f31 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:54.520580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a215fb-3d37-4e3c-9740-2c226227c9f0 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:54.548460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:54.556436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e60bb31-861b-4aae-89cf-1a8689415cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:54.557186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60bb31-861b-4aae-89cf-1a8689415cf1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.557445 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60bb31-861b-4aae-89cf-1a8689415cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.557765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e60bb31-861b-4aae-89cf-1a8689415cf1 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.558492 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60bb31-861b-4aae-89cf-1a8689415cf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:54.558801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60bb31-861b-4aae-89cf-1a8689415cf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:54.560231 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e60bb31-861b-4aae-89cf-1a8689415cf1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:54.575163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 245/497] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:54.575163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2f9b2-2533-4f62-9f80-ced083c6357b None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.575163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2f9b2-2533-4f62-9f80-ced083c6357b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.575163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f2f9b2-2533-4f62-9f80-ced083c6357b None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.583286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 246/498] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:54.583286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d876dc-ac2e-4cfe-b8b7-b59f28509561 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.583286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d876dc-ac2e-4cfe-b8b7-b59f28509561 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.583286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d876dc-ac2e-4cfe-b8b7-b59f28509561 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.583286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 247/499] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:54.583286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d876dc-ac2e-4cfe-b8b7-b59f28509561 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:54.625075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 253/500] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:54.625917 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1489607-3a60-43b5-addc-49b946fb7f31 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:54.685291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d876dc-ac2e-4cfe-b8b7-b59f28509561 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:54.691211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:54.727753 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1489607-3a60-43b5-addc-49b946fb7f31 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:54.729639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64332ab5-e217-4b68-b6da-e9352b399f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:54.730310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64332ab5-e217-4b68-b6da-e9352b399f7d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.730595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64332ab5-e217-4b68-b6da-e9352b399f7d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.730874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64332ab5-e217-4b68-b6da-e9352b399f7d None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.731618 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64332ab5-e217-4b68-b6da-e9352b399f7d None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:54.731957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64332ab5-e217-4b68-b6da-e9352b399f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:54.733340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64332ab5-e217-4b68-b6da-e9352b399f7d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:54.741909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 248/501] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:49:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:54.743126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f087beb-3953-451b-a322-dcaad0430e8b None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.743416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f087beb-3953-451b-a322-dcaad0430e8b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.743694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f087beb-3953-451b-a322-dcaad0430e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.760314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-6f087beb-3953-451b-a322-dcaad0430e8b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:54.762027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6f087beb-3953-451b-a322-dcaad0430e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:54.762354 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24ac1c0-ca99-4138-8acc-9d150ce60830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:54.763145 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac1c0-ca99-4138-8acc-9d150ce60830 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.763425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac1c0-ca99-4138-8acc-9d150ce60830 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.763697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24ac1c0-ca99-4138-8acc-9d150ce60830 None admin] PATH_INFO: `/v3/users/glance` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.770891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ac1c0-ca99-4138-8acc-9d150ce60830 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:54.772300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24ac1c0-ca99-4138-8acc-9d150ce60830 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-c24ac1c0-ca99-4138-8acc-9d150ce60830 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:49:54.787241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:54.788235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:54.789124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:54.789124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:54.789124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:49:54.789124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:49:54.789124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:49:54.789124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:49:54.789124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:49:54.789124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:49:54.789124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:49:54.789124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:54.789124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 254/502] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:54.789939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cef575-800a-4495-8376-6f13ba858575 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.789939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cef575-800a-4495-8376-6f13ba858575 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.790152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cef575-800a-4495-8376-6f13ba858575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.806081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b0cef575-800a-4495-8376-6f13ba858575 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:54.807271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b0cef575-800a-4495-8376-6f13ba858575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:54.813278 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:54.834032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 249/503] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:54.834862 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f087beb-3953-451b-a322-dcaad0430e8b None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:54.877335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 255/504] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:54.878308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cef575-800a-4495-8376-6f13ba858575 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:54.936644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f087beb-3953-451b-a322-dcaad0430e8b None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:54.951253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:54.971506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b440fd8-ec57-4b6b-8174-645c475a5fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:54.972335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b440fd8-ec57-4b6b-8174-645c475a5fae None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:54.972615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b440fd8-ec57-4b6b-8174-645c475a5fae None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:54.972894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b440fd8-ec57-4b6b-8174-645c475a5fae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:54.983631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b440fd8-ec57-4b6b-8174-645c475a5fae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:54.985126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b440fd8-ec57-4b6b-8174-645c475a5fae None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:54.994596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cef575-800a-4495-8376-6f13ba858575 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-9b440fd8-ec57-4b6b-8174-645c475a5fae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:55.003564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:55.004711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:55.005559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:55.005559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:55.005559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:55.005559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:55.005559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 250/505] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:55.006716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b440fd8-ec57-4b6b-8174-645c475a5fae None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:55.035698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b0010-3bd8-465a-a542-331787066e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:55.036442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b0010-3bd8-465a-a542-331787066e08 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.036725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b0010-3bd8-465a-a542-331787066e08 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.037006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2b0010-3bd8-465a-a542-331787066e08 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.040184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:55.047614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b0010-3bd8-465a-a542-331787066e08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:55.049186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2b0010-3bd8-465a-a542-331787066e08 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-7a2b0010-3bd8-465a-a542-331787066e08 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:55.067928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:55.068935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:55.070062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:55.070062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:55.070062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:55.070062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:55.070062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 256/506] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:55.070477 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b0010-3bd8-465a-a542-331787066e08 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:55.113446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b440fd8-ec57-4b6b-8174-645c475a5fae None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.147231 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064754c-ca15-4963-9262-9cfca85ca263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:55.147931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064754c-ca15-4963-9262-9cfca85ca263 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.148214 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064754c-ca15-4963-9262-9cfca85ca263 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.148489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c064754c-ca15-4963-9262-9cfca85ca263 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.149318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064754c-ca15-4963-9262-9cfca85ca263 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:55.149627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064754c-ca15-4963-9262-9cfca85ca263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:55.151071 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c064754c-ca15-4963-9262-9cfca85ca263 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:55.169329 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 251/507] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Jun 23 10:49:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:55.170163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064754c-ca15-4963-9262-9cfca85ca263 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:55.176094 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2b0010-3bd8-465a-a542-331787066e08 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.186211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:55.211001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336aad0-dce4-43f5-8da0-781a0859fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:55.211789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336aad0-dce4-43f5-8da0-781a0859fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.212103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336aad0-dce4-43f5-8da0-781a0859fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.212379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336aad0-dce4-43f5-8da0-781a0859fbe2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.223969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336aad0-dce4-43f5-8da0-781a0859fbe2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-2336aad0-dce4-43f5-8da0-781a0859fbe2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:55.231958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:55.233008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:55.233954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 257/508] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:49:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:55.234766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336aad0-dce4-43f5-8da0-781a0859fbe2 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:55.265800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:55.275495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c064754c-ca15-4963-9262-9cfca85ca263 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.310514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2707bb-9de6-49f1-ac74-bd376819432d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:55.311361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2707bb-9de6-49f1-ac74-bd376819432d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.311739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2707bb-9de6-49f1-ac74-bd376819432d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.312148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2707bb-9de6-49f1-ac74-bd376819432d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.322276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2707bb-9de6-49f1-ac74-bd376819432d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:55.324383 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2707bb-9de6-49f1-ac74-bd376819432d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:55.332423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336aad0-dce4-43f5-8da0-781a0859fbe2 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-2d2707bb-9de6-49f1-ac74-bd376819432d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:55.341624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:55.342610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:55.343500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:55.343500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:55.343500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:55.343500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:55.343500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 252/509] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:55.344127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2707bb-9de6-49f1-ac74-bd376819432d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:55.371901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8cdf8-c1b8-4d86-bc58-72642540defb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:55.372569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8cdf8-c1b8-4d86-bc58-72642540defb None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.372853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8cdf8-c1b8-4d86-bc58-72642540defb None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.373133 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e8cdf8-c1b8-4d86-bc58-72642540defb None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.373856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8cdf8-c1b8-4d86-bc58-72642540defb None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:55.374168 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8cdf8-c1b8-4d86-bc58-72642540defb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:55.375545 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e8cdf8-c1b8-4d86-bc58-72642540defb None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:55.387188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 258/510] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:55.388015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8cdf8-c1b8-4d86-bc58-72642540defb None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:55.415002 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:55.448271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2707bb-9de6-49f1-ac74-bd376819432d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.483870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a510db-690e-4cd6-8e99-f38ef25e04e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:55.484529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a510db-690e-4cd6-8e99-f38ef25e04e6 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.484807 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a510db-690e-4cd6-8e99-f38ef25e04e6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.485078 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a510db-690e-4cd6-8e99-f38ef25e04e6 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.485793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a510db-690e-4cd6-8e99-f38ef25e04e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:55.486093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a510db-690e-4cd6-8e99-f38ef25e04e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:55.487465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a510db-690e-4cd6-8e99-f38ef25e04e6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:55.489283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e8cdf8-c1b8-4d86-bc58-72642540defb None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.499448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 253/511] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:55.500279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a510db-690e-4cd6-8e99-f38ef25e04e6 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:55.502816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:55.524342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da874f-1427-47e3-aa89-bb0d355d7051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:55.524991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da874f-1427-47e3-aa89-bb0d355d7051 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.525272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da874f-1427-47e3-aa89-bb0d355d7051 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.525570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da874f-1427-47e3-aa89-bb0d355d7051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.627751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da874f-1427-47e3-aa89-bb0d355d7051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:55.629240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89da874f-1427-47e3-aa89-bb0d355d7051 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:55.656808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:55.658966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a510db-690e-4cd6-8e99-f38ef25e04e6 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.692290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac57ad7-9a6c-4236-b712-170b0ff1c250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:55.692958 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac57ad7-9a6c-4236-b712-170b0ff1c250 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.693247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac57ad7-9a6c-4236-b712-170b0ff1c250 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.693571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac57ad7-9a6c-4236-b712-170b0ff1c250 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.694376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac57ad7-9a6c-4236-b712-170b0ff1c250 None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:55.694686 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac57ad7-9a6c-4236-b712-170b0ff1c250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:55.696096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac57ad7-9a6c-4236-b712-170b0ff1c250 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:55.704147 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 254/512] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:49:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:55.704938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac57ad7-9a6c-4236-b712-170b0ff1c250 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:55.730608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 259/513] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:55.731456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da874f-1427-47e3-aa89-bb0d355d7051 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:55.767427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:55.804390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac57ad7-9a6c-4236-b712-170b0ff1c250 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.830570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da874f-1427-47e3-aa89-bb0d355d7051 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.838084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724025c-eb41-4274-afef-26965d1339bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:55.838741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724025c-eb41-4274-afef-26965d1339bc None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.839016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724025c-eb41-4274-afef-26965d1339bc None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.839289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a724025c-eb41-4274-afef-26965d1339bc None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.840032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724025c-eb41-4274-afef-26965d1339bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:55.840334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724025c-eb41-4274-afef-26965d1339bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:55.841705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a724025c-eb41-4274-afef-26965d1339bc None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:55.853279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 255/514] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:55.854073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724025c-eb41-4274-afef-26965d1339bc None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:55.857163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:55.864950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb9ad6-fb67-47a5-8028-94f5223da149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:55.865734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb9ad6-fb67-47a5-8028-94f5223da149 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.871026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb9ad6-fb67-47a5-8028-94f5223da149 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.871026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb9ad6-fb67-47a5-8028-94f5223da149 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.873533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb9ad6-fb67-47a5-8028-94f5223da149 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:55.875006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fb9ad6-fb67-47a5-8028-94f5223da149 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-09fb9ad6-fb67-47a5-8028-94f5223da149 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:49:55.890267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:55.891111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:55.891976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:49:55.891976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:49:55.891976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:49:55.891976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:49:55.891976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:49:55.891976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:49:55.891976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:49:55.891976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:55.891976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 260/515] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:55.892432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb9ad6-fb67-47a5-8028-94f5223da149 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:55.954567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a724025c-eb41-4274-afef-26965d1339bc None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.978630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:55.989025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3677d0-d336-40a4-a8e0-2cce17c78cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:55.989834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3677d0-d336-40a4-a8e0-2cce17c78cf5 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:55.990161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3677d0-d336-40a4-a8e0-2cce17c78cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:55.990496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3677d0-d336-40a4-a8e0-2cce17c78cf5 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:55.997733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3677d0-d336-40a4-a8e0-2cce17c78cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:55.998545 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb9ad6-fb67-47a5-8028-94f5223da149 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:55.999214 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3677d0-d336-40a4-a8e0-2cce17c78cf5 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-1e3677d0-d336-40a4-a8e0-2cce17c78cf5 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:49:56.016564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:56.017489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:56.018364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:56.018364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:56.018364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:49:56.018364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:49:56.018364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:49:56.018364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:49:56.018364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:49:56.018364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:49:56.018364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:49:56.018364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:56.018364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 256/516] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:49:55 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:56.018915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3677d0-d336-40a4-a8e0-2cce17c78cf5 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.033810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063ccef-20b4-44c1-b924-1b717fbadc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.034657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ccef-20b4-44c1-b924-1b717fbadc32 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.034935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ccef-20b4-44c1-b924-1b717fbadc32 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.035203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063ccef-20b4-44c1-b924-1b717fbadc32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.045811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063ccef-20b4-44c1-b924-1b717fbadc32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.047264 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063ccef-20b4-44c1-b924-1b717fbadc32 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-a063ccef-20b4-44c1-b924-1b717fbadc32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:56.064274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:56.065184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:56.066017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:56.066017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:56.066017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:56.066017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:56.066017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 261/517] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:56.066298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063ccef-20b4-44c1-b924-1b717fbadc32 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.109891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:56.123645 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3677d0-d336-40a4-a8e0-2cce17c78cf5 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.158361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae601c1c-958a-401f-a756-9574054f9ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.159134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae601c1c-958a-401f-a756-9574054f9ed9 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.159414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae601c1c-958a-401f-a756-9574054f9ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.159691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae601c1c-958a-401f-a756-9574054f9ed9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.167687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063ccef-20b4-44c1-b924-1b717fbadc32 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.169832 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae601c1c-958a-401f-a756-9574054f9ed9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.171301 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae601c1c-958a-401f-a756-9574054f9ed9 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-ae601c1c-958a-401f-a756-9574054f9ed9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:56.188576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:56.189454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:56.191080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:56.191080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:56.191080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:56.191080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:56.191080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 257/518] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:56.191080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae601c1c-958a-401f-a756-9574054f9ed9 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.203938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafdcc9-39fe-4714-9368-8c3248d8f132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.204615 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafdcc9-39fe-4714-9368-8c3248d8f132 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.204903 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafdcc9-39fe-4714-9368-8c3248d8f132 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.205182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cafdcc9-39fe-4714-9368-8c3248d8f132 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.205887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafdcc9-39fe-4714-9368-8c3248d8f132 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.207326 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cafdcc9-39fe-4714-9368-8c3248d8f132 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.226529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:56.290660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae601c1c-958a-401f-a756-9574054f9ed9 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.315117 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 262/519] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:49:56 2022] POST /identity/v3/users => generated 247 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:49:56.316021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafdcc9-39fe-4714-9368-8c3248d8f132 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.325470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88944ea2-1f17-40d9-b6e9-a9f3ceb4d840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.326197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88944ea2-1f17-40d9-b6e9-a9f3ceb4d840 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.326509 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88944ea2-1f17-40d9-b6e9-a9f3ceb4d840 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.326818 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88944ea2-1f17-40d9-b6e9-a9f3ceb4d840 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.327708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88944ea2-1f17-40d9-b6e9-a9f3ceb4d840 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:56.328067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88944ea2-1f17-40d9-b6e9-a9f3ceb4d840 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.329571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88944ea2-1f17-40d9-b6e9-a9f3ceb4d840 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.354458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 258/520] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:49:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:56.354458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88944ea2-1f17-40d9-b6e9-a9f3ceb4d840 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.435668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:56.442597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cafdcc9-39fe-4714-9368-8c3248d8f132 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.470748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:56.477188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88944ea2-1f17-40d9-b6e9-a9f3ceb4d840 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.483685 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2cdb4-d958-4f34-8966-67074307181c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.485033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2cdb4-d958-4f34-8966-67074307181c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.485033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2cdb4-d958-4f34-8966-67074307181c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.485033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f2cdb4-d958-4f34-8966-67074307181c None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.485822 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2cdb4-d958-4f34-8966-67074307181c None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:56.486783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2cdb4-d958-4f34-8966-67074307181c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.487514 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f2cdb4-d958-4f34-8966-67074307181c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.520286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1156d82-9493-4676-bfef-39aee58d553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.521211 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1156d82-9493-4676-bfef-39aee58d553d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.521618 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1156d82-9493-4676-bfef-39aee58d553d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.522002 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1156d82-9493-4676-bfef-39aee58d553d None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.522840 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1156d82-9493-4676-bfef-39aee58d553d None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:56.523254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1156d82-9493-4676-bfef-39aee58d553d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.525427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1156d82-9493-4676-bfef-39aee58d553d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.529581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 263/521] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Jun 23 10:49:56 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:56.530584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2cdb4-d958-4f34-8966-67074307181c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.538952 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 259/522] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:56.540043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1156d82-9493-4676-bfef-39aee58d553d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.646413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f2cdb4-d958-4f34-8966-67074307181c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.666324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1156d82-9493-4676-bfef-39aee58d553d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.686927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141030b9-331a-43a3-90b7-1a6e84c9fcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.687523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141030b9-331a-43a3-90b7-1a6e84c9fcba None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.687827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141030b9-331a-43a3-90b7-1a6e84c9fcba None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.688136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141030b9-331a-43a3-90b7-1a6e84c9fcba None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.689601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141030b9-331a-43a3-90b7-1a6e84c9fcba None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:56.689916 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141030b9-331a-43a3-90b7-1a6e84c9fcba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.691513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141030b9-331a-43a3-90b7-1a6e84c9fcba None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.703798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 264/523] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:56.704197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffdc5a-4783-487d-b56b-a7e247707041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.705586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffdc5a-4783-487d-b56b-a7e247707041 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.705586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffdc5a-4783-487d-b56b-a7e247707041 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.705586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffdc5a-4783-487d-b56b-a7e247707041 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.706623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffdc5a-4783-487d-b56b-a7e247707041 None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=a020e7fe06574a108b46f9f48bddc4e4) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:56.707033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffdc5a-4783-487d-b56b-a7e247707041 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.708930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffdc5a-4783-487d-b56b-a7e247707041 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.709085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141030b9-331a-43a3-90b7-1a6e84c9fcba None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.723870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 260/524] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:56 2022] GET /identity/v3/role_assignments?user.id=a020e7fe06574a108b46f9f48bddc4e4&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:56.723870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffdc5a-4783-487d-b56b-a7e247707041 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.732028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:56.774912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:56.834990 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141030b9-331a-43a3-90b7-1a6e84c9fcba None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.874254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351b314-56da-4b25-8ce1-52ed6d9dfcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.874920 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351b314-56da-4b25-8ce1-52ed6d9dfcc6 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.875201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351b314-56da-4b25-8ce1-52ed6d9dfcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.875478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351b314-56da-4b25-8ce1-52ed6d9dfcc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.881471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffdc5a-4783-487d-b56b-a7e247707041 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:56.931291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc1b87-402a-4d0a-8373-539bb8f01f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:56.932141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc1b87-402a-4d0a-8373-539bb8f01f62 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:56.932431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc1b87-402a-4d0a-8373-539bb8f01f62 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:56.932785 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fc1b87-402a-4d0a-8373-539bb8f01f62 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:56.942751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc1b87-402a-4d0a-8373-539bb8f01f62 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.944744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fc1b87-402a-4d0a-8373-539bb8f01f62 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.959462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351b314-56da-4b25-8ce1-52ed6d9dfcc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:56.961277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351b314-56da-4b25-8ce1-52ed6d9dfcc6 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-59fc1b87-402a-4d0a-8373-539bb8f01f62 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:49:56.965105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:56.966039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:56.966968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:56.966968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:56.966968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:49:56.966968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:49:56.966968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:49:56.966968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:49:56.966968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:49:56.966968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:49:56.966968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:49:56.966968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:56.966968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 261/525] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:49:56 2022] GET /identity/v3/users/neutron => generated 85 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:56.967649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc1b87-402a-4d0a-8373-539bb8f01f62 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:56.984979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.077381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.091967 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 265/526] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:57.093156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351b314-56da-4b25-8ce1-52ed6d9dfcc6 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:57.102340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fc1b87-402a-4d0a-8373-539bb8f01f62 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.148708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e50b6e-0123-4643-874b-ca3696a46410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.149500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50b6e-0123-4643-874b-ca3696a46410 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.149780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50b6e-0123-4643-874b-ca3696a46410 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.150053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e50b6e-0123-4643-874b-ca3696a46410 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.159578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e50b6e-0123-4643-874b-ca3696a46410 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.161737 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e50b6e-0123-4643-874b-ca3696a46410 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-e8e50b6e-0123-4643-874b-ca3696a46410 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:49:57.180322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:57.181191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:57.182026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:49:57.182026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:49:57.182026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:49:57.182026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:49:57.182026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:49:57.182026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:49:57.182026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:49:57.182026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:57.184951 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 262/527] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:57.185929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e50b6e-0123-4643-874b-ca3696a46410 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:57.217393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351b314-56da-4b25-8ce1-52ed6d9dfcc6 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.235374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.282111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0738b-7f18-435f-9f60-10373bfbbd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.283075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0738b-7f18-435f-9f60-10373bfbbd53 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.283516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0738b-7f18-435f-9f60-10373bfbbd53 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.283980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c0738b-7f18-435f-9f60-10373bfbbd53 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.284995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0738b-7f18-435f-9f60-10373bfbbd53 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:57.285488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0738b-7f18-435f-9f60-10373bfbbd53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.287726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c0738b-7f18-435f-9f60-10373bfbbd53 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.306188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e50b6e-0123-4643-874b-ca3696a46410 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.312151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 266/528] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Jun 23 10:49:57 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:57.313269 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0738b-7f18-435f-9f60-10373bfbbd53 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:57.345376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296581f-ab6c-4f0a-a06f-e07ec0a98262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.346165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296581f-ab6c-4f0a-a06f-e07ec0a98262 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.346451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296581f-ab6c-4f0a-a06f-e07ec0a98262 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.346847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b296581f-ab6c-4f0a-a06f-e07ec0a98262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.358015 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.360658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296581f-ab6c-4f0a-a06f-e07ec0a98262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.362545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b296581f-ab6c-4f0a-a06f-e07ec0a98262 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-b296581f-ab6c-4f0a-a06f-e07ec0a98262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:57.381727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:57.382791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:57.383614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:57.383614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:57.383614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:57.383614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:57.383614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 263/529] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:57.384351 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296581f-ab6c-4f0a-a06f-e07ec0a98262 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:57.454213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c0738b-7f18-435f-9f60-10373bfbbd53 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.499922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b296581f-ab6c-4f0a-a06f-e07ec0a98262 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.501090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7dc46-fce6-458e-9e59-777e11b085c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.502229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7dc46-fce6-458e-9e59-777e11b085c5 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.503703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7dc46-fce6-458e-9e59-777e11b085c5 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.507925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a7dc46-fce6-458e-9e59-777e11b085c5 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.507925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7dc46-fce6-458e-9e59-777e11b085c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:57.507925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7dc46-fce6-458e-9e59-777e11b085c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.507925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a7dc46-fce6-458e-9e59-777e11b085c5 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.533704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 267/530] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:49:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:57.536591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7dc46-fce6-458e-9e59-777e11b085c5 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:57.546131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf3729-a1b4-4915-a149-b5411fc7f816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.546784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf3729-a1b4-4915-a149-b5411fc7f816 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.547067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf3729-a1b4-4915-a149-b5411fc7f816 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.547348 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bf3729-a1b4-4915-a149-b5411fc7f816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.584189 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.620742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.628894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf3729-a1b4-4915-a149-b5411fc7f816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.630560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bf3729-a1b4-4915-a149-b5411fc7f816 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.677053 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a7dc46-fce6-458e-9e59-777e11b085c5 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.718706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd9f00-0e0a-42b4-86d5-4a838827ebe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.719540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd9f00-0e0a-42b4-86d5-4a838827ebe2 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.720033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd9f00-0e0a-42b4-86d5-4a838827ebe2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.720329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd9f00-0e0a-42b4-86d5-4a838827ebe2 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.721150 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd9f00-0e0a-42b4-86d5-4a838827ebe2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:57.721548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd9f00-0e0a-42b4-86d5-4a838827ebe2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.723050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd9f00-0e0a-42b4-86d5-4a838827ebe2 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.740128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 268/531] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:57.740991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd9f00-0e0a-42b4-86d5-4a838827ebe2 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:57.748165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 264/532] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:49:57.749203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf3729-a1b4-4915-a149-b5411fc7f816 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:57.854253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.862721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:57.870309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd9f00-0e0a-42b4-86d5-4a838827ebe2 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.878203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bf3729-a1b4-4915-a149-b5411fc7f816 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:57.908605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5f33e-1c15-4b5c-982a-f797e31c1ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.909288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5f33e-1c15-4b5c-982a-f797e31c1ab0 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.909568 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5f33e-1c15-4b5c-982a-f797e31c1ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.909840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5f33e-1c15-4b5c-982a-f797e31c1ab0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.910678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5f33e-1c15-4b5c-982a-f797e31c1ab0 None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=5211ed409a3f43d281bca44382aa03fe) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:57.910986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5f33e-1c15-4b5c-982a-f797e31c1ab0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.912826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd5f33e-1c15-4b5c-982a-f797e31c1ab0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.919067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 269/533] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:57 2022] GET /identity/v3/role_assignments?user.id=5211ed409a3f43d281bca44382aa03fe&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:57.919969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5f33e-1c15-4b5c-982a-f797e31c1ab0 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:57.940692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d59215-a7a1-4d9b-baff-768546cb28e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:57.941573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d59215-a7a1-4d9b-baff-768546cb28e4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:57.941870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d59215-a7a1-4d9b-baff-768546cb28e4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:57.944907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d59215-a7a1-4d9b-baff-768546cb28e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:57.966584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d59215-a7a1-4d9b-baff-768546cb28e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:57.968129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d59215-a7a1-4d9b-baff-768546cb28e4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-45d59215-a7a1-4d9b-baff-768546cb28e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:49:57.996778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:57.997695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:57.998547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:49:57.998547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:49:57.998547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:49:57.998547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:49:57.998547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:49:57.998547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:49:57.998547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:49:57.998547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:58.008338 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 265/534] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:58.014940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d59215-a7a1-4d9b-baff-768546cb28e4 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.062214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5f33e-1c15-4b5c-982a-f797e31c1ab0 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:58.104820 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a85ab-dba6-4c2b-90a3-8a1147afa3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:58.105570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a85ab-dba6-4c2b-90a3-8a1147afa3a6 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.105864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a85ab-dba6-4c2b-90a3-8a1147afa3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.106147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913a85ab-dba6-4c2b-90a3-8a1147afa3a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.129692 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a85ab-dba6-4c2b-90a3-8a1147afa3a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:58.131191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913a85ab-dba6-4c2b-90a3-8a1147afa3a6 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-913a85ab-dba6-4c2b-90a3-8a1147afa3a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:58.156415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:58.157390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:58.158200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:58.158200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:58.158200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:58.158200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:58.158200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 270/535] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:49:58.164128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a85ab-dba6-4c2b-90a3-8a1147afa3a6 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.176842 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:58.274251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913a85ab-dba6-4c2b-90a3-8a1147afa3a6 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:58.285750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d59215-a7a1-4d9b-baff-768546cb28e4 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:58.312008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e0ca0-85d5-444c-a972-fc67e0858d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:58.313040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e0ca0-85d5-444c-a972-fc67e0858d65 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.313566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e0ca0-85d5-444c-a972-fc67e0858d65 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.314151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792e0ca0-85d5-444c-a972-fc67e0858d65 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.315090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e0ca0-85d5-444c-a972-fc67e0858d65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:58.315598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e0ca0-85d5-444c-a972-fc67e0858d65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:58.321737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792e0ca0-85d5-444c-a972-fc67e0858d65 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:58.328518 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b7be4-afb4-4cce-b5b3-597004ed44cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:58.331827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7be4-afb4-4cce-b5b3-597004ed44cf None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.331827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7be4-afb4-4cce-b5b3-597004ed44cf None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.331827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2b7be4-afb4-4cce-b5b3-597004ed44cf None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.331827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b7be4-afb4-4cce-b5b3-597004ed44cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:58.331827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b7be4-afb4-4cce-b5b3-597004ed44cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:58.332308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2b7be4-afb4-4cce-b5b3-597004ed44cf None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:58.348768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 271/536] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:58.355014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e0ca0-85d5-444c-a972-fc67e0858d65 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.366010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 266/537] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:49:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:58.366970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b7be4-afb4-4cce-b5b3-597004ed44cf None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.398309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:58.463274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:58.516673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792e0ca0-85d5-444c-a972-fc67e0858d65 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:58.568553 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea01ba3-0c22-49b0-815a-e70221abf8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:58.569370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea01ba3-0c22-49b0-815a-e70221abf8b8 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.569656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea01ba3-0c22-49b0-815a-e70221abf8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.570022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea01ba3-0c22-49b0-815a-e70221abf8b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.571332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2b7be4-afb4-4cce-b5b3-597004ed44cf None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:58.578797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea01ba3-0c22-49b0-815a-e70221abf8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:58.580329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea01ba3-0c22-49b0-815a-e70221abf8b8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-0ea01ba3-0c22-49b0-815a-e70221abf8b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:49:58.601980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:58.602891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:58.603714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:49:58.603714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:49:58.603714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:49:58.603714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:49:58.603714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:49:58.603714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:49:58.603714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:49:58.603714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:58.607958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 272/538] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:49:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:49:58.609838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238e83e-1d94-4fc7-b7e2-05fbc25479c0 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.610130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238e83e-1d94-4fc7-b7e2-05fbc25479c0 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.610408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238e83e-1d94-4fc7-b7e2-05fbc25479c0 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.611963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 273/539] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:58.614344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238e83e-1d94-4fc7-b7e2-05fbc25479c0 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.629114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34d4045-ddad-42c4-946e-f8c34599ad5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:58.629771 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d4045-ddad-42c4-946e-f8c34599ad5a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.630050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d4045-ddad-42c4-946e-f8c34599ad5a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.630325 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34d4045-ddad-42c4-946e-f8c34599ad5a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.631156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d4045-ddad-42c4-946e-f8c34599ad5a None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=71539f69f3c8446ca7e9833d244d20fb) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:58.631469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d4045-ddad-42c4-946e-f8c34599ad5a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:58.633033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34d4045-ddad-42c4-946e-f8c34599ad5a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:58.639935 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 267/540] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:58 2022] GET /identity/v3/role_assignments?user.id=71539f69f3c8446ca7e9833d244d20fb&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:58.649245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a082ebf-92c2-42d2-bf62-3c2e0b079223 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.649577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a082ebf-92c2-42d2-bf62-3c2e0b079223 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.649796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a082ebf-92c2-42d2-bf62-3c2e0b079223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.681003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-6a082ebf-92c2-42d2-bf62-3c2e0b079223 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:58.682291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6a082ebf-92c2-42d2-bf62-3c2e0b079223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:58.761829 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238e83e-1d94-4fc7-b7e2-05fbc25479c0 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:58.808322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:58.812514 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28a14-d908-4be0-8e3a-3e7582abff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:58.813857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28a14-d908-4be0-8e3a-3e7582abff16 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:58.814358 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28a14-d908-4be0-8e3a-3e7582abff16 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:58.814840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc28a14-d908-4be0-8e3a-3e7582abff16 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:58.816061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc28a14-d908-4be0-8e3a-3e7582abff16 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:58.816633 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc28a14-d908-4be0-8e3a-3e7582abff16 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:58.818505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc28a14-d908-4be0-8e3a-3e7582abff16 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:58.836317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 274/541] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:49:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:58.842950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28a14-d908-4be0-8e3a-3e7582abff16 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.869465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 268/542] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:49:58.898634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a082ebf-92c2-42d2-bf62-3c2e0b079223 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:58.907891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:58.967029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc28a14-d908-4be0-8e3a-3e7582abff16 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:59.019892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc9755-aa83-4520-925e-e03ad4a1b751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:59.020124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a082ebf-92c2-42d2-bf62-3c2e0b079223 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:59.020561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc9755-aa83-4520-925e-e03ad4a1b751 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:59.020848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc9755-aa83-4520-925e-e03ad4a1b751 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:59.021129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc9755-aa83-4520-925e-e03ad4a1b751 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:59.022202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc9755-aa83-4520-925e-e03ad4a1b751 None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=2d903a8e2ce4489fa7f5b7479ff0b7a2) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:59.022623 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc9755-aa83-4520-925e-e03ad4a1b751 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:59.024110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc9755-aa83-4520-925e-e03ad4a1b751 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:59.040085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 275/543] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:49:58 2022] GET /identity/v3/role_assignments?user.id=2d903a8e2ce4489fa7f5b7479ff0b7a2&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:59.041667 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b6a8c-e093-4f7c-bab9-03304852a8c9 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:59.042001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b6a8c-e093-4f7c-bab9-03304852a8c9 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:59.042284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b6a8c-e093-4f7c-bab9-03304852a8c9 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:59.044140 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 276/544] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:49:59.049966 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797efc9-ee42-4270-bd6a-66bb4aed4175 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:59.050562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797efc9-ee42-4270-bd6a-66bb4aed4175 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:59.050863 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797efc9-ee42-4270-bd6a-66bb4aed4175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:59.064916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c8030-f73d-4ea9-a1c9-93048b79e6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:59.065742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c8030-f73d-4ea9-a1c9-93048b79e6fc None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:59.066026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c8030-f73d-4ea9-a1c9-93048b79e6fc None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:59.066308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684c8030-f73d-4ea9-a1c9-93048b79e6fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:59.082598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-e797efc9-ee42-4270-bd6a-66bb4aed4175 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:49:59.083871 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e797efc9-ee42-4270-bd6a-66bb4aed4175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:49:59.091247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684c8030-f73d-4ea9-a1c9-93048b79e6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-684c8030-f73d-4ea9-a1c9-93048b79e6fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:59.105566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:59.106516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:59.107308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:59.107308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:59.107308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:59.107308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:59.107308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:59.107308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:59.107308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:59.107308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:59.107308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:59.107308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:59.107308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:49:59.107308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:59.107957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 269/545] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:49:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:49:59.115041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c8030-f73d-4ea9-a1c9-93048b79e6fc None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:59.196607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:59.211119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 277/546] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:49:59.235087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797efc9-ee42-4270-bd6a-66bb4aed4175 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:59.258490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:59.319955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684c8030-f73d-4ea9-a1c9-93048b79e6fc None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:59.385205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daf1e4-b9f7-497e-9474-c016de7f73ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:59.387986 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf1e4-b9f7-497e-9474-c016de7f73ad None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:59.388498 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf1e4-b9f7-497e-9474-c016de7f73ad None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:59.389956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8daf1e4-b9f7-497e-9474-c016de7f73ad None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:59.390912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daf1e4-b9f7-497e-9474-c016de7f73ad None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:59.392688 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daf1e4-b9f7-497e-9474-c016de7f73ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:59.394317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8daf1e4-b9f7-497e-9474-c016de7f73ad None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:59.405306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 270/547] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:49:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:49:59.410102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797efc9-ee42-4270-bd6a-66bb4aed4175 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:59.410632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daf1e4-b9f7-497e-9474-c016de7f73ad None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:59.448605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c1cdf-9efd-4b43-ac7d-6608e4ca8a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:59.450550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c1cdf-9efd-4b43-ac7d-6608e4ca8a69 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:59.451179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c1cdf-9efd-4b43-ac7d-6608e4ca8a69 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:59.451951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c1cdf-9efd-4b43-ac7d-6608e4ca8a69 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:59.465204 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c1cdf-9efd-4b43-ac7d-6608e4ca8a69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-c13c1cdf-9efd-4b43-ac7d-6608e4ca8a69 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:49:59.475522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:59.476457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:59.477733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:59.477733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:59.477733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:59.477733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:59.477733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:49:59.477733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:49:59.477733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:49:59.477733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:49:59.477733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:49:59.477733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:49:59.477733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:49:59.477733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:49:59.480842 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 278/548] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:49:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:49:59.487874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c1cdf-9efd-4b43-ac7d-6608e4ca8a69 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:59.589931 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:59.602408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8daf1e4-b9f7-497e-9474-c016de7f73ad None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:59.631498 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:59.639838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a3566-154f-491d-bbbe-3abe407f45ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:59.640639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a3566-154f-491d-bbbe-3abe407f45ce None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:59.640924 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a3566-154f-491d-bbbe-3abe407f45ce None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:59.641300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58a3566-154f-491d-bbbe-3abe407f45ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:59.653485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a3566-154f-491d-bbbe-3abe407f45ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:59.656799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58a3566-154f-491d-bbbe-3abe407f45ce None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-b58a3566-154f-491d-bbbe-3abe407f45ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:49:59.676279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:49:59.677196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:49:59.678037 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:49:59.678037 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:49:59.678037 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:49:59.678037 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:49:59.678037 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 271/549] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:49:59.683100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a3566-154f-491d-bbbe-3abe407f45ce None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:59.712318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c1cdf-9efd-4b43-ac7d-6608e4ca8a69 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:59.749180 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff8b30-dab0-4ab0-b1cc-d8b3ef720873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:59.750247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff8b30-dab0-4ab0-b1cc-d8b3ef720873 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:59.750731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff8b30-dab0-4ab0-b1cc-d8b3ef720873 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:59.751214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff8b30-dab0-4ab0-b1cc-d8b3ef720873 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:59.752365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff8b30-dab0-4ab0-b1cc-d8b3ef720873 None admin] RBAC: Adding query filter params (name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:59.752878 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff8b30-dab0-4ab0-b1cc-d8b3ef720873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:59.754467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff8b30-dab0-4ab0-b1cc-d8b3ef720873 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:59.765321 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 279/550] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:49:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:59.775684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff8b30-dab0-4ab0-b1cc-d8b3ef720873 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:59.853912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58a3566-154f-491d-bbbe-3abe407f45ce None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:59.917547 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff8b30-dab0-4ab0-b1cc-d8b3ef720873 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:49:59.920371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:49:59.954043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934263a4-e8f4-4fb9-bb78-ad5ba48b9db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:59.954709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934263a4-e8f4-4fb9-bb78-ad5ba48b9db7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:59.954993 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934263a4-e8f4-4fb9-bb78-ad5ba48b9db7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:59.955281 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934263a4-e8f4-4fb9-bb78-ad5ba48b9db7 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:59.956049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934263a4-e8f4-4fb9-bb78-ad5ba48b9db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:49:59.956357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934263a4-e8f4-4fb9-bb78-ad5ba48b9db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:59.957807 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934263a4-e8f4-4fb9-bb78-ad5ba48b9db7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:49:59.962593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cb3dd-5b39-42b9-980f-cddd8a8d41a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:49:59.963347 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cb3dd-5b39-42b9-980f-cddd8a8d41a0 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:49:59.963692 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cb3dd-5b39-42b9-980f-cddd8a8d41a0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:49:59.964003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6cb3dd-5b39-42b9-980f-cddd8a8d41a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:49:59.971480 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 272/551] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:49:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:49:59.977278 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934263a4-e8f4-4fb9-bb78-ad5ba48b9db7 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:49:59.994215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cb3dd-5b39-42b9-980f-cddd8a8d41a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:49:59.995828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6cb3dd-5b39-42b9-980f-cddd8a8d41a0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:00.027165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-fd6cb3dd-5b39-42b9-980f-cddd8a8d41a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:00.029083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:00.029921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:00.030819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:00.030819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:00.030819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:00.030819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:00.034881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 280/552] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:49:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:00.039135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cb3dd-5b39-42b9-980f-cddd8a8d41a0 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:00.123070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934263a4-e8f4-4fb9-bb78-ad5ba48b9db7 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:00.193428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188ade9-36d4-47b7-a4b4-2990157b7588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:00.194219 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188ade9-36d4-47b7-a4b4-2990157b7588 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:00.194498 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188ade9-36d4-47b7-a4b4-2990157b7588 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:00.194770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2188ade9-36d4-47b7-a4b4-2990157b7588 None admin] PATH_INFO: `/v3/users/swift` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.211585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188ade9-36d4-47b7-a4b4-2990157b7588 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:00.213157 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2188ade9-36d4-47b7-a4b4-2990157b7588 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-2188ade9-36d4-47b7-a4b4-2990157b7588 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:00.229764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:00.230738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:00.231659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:00.231659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:00.231659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:00.231659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:00.231659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:00.231659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:00.231659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:00.231659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:00.231659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:50:00.231659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:00.231659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 273/553] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:49:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:00.236633 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188ade9-36d4-47b7-a4b4-2990157b7588 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:00.239474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6cb3dd-5b39-42b9-980f-cddd8a8d41a0 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:00.316553 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff1b691-ce59-463c-aaeb-28dd99c42cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:00.317225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1b691-ce59-463c-aaeb-28dd99c42cd5 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:00.317506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1b691-ce59-463c-aaeb-28dd99c42cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:00.317780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff1b691-ce59-463c-aaeb-28dd99c42cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.318506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1b691-ce59-463c-aaeb-28dd99c42cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:00.318811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1b691-ce59-463c-aaeb-28dd99c42cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:00.320218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff1b691-ce59-463c-aaeb-28dd99c42cd5 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:00.340324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 281/554] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:00.341666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1231d-8b8b-497c-9c85-9288eea66386 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:00.341953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1231d-8b8b-497c-9c85-9288eea66386 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:00.342229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1231d-8b8b-497c-9c85-9288eea66386 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.353661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 282/555] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:00.356018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1231d-8b8b-497c-9c85-9288eea66386 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:00.380690 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:00.393776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:00.397214 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2188ade9-36d4-47b7-a4b4-2990157b7588 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:00.438089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1543d0-ba44-4688-b05c-a289f086736a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:00.438980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1543d0-ba44-4688-b05c-a289f086736a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:00.439321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1543d0-ba44-4688-b05c-a289f086736a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:00.439650 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1543d0-ba44-4688-b05c-a289f086736a None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.440607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1543d0-ba44-4688-b05c-a289f086736a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:00.440975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1543d0-ba44-4688-b05c-a289f086736a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:00.442829 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1543d0-ba44-4688-b05c-a289f086736a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:00.467548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 274/556] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Jun 23 10:50:00 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:00.467548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c483116-808a-404f-9c3c-c3c74e964372 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:00.467548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c483116-808a-404f-9c3c-c3c74e964372 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:00.467548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c483116-808a-404f-9c3c-c3c74e964372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.484513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1231d-8b8b-497c-9c85-9288eea66386 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:00.486664 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-2c483116-808a-404f-9c3c-c3c74e964372 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:00.488342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2c483116-808a-404f-9c3c-c3c74e964372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:00.523896 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34584d-f5c7-4e55-a1b5-cc95e1634c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:00.525144 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34584d-f5c7-4e55-a1b5-cc95e1634c08 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:00.525575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34584d-f5c7-4e55-a1b5-cc95e1634c08 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:00.526278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34584d-f5c7-4e55-a1b5-cc95e1634c08 None admin] PATH_INFO: `/v3/users/nova` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.534483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34584d-f5c7-4e55-a1b5-cc95e1634c08 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:00.536273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34584d-f5c7-4e55-a1b5-cc95e1634c08 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-da34584d-f5c7-4e55-a1b5-cc95e1634c08 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:00.552981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:00.554402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:00.555319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:00.555319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:00.555319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:00.555319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:00.555319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:00.555319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:00.555319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:00.555319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:00.555319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:50:00.555319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:00.558214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 283/557] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Jun 23 10:50:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:00.559425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34584d-f5c7-4e55-a1b5-cc95e1634c08 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:00.571863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 275/558] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:00.571863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c483116-808a-404f-9c3c-c3c74e964372 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:00.666514 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:00.672884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:00.686639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c483116-808a-404f-9c3c-c3c74e964372 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:00.699064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34584d-f5c7-4e55-a1b5-cc95e1634c08 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:00.724910 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c3479-5a1f-4fa6-9979-d6f86393137b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:00.725508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c3479-5a1f-4fa6-9979-d6f86393137b None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:00.725797 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c3479-5a1f-4fa6-9979-d6f86393137b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:00.726211 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549c3479-5a1f-4fa6-9979-d6f86393137b None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.727066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c3479-5a1f-4fa6-9979-d6f86393137b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:00.727597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c3479-5a1f-4fa6-9979-d6f86393137b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:00.728861 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549c3479-5a1f-4fa6-9979-d6f86393137b None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:00.745463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d622592-da30-4901-8886-cc10b0422813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:00.746576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d622592-da30-4901-8886-cc10b0422813 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:00.747065 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d622592-da30-4901-8886-cc10b0422813 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:00.747560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d622592-da30-4901-8886-cc10b0422813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.750131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 276/559] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Jun 23 10:50:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:00.751101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c3479-5a1f-4fa6-9979-d6f86393137b None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:00.830881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d622592-da30-4901-8886-cc10b0422813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:00.833064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d622592-da30-4901-8886-cc10b0422813 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:00.862631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549c3479-5a1f-4fa6-9979-d6f86393137b None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:00.900637 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f55e7-2c2e-41ba-af66-dd45315aec65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:00.901469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f55e7-2c2e-41ba-af66-dd45315aec65 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:00.901775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f55e7-2c2e-41ba-af66-dd45315aec65 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:00.902597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f55e7-2c2e-41ba-af66-dd45315aec65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:00.914327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f55e7-2c2e-41ba-af66-dd45315aec65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:00.919397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-0b9f55e7-2c2e-41ba-af66-dd45315aec65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:00.924060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:00.925024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:00.925836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:00.925836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:00.925836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:00.925836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:00.925836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:00.925836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:00.925836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:00.925836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:00.925836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:00.925836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:00.925836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:00.925836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:00.929253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 277/560] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:00.930338 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f55e7-2c2e-41ba-af66-dd45315aec65 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:00.943427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:00.955542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 284/561] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:00.956787 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d622592-da30-4901-8886-cc10b0422813 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.049578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f55e7-2c2e-41ba-af66-dd45315aec65 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.083511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d622592-da30-4901-8886-cc10b0422813 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.084546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0153a3-8fc9-45b3-81a4-7856fd637843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.085341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0153a3-8fc9-45b3-81a4-7856fd637843 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.085627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0153a3-8fc9-45b3-81a4-7856fd637843 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.085914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0153a3-8fc9-45b3-81a4-7856fd637843 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.097287 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0153a3-8fc9-45b3-81a4-7856fd637843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.098778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0153a3-8fc9-45b3-81a4-7856fd637843 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-8e0153a3-8fc9-45b3-81a4-7856fd637843 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:01.117985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:01.119067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:01.120080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:01.120080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:01.120080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:01.120080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:01.120080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 278/562] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:01.120369 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0153a3-8fc9-45b3-81a4-7856fd637843 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.125769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729f7f19-1185-4dbb-81e9-e6851eba7e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.126515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f7f19-1185-4dbb-81e9-e6851eba7e04 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.126802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f7f19-1185-4dbb-81e9-e6851eba7e04 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.127078 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729f7f19-1185-4dbb-81e9-e6851eba7e04 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.127847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f7f19-1185-4dbb-81e9-e6851eba7e04 None admin] RBAC: Adding query filter params (name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:01.128159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f7f19-1185-4dbb-81e9-e6851eba7e04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.129557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729f7f19-1185-4dbb-81e9-e6851eba7e04 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:01.138428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 285/563] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:50:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:01.139709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545ea46-4b23-4afb-b05b-78b9ad13e03a None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.140043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545ea46-4b23-4afb-b05b-78b9ad13e03a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.140323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a545ea46-4b23-4afb-b05b-78b9ad13e03a None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.141703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 286/564] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:01.142223 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545ea46-4b23-4afb-b05b-78b9ad13e03a None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.186718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:01.194799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:01.238085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0153a3-8fc9-45b3-81a4-7856fd637843 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.250584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a545ea46-4b23-4afb-b05b-78b9ad13e03a None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.276402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b288ae80-c9cf-4a16-b4d7-ddf5cf16ccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.277346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288ae80-c9cf-4a16-b4d7-ddf5cf16ccfe None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.277962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288ae80-c9cf-4a16-b4d7-ddf5cf16ccfe None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.278376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b288ae80-c9cf-4a16-b4d7-ddf5cf16ccfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.285081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeed29b-8255-431d-af10-424642e75701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.285773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeed29b-8255-431d-af10-424642e75701 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.286058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeed29b-8255-431d-af10-424642e75701 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.286388 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeed29b-8255-431d-af10-424642e75701 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.287061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeed29b-8255-431d-af10-424642e75701 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:01.287368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeed29b-8255-431d-af10-424642e75701 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.288765 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeed29b-8255-431d-af10-424642e75701 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:01.291535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288ae80-c9cf-4a16-b4d7-ddf5cf16ccfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.293566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b288ae80-c9cf-4a16-b4d7-ddf5cf16ccfe None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:01.301951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 287/565] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:01.302707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeed29b-8255-431d-af10-424642e75701 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-b288ae80-c9cf-4a16-b4d7-ddf5cf16ccfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:01.315380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:01.321181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:01.322298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:01.322298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:01.322298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:01.322298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:01.322298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 279/566] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:01.322298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083ba12-d732-454e-ad6a-4ff41ab004cd None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.322298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083ba12-d732-454e-ad6a-4ff41ab004cd None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.322298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083ba12-d732-454e-ad6a-4ff41ab004cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.338414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b083ba12-d732-454e-ad6a-4ff41ab004cd None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:01.340250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b083ba12-d732-454e-ad6a-4ff41ab004cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:01.415627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 280/567] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:01.420303 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083ba12-d732-454e-ad6a-4ff41ab004cd None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.427226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:01.431215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeed29b-8255-431d-af10-424642e75701 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.466846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cd609-f24a-4dfd-9cc1-bd9475179f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.467642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cd609-f24a-4dfd-9cc1-bd9475179f28 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.467959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cd609-f24a-4dfd-9cc1-bd9475179f28 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.468237 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1cd609-f24a-4dfd-9cc1-bd9475179f28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.474290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:01.478747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cd609-f24a-4dfd-9cc1-bd9475179f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.480300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1cd609-f24a-4dfd-9cc1-bd9475179f28 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-cb1cd609-f24a-4dfd-9cc1-bd9475179f28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:01.498756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:01.499695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:01.500601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:01.500601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:01.500601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:01.500601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:01.500601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 288/568] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:01.501357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cd609-f24a-4dfd-9cc1-bd9475179f28 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.533706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083ba12-d732-454e-ad6a-4ff41ab004cd None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.613157 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d859d-5c7e-41e3-a133-020193a3bf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.613942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d859d-5c7e-41e3-a133-020193a3bf48 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.614225 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d859d-5c7e-41e3-a133-020193a3bf48 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.614498 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d859d-5c7e-41e3-a133-020193a3bf48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.621685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d859d-5c7e-41e3-a133-020193a3bf48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.623134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d859d-5c7e-41e3-a133-020193a3bf48 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-dd9d859d-5c7e-41e3-a133-020193a3bf48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:01.637344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:01.638317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:01.639194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:01.639194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:01.639194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:01.639194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:01.639194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:01.639194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:01.639194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:01.639194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:01.639194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 281/569] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:01.639693 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeceab1-786c-4d47-8d13-7a761b588649 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.640000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeceab1-786c-4d47-8d13-7a761b588649 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.640277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeceab1-786c-4d47-8d13-7a761b588649 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.641660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 282/570] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:01.646105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeceab1-786c-4d47-8d13-7a761b588649 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.649835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1cd609-f24a-4dfd-9cc1-bd9475179f28 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.684978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d4b0-45fc-4e7c-8d02-2d320b779501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.685654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d4b0-45fc-4e7c-8d02-2d320b779501 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.685981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d4b0-45fc-4e7c-8d02-2d320b779501 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.686300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d4b0-45fc-4e7c-8d02-2d320b779501 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.687058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33d4b0-45fc-4e7c-8d02-2d320b779501 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:01.687391 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33d4b0-45fc-4e7c-8d02-2d320b779501 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.688814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33d4b0-45fc-4e7c-8d02-2d320b779501 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:01.700377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 289/571] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:01.701195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d4b0-45fc-4e7c-8d02-2d320b779501 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.714300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:01.743625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:01.747595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeceab1-786c-4d47-8d13-7a761b588649 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.782157 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4c825-cb5b-4811-8757-5a6c7ec40d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.782943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4c825-cb5b-4811-8757-5a6c7ec40d73 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.783232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4c825-cb5b-4811-8757-5a6c7ec40d73 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.783511 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e4c825-cb5b-4811-8757-5a6c7ec40d73 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.793676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e4c825-cb5b-4811-8757-5a6c7ec40d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-90e4c825-cb5b-4811-8757-5a6c7ec40d73 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:01.801389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:01.802560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:01.803400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 283/572] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:01.804160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d4b0-45fc-4e7c-8d02-2d320b779501 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.804248 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4c825-cb5b-4811-8757-5a6c7ec40d73 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.841025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3343269f-8d45-4c22-89d6-5970d3cddd6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.841612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343269f-8d45-4c22-89d6-5970d3cddd6b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.841906 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343269f-8d45-4c22-89d6-5970d3cddd6b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.842186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3343269f-8d45-4c22-89d6-5970d3cddd6b None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.842910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343269f-8d45-4c22-89d6-5970d3cddd6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:01.843223 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343269f-8d45-4c22-89d6-5970d3cddd6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.844646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3343269f-8d45-4c22-89d6-5970d3cddd6b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:01.857767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 290/573] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:01.858813 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b38b9-f2fd-443a-91fd-ed547fcd562b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.859100 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b38b9-f2fd-443a-91fd-ed547fcd562b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.859380 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939b38b9-f2fd-443a-91fd-ed547fcd562b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.875588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-939b38b9-f2fd-443a-91fd-ed547fcd562b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:01.876832 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-939b38b9-f2fd-443a-91fd-ed547fcd562b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:01.904535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e4c825-cb5b-4811-8757-5a6c7ec40d73 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:01.937611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce14ab-2bf7-4dc8-a529-e04cc0472dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:01.938266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce14ab-2bf7-4dc8-a529-e04cc0472dee None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:01.938546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce14ab-2bf7-4dc8-a529-e04cc0472dee None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:01.938823 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bce14ab-2bf7-4dc8-a529-e04cc0472dee None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:01.939602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce14ab-2bf7-4dc8-a529-e04cc0472dee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:01.939945 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce14ab-2bf7-4dc8-a529-e04cc0472dee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:01.940099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:01.941396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bce14ab-2bf7-4dc8-a529-e04cc0472dee None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:01.944565 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 291/574] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:01.945399 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b38b9-f2fd-443a-91fd-ed547fcd562b None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.954892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 284/575] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:01.955900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce14ab-2bf7-4dc8-a529-e04cc0472dee None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:01.983197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:02.045371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939b38b9-f2fd-443a-91fd-ed547fcd562b None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:02.059518 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bce14ab-2bf7-4dc8-a529-e04cc0472dee None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:02.079254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5192336-f37e-4379-9ad8-8d2c4d06e42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:02.080070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5192336-f37e-4379-9ad8-8d2c4d06e42c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:02.080354 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5192336-f37e-4379-9ad8-8d2c4d06e42c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:02.080632 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5192336-f37e-4379-9ad8-8d2c4d06e42c None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:02.087239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5192336-f37e-4379-9ad8-8d2c4d06e42c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:02.088768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5192336-f37e-4379-9ad8-8d2c4d06e42c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:02.092930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc7704-187a-4a9e-a449-7b5a0ab57366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:02.093528 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc7704-187a-4a9e-a449-7b5a0ab57366 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:02.093810 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc7704-187a-4a9e-a449-7b5a0ab57366 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:02.094084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc7704-187a-4a9e-a449-7b5a0ab57366 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:02.094814 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc7704-187a-4a9e-a449-7b5a0ab57366 None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:02.095118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc7704-187a-4a9e-a449-7b5a0ab57366 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:02.096490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc7704-187a-4a9e-a449-7b5a0ab57366 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-b5192336-f37e-4379-9ad8-8d2c4d06e42c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:02.102519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:02.103476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:02.105161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:02.105161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:02.105161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:02.105161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:02.105161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:02.105161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:02.105161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:02.105161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:02.105161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 292/576] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:02.105838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 285/577] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:50:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:02.106072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc7704-187a-4a9e-a449-7b5a0ab57366 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:02.108162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5192336-f37e-4379-9ad8-8d2c4d06e42c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:02.168120 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:02.192594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:02.210688 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc7704-187a-4a9e-a449-7b5a0ab57366 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:02.210895 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5192336-f37e-4379-9ad8-8d2c4d06e42c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:02.245847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4461a0-da07-470a-a7f3-838050aa47da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:02.246668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4461a0-da07-470a-a7f3-838050aa47da None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:02.246775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a61d7d-5980-46e7-80e5-0aab7de1c7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:02.246953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4461a0-da07-470a-a7f3-838050aa47da None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:02.247231 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4461a0-da07-470a-a7f3-838050aa47da None admin] PATH_INFO: `/v3/users/glance` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:02.247613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a61d7d-5980-46e7-80e5-0aab7de1c7c6 None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:02.247929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a61d7d-5980-46e7-80e5-0aab7de1c7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:02.248214 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a61d7d-5980-46e7-80e5-0aab7de1c7c6 None admin] PATH_INFO: `/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/a020e7fe06574a108b46f9f48bddc4e4/roles/c14c06359c8649ceaef626fadcc1fc3a` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:02.254856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4461a0-da07-470a-a7f3-838050aa47da None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:02.256361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4461a0-da07-470a-a7f3-838050aa47da None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:02.263118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a61d7d-5980-46e7-80e5-0aab7de1c7c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27530ca8f8e4156a519c726bd98c2a0, user_id=a020e7fe06574a108b46f9f48bddc4e4, role_id=c14c06359c8649ceaef626fadcc1fc3a)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:02.264564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a61d7d-5980-46e7-80e5-0aab7de1c7c6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-bd4461a0-da07-470a-a7f3-838050aa47da None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:02.270366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:02.272363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:02.273798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:02.273798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:02.273798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:02.273798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:02.273798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:02.273798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:02.273798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:02.273798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:02.273798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:50:02.273798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:02.276611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 293/578] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:50:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:02.277461 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4461a0-da07-470a-a7f3-838050aa47da None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:02.329326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 286/579] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:50:02 2022] PUT /identity/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/a020e7fe06574a108b46f9f48bddc4e4/roles/c14c06359c8649ceaef626fadcc1fc3a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:02.330238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a61d7d-5980-46e7-80e5-0aab7de1c7c6 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:02.392748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4461a0-da07-470a-a7f3-838050aa47da None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:02.416370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:02.436143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a4b7-3abc-4873-8f8d-86f8a8934690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:02.436957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a4b7-3abc-4873-8f8d-86f8a8934690 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:02.437240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a4b7-3abc-4873-8f8d-86f8a8934690 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:02.437511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5a4b7-3abc-4873-8f8d-86f8a8934690 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:02.445994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a61d7d-5980-46e7-80e5-0aab7de1c7c6 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:02.450292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5a4b7-3abc-4873-8f8d-86f8a8934690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-5dd5a4b7-3abc-4873-8f8d-86f8a8934690 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:02.458190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:02.459199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:02.460064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 294/580] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:02.460824 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a4b7-3abc-4873-8f8d-86f8a8934690 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:02.493904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:02.499478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a06a2-4dc8-42a5-9a16-650455686af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:02.500616 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a06a2-4dc8-42a5-9a16-650455686af6 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:02.500616 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a06a2-4dc8-42a5-9a16-650455686af6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:02.500816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a06a2-4dc8-42a5-9a16-650455686af6 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:02.501522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a06a2-4dc8-42a5-9a16-650455686af6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:02.501833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a06a2-4dc8-42a5-9a16-650455686af6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:02.503284 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a06a2-4dc8-42a5-9a16-650455686af6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:02.516884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 287/581] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:02.517088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a06a2-4dc8-42a5-9a16-650455686af6 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:02.605576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5a4b7-3abc-4873-8f8d-86f8a8934690 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:02.637062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a06a2-4dc8-42a5-9a16-650455686af6 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:02.642197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87767e-2ad5-4efa-8f35-cff9f2250a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:02.643048 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87767e-2ad5-4efa-8f35-cff9f2250a27 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:02.643282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87767e-2ad5-4efa-8f35-cff9f2250a27 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:02.643657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b87767e-2ad5-4efa-8f35-cff9f2250a27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:02.655322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87767e-2ad5-4efa-8f35-cff9f2250a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:02.656833 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b87767e-2ad5-4efa-8f35-cff9f2250a27 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:02.673205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1553df0-5f0d-4aff-bdc2-47160da6c664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:02.674031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1553df0-5f0d-4aff-bdc2-47160da6c664 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:02.674412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1553df0-5f0d-4aff-bdc2-47160da6c664 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-6b87767e-2ad5-4efa-8f35-cff9f2250a27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:02.674510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:02.675527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:02.676726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:02.676726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:02.676726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:02.676726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:02.677019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1553df0-5f0d-4aff-bdc2-47160da6c664 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:02.677888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1553df0-5f0d-4aff-bdc2-47160da6c664 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:02.678297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1553df0-5f0d-4aff-bdc2-47160da6c664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:02.679878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1553df0-5f0d-4aff-bdc2-47160da6c664 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:02.680318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 295/582] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:02.680991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87767e-2ad5-4efa-8f35-cff9f2250a27 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:02.703957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 288/583] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Jun 23 10:50:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:02.703957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1553df0-5f0d-4aff-bdc2-47160da6c664 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:02.719963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:02.757116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:02.792980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b87767e-2ad5-4efa-8f35-cff9f2250a27 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:02.820081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1553df0-5f0d-4aff-bdc2-47160da6c664 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:02.832099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f02e4-14f2-48a0-bb67-a044ff2a9ba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:02.832919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f02e4-14f2-48a0-bb67-a044ff2a9ba0 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:02.833303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f02e4-14f2-48a0-bb67-a044ff2a9ba0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:02.833684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f02e4-14f2-48a0-bb67-a044ff2a9ba0 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:02.834536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f02e4-14f2-48a0-bb67-a044ff2a9ba0 None admin] RBAC: Adding query filter params (name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:02.834945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f02e4-14f2-48a0-bb67-a044ff2a9ba0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:02.836444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f02e4-14f2-48a0-bb67-a044ff2a9ba0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:02.849931 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 296/584] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:50:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:02.849931 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f02e4-14f2-48a0-bb67-a044ff2a9ba0 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:02.864133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b062d-ec09-40b9-9795-208d3fe75b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:02.864939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b062d-ec09-40b9-9795-208d3fe75b2d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:02.865319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b062d-ec09-40b9-9795-208d3fe75b2d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:02.865692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b062d-ec09-40b9-9795-208d3fe75b2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:02.866622 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b062d-ec09-40b9-9795-208d3fe75b2d None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=dd54976bc4b541a89a0c15788bfb71ed) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:02.867038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b062d-ec09-40b9-9795-208d3fe75b2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:02.868588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b062d-ec09-40b9-9795-208d3fe75b2d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:02.875575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 289/585] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:02 2022] GET /identity/v3/role_assignments?user.id=dd54976bc4b541a89a0c15788bfb71ed&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:02.876405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b062d-ec09-40b9-9795-208d3fe75b2d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:02.985923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:02.993639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b062d-ec09-40b9-9795-208d3fe75b2d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.002474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f02e4-14f2-48a0-bb67-a044ff2a9ba0 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.011184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:03.033979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd302ad-e8b0-4c32-91e1-87f95a79a951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.036752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd302ad-e8b0-4c32-91e1-87f95a79a951 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.036752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd302ad-e8b0-4c32-91e1-87f95a79a951 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.036752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd302ad-e8b0-4c32-91e1-87f95a79a951 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.036992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243c445-ae6b-4374-b168-afe52a2cf3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.036992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243c445-ae6b-4374-b168-afe52a2cf3f8 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.037479 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243c445-ae6b-4374-b168-afe52a2cf3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.037764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d243c445-ae6b-4374-b168-afe52a2cf3f8 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.038523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243c445-ae6b-4374-b168-afe52a2cf3f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:03.038827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243c445-ae6b-4374-b168-afe52a2cf3f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.040242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d243c445-ae6b-4374-b168-afe52a2cf3f8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.051474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd302ad-e8b0-4c32-91e1-87f95a79a951 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.054673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd302ad-e8b0-4c32-91e1-87f95a79a951 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.058319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 297/586] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:03.059284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243c445-ae6b-4374-b168-afe52a2cf3f8 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-fbd302ad-e8b0-4c32-91e1-87f95a79a951 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:03.078583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:03.079898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:03.081064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:03.081064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:03.081064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:03.081064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:03.087724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 290/587] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:03.089500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd302ad-e8b0-4c32-91e1-87f95a79a951 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.166465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d243c445-ae6b-4374-b168-afe52a2cf3f8 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.200706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd302ad-e8b0-4c32-91e1-87f95a79a951 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.203064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e40b2-a0b7-48e5-8ca1-ba58f84db657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.204639 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e40b2-a0b7-48e5-8ca1-ba58f84db657 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.204639 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e40b2-a0b7-48e5-8ca1-ba58f84db657 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.204639 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e40b2-a0b7-48e5-8ca1-ba58f84db657 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.215783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e40b2-a0b7-48e5-8ca1-ba58f84db657 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.217338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e40b2-a0b7-48e5-8ca1-ba58f84db657 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-9a6e40b2-a0b7-48e5-8ca1-ba58f84db657 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:03.235713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:03.236719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:03.237603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:03.237603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:03.237603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:03.237603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:03.239886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 298/588] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:03.240924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e40b2-a0b7-48e5-8ca1-ba58f84db657 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.245941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a31af5-766e-4121-89ff-f9ab11821dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.247013 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a31af5-766e-4121-89ff-f9ab11821dc3 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.247493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a31af5-766e-4121-89ff-f9ab11821dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.248016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a31af5-766e-4121-89ff-f9ab11821dc3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.251034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:03.256477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a31af5-766e-4121-89ff-f9ab11821dc3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.258156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a31af5-766e-4121-89ff-f9ab11821dc3 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-84a31af5-766e-4121-89ff-f9ab11821dc3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:03.273555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:03.274529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:03.275531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:03.275531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:03.275531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:03.275531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:03.275531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:03.275531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:03.275531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:03.275531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:03.275531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:50:03.275531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:03.278708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 291/589] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:50:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:03.279746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a31af5-766e-4121-89ff-f9ab11821dc3 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.319414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:03.372010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e40b2-a0b7-48e5-8ca1-ba58f84db657 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.415737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a696715-f62b-43d1-8048-56dee6b52a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.417477 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a696715-f62b-43d1-8048-56dee6b52a2c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.418243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a696715-f62b-43d1-8048-56dee6b52a2c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.418825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a696715-f62b-43d1-8048-56dee6b52a2c None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.419837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a696715-f62b-43d1-8048-56dee6b52a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:03.420469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a696715-f62b-43d1-8048-56dee6b52a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.422630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a696715-f62b-43d1-8048-56dee6b52a2c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.424327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a31af5-766e-4121-89ff-f9ab11821dc3 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.446165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 299/590] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:03.446165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a696715-f62b-43d1-8048-56dee6b52a2c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.469732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a8bb8-b5db-4d13-be18-270f574ac9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.470779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a8bb8-b5db-4d13-be18-270f574ac9cd None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.471237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a8bb8-b5db-4d13-be18-270f574ac9cd None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.471685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a8bb8-b5db-4d13-be18-270f574ac9cd None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.472647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a8bb8-b5db-4d13-be18-270f574ac9cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:03.473182 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a8bb8-b5db-4d13-be18-270f574ac9cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.475124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a8bb8-b5db-4d13-be18-270f574ac9cd None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.488824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 292/591] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:03.489966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a8bb8-b5db-4d13-be18-270f574ac9cd None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.534672 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:03.573704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a696715-f62b-43d1-8048-56dee6b52a2c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.582269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:03.600779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a8bb8-b5db-4d13-be18-270f574ac9cd None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.614588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7915b0-3778-4a60-a57d-e3e733534e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.615386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7915b0-3778-4a60-a57d-e3e733534e20 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.615586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7915b0-3778-4a60-a57d-e3e733534e20 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.615890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7915b0-3778-4a60-a57d-e3e733534e20 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.616738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7915b0-3778-4a60-a57d-e3e733534e20 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:03.617314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7915b0-3778-4a60-a57d-e3e733534e20 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.618611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7915b0-3778-4a60-a57d-e3e733534e20 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.639010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 300/592] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Jun 23 10:50:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:03.639524 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4207271-6e8d-45e4-a95d-310b5082aca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.639960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7915b0-3778-4a60-a57d-e3e733534e20 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.640901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4207271-6e8d-45e4-a95d-310b5082aca4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.641379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4207271-6e8d-45e4-a95d-310b5082aca4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.641857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4207271-6e8d-45e4-a95d-310b5082aca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.649454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4207271-6e8d-45e4-a95d-310b5082aca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.651276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4207271-6e8d-45e4-a95d-310b5082aca4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-d4207271-6e8d-45e4-a95d-310b5082aca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:03.665931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:03.667400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:03.668311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:03.668311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:03.668311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:03.668311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:03.668311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:03.668311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:03.668311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:03.668311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:03.670712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 293/593] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:03.671697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4207271-6e8d-45e4-a95d-310b5082aca4 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.751224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7915b0-3778-4a60-a57d-e3e733534e20 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.775223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4207271-6e8d-45e4-a95d-310b5082aca4 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.776000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:03.787182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5337a-dd93-4055-9a03-7a60a3f2e582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.787909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5337a-dd93-4055-9a03-7a60a3f2e582 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.788198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5337a-dd93-4055-9a03-7a60a3f2e582 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.788537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc5337a-dd93-4055-9a03-7a60a3f2e582 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.796007 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5337a-dd93-4055-9a03-7a60a3f2e582 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.797460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc5337a-dd93-4055-9a03-7a60a3f2e582 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.812878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0ea46-c0e3-4246-9b4f-d0dcd3ad6765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-bbc5337a-dd93-4055-9a03-7a60a3f2e582 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:03.813867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:03.814789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:03.815709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:03.815709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:03.815709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:03.815709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:03.815709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:03.815709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:03.815709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:03.815709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:03.815709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:50:03.815709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:03.815709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 301/594] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:03 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:03.816853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5337a-dd93-4055-9a03-7a60a3f2e582 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.817162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0ea46-c0e3-4246-9b4f-d0dcd3ad6765 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.817648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0ea46-c0e3-4246-9b4f-d0dcd3ad6765 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.818112 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d0ea46-c0e3-4246-9b4f-d0dcd3ad6765 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.829605 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0ea46-c0e3-4246-9b4f-d0dcd3ad6765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.831357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d0ea46-c0e3-4246-9b4f-d0dcd3ad6765 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.839165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-85d0ea46-c0e3-4246-9b4f-d0dcd3ad6765 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:03.851354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:03.852974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:03.853852 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:03.853852 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:03.853852 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:03.853852 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:03.853852 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 294/595] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:03.854770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0ea46-c0e3-4246-9b4f-d0dcd3ad6765 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.925119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc5337a-dd93-4055-9a03-7a60a3f2e582 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.958572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d0ea46-c0e3-4246-9b4f-d0dcd3ad6765 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:03.962050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f73762-cb5a-4d79-9dd5-bb6f974e03e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.962715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f73762-cb5a-4d79-9dd5-bb6f974e03e9 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.963001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f73762-cb5a-4d79-9dd5-bb6f974e03e9 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.963282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f73762-cb5a-4d79-9dd5-bb6f974e03e9 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.964683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f73762-cb5a-4d79-9dd5-bb6f974e03e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:03.965057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f73762-cb5a-4d79-9dd5-bb6f974e03e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:03.966569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f73762-cb5a-4d79-9dd5-bb6f974e03e9 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:03.983941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 302/596] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:03.985058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f73762-cb5a-4d79-9dd5-bb6f974e03e9 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:03.996397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8adbcd-d107-4c28-bced-6457ff10afe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:03.997324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8adbcd-d107-4c28-bced-6457ff10afe3 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:03.997823 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8adbcd-d107-4c28-bced-6457ff10afe3 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:03.998239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8adbcd-d107-4c28-bced-6457ff10afe3 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:03.999306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8adbcd-d107-4c28-bced-6457ff10afe3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:03.999778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8adbcd-d107-4c28-bced-6457ff10afe3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.001538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8adbcd-d107-4c28-bced-6457ff10afe3 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.022122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 295/597] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Jun 23 10:50:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:04.023397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8adbcd-d107-4c28-bced-6457ff10afe3 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.037525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:04.096581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f73762-cb5a-4d79-9dd5-bb6f974e03e9 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.109900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:04.133317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e29f56-91b3-4161-b665-3003d40fee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.134215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e29f56-91b3-4161-b665-3003d40fee48 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.134501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e29f56-91b3-4161-b665-3003d40fee48 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.134781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e29f56-91b3-4161-b665-3003d40fee48 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.135405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8adbcd-d107-4c28-bced-6457ff10afe3 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.135665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e29f56-91b3-4161-b665-3003d40fee48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:04.136090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e29f56-91b3-4161-b665-3003d40fee48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.137507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e29f56-91b3-4161-b665-3003d40fee48 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.150629 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 303/598] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:04.152200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e29f56-91b3-4161-b665-3003d40fee48 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.174277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1ed28-874f-457c-acd9-4a975e02f6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.175548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ed28-874f-457c-acd9-4a975e02f6c6 None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.176050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ed28-874f-457c-acd9-4a975e02f6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.176502 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee1ed28-874f-457c-acd9-4a975e02f6c6 None admin] PATH_INFO: `/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/5211ed409a3f43d281bca44382aa03fe/roles/c14c06359c8649ceaef626fadcc1fc3a` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.191920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1ed28-874f-457c-acd9-4a975e02f6c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27530ca8f8e4156a519c726bd98c2a0, user_id=5211ed409a3f43d281bca44382aa03fe, role_id=c14c06359c8649ceaef626fadcc1fc3a)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.193650 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee1ed28-874f-457c-acd9-4a975e02f6c6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.258454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e29f56-91b3-4161-b665-3003d40fee48 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.260938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:04.281604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 296/599] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:50:04 2022] PUT /identity/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/5211ed409a3f43d281bca44382aa03fe/roles/c14c06359c8649ceaef626fadcc1fc3a => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:04.287216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1ed28-874f-457c-acd9-4a975e02f6c6 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.299837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32a036-d800-40d8-a8da-ad448b884686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.299837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32a036-d800-40d8-a8da-ad448b884686 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.299837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32a036-d800-40d8-a8da-ad448b884686 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.299837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d32a036-d800-40d8-a8da-ad448b884686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.312434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32a036-d800-40d8-a8da-ad448b884686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.313904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d32a036-d800-40d8-a8da-ad448b884686 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-1d32a036-d800-40d8-a8da-ad448b884686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:04.333066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:04.334118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:04.335006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:04.335006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:04.335006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:04.335006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:04.335006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 304/600] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:04.344252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32a036-d800-40d8-a8da-ad448b884686 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.486628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee1ed28-874f-457c-acd9-4a975e02f6c6 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.486827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d32a036-d800-40d8-a8da-ad448b884686 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.504216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:04.533620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0637ee37-df8a-44a3-816f-7717b06eaadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.534253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637ee37-df8a-44a3-816f-7717b06eaadb None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.534489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509682d0-a92d-4ffb-8f1b-9b6957bac9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.534621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637ee37-df8a-44a3-816f-7717b06eaadb None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.534811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0637ee37-df8a-44a3-816f-7717b06eaadb None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.535549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637ee37-df8a-44a3-816f-7717b06eaadb None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:04.535885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637ee37-df8a-44a3-816f-7717b06eaadb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.536244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509682d0-a92d-4ffb-8f1b-9b6957bac9db None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.536733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509682d0-a92d-4ffb-8f1b-9b6957bac9db None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.537211 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509682d0-a92d-4ffb-8f1b-9b6957bac9db None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.537311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0637ee37-df8a-44a3-816f-7717b06eaadb None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.546462 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509682d0-a92d-4ffb-8f1b-9b6957bac9db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.548299 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509682d0-a92d-4ffb-8f1b-9b6957bac9db None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.551745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 305/601] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:04.553146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44103f26-4a0c-42fe-ae2a-7df9f25009ce None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.553445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44103f26-4a0c-42fe-ae2a-7df9f25009ce None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.553755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44103f26-4a0c-42fe-ae2a-7df9f25009ce None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.560203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 306/602] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:04.561178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44103f26-4a0c-42fe-ae2a-7df9f25009ce None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-509682d0-a92d-4ffb-8f1b-9b6957bac9db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:04.569093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:04.569974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:04.570826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:04.570826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:04.570826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:04.570826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:04.570826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:04.570826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:04.570826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:04.570826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:04.573425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 297/603] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:04.579268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68148fac-3e67-4153-b1bf-1a4177c93c3f None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.580043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68148fac-3e67-4153-b1bf-1a4177c93c3f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.580530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68148fac-3e67-4153-b1bf-1a4177c93c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.586444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:04.598700 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-68148fac-3e67-4153-b1bf-1a4177c93c3f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:04.600518 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-68148fac-3e67-4153-b1bf-1a4177c93c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:04.685859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 298/604] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:04.687103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68148fac-3e67-4153-b1bf-1a4177c93c3f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.709957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44103f26-4a0c-42fe-ae2a-7df9f25009ce None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.748208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72ed0d-dcf0-425f-9ca0-9961b27c3280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.749383 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72ed0d-dcf0-425f-9ca0-9961b27c3280 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.749925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72ed0d-dcf0-425f-9ca0-9961b27c3280 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.750393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72ed0d-dcf0-425f-9ca0-9961b27c3280 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.758170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72ed0d-dcf0-425f-9ca0-9961b27c3280 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.759909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72ed0d-dcf0-425f-9ca0-9961b27c3280 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-7e72ed0d-dcf0-425f-9ca0-9961b27c3280 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:04.775606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:04.776658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:04.777550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:04.777550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:04.777550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:04.777550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:04.777550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:04.777550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:04.777550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:04.777550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:04.780144 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 307/605] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:04.781284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72ed0d-dcf0-425f-9ca0-9961b27c3280 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.813245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:04.820635 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68148fac-3e67-4153-b1bf-1a4177c93c3f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.870198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cbb83-3ef4-4a24-9d48-4cdd20c60794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.872405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cbb83-3ef4-4a24-9d48-4cdd20c60794 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.872714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cbb83-3ef4-4a24-9d48-4cdd20c60794 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.872998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27cbb83-3ef4-4a24-9d48-4cdd20c60794 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.873860 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cbb83-3ef4-4a24-9d48-4cdd20c60794 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:04.874175 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cbb83-3ef4-4a24-9d48-4cdd20c60794 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:04.876315 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27cbb83-3ef4-4a24-9d48-4cdd20c60794 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:04.899199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 299/606] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:04.899199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cbb83-3ef4-4a24-9d48-4cdd20c60794 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:04.909138 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:04.933898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72ed0d-dcf0-425f-9ca0-9961b27c3280 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:04.972306 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd051f-2b29-4dd8-8f2f-842209ffab35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:04.973462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd051f-2b29-4dd8-8f2f-842209ffab35 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:04.973976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd051f-2b29-4dd8-8f2f-842209ffab35 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:04.974714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd051f-2b29-4dd8-8f2f-842209ffab35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:04.989261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd051f-2b29-4dd8-8f2f-842209ffab35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-6efd051f-2b29-4dd8-8f2f-842209ffab35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:04.997604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:04.998552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:04.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:04.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:04.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:04.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:04.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:04.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:04.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:04.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:04.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:04.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:04.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:04.999374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:05.006729 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 308/607] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:05.007948 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd051f-2b29-4dd8-8f2f-842209ffab35 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.031980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27cbb83-3ef4-4a24-9d48-4cdd20c60794 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.070447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fbeef-072d-49ce-b315-6d2feaddd1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.071028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fbeef-072d-49ce-b315-6d2feaddd1fb None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.071313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fbeef-072d-49ce-b315-6d2feaddd1fb None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.071593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137fbeef-072d-49ce-b315-6d2feaddd1fb None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.072469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fbeef-072d-49ce-b315-6d2feaddd1fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:05.072816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fbeef-072d-49ce-b315-6d2feaddd1fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.074259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137fbeef-072d-49ce-b315-6d2feaddd1fb None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.086851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 300/608] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:05.087691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fbeef-072d-49ce-b315-6d2feaddd1fb None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.112276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:05.133252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd051f-2b29-4dd8-8f2f-842209ffab35 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.169467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9d315-f71c-408c-93cb-808ea7e68086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.170362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9d315-f71c-408c-93cb-808ea7e68086 None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.170658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9d315-f71c-408c-93cb-808ea7e68086 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.170939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d9d315-f71c-408c-93cb-808ea7e68086 None admin] PATH_INFO: `/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/71539f69f3c8446ca7e9833d244d20fb/roles/c14c06359c8649ceaef626fadcc1fc3a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.174357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:05.187737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9d315-f71c-408c-93cb-808ea7e68086 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27530ca8f8e4156a519c726bd98c2a0, user_id=71539f69f3c8446ca7e9833d244d20fb, role_id=c14c06359c8649ceaef626fadcc1fc3a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.189269 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d9d315-f71c-408c-93cb-808ea7e68086 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.201503 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137fbeef-072d-49ce-b315-6d2feaddd1fb None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.236153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5887cc2-895e-4b3c-900a-1f8bc1e690d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.236821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5887cc2-895e-4b3c-900a-1f8bc1e690d0 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.237131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5887cc2-895e-4b3c-900a-1f8bc1e690d0 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.237383 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5887cc2-895e-4b3c-900a-1f8bc1e690d0 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.238123 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5887cc2-895e-4b3c-900a-1f8bc1e690d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:05.238431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5887cc2-895e-4b3c-900a-1f8bc1e690d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.239829 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5887cc2-895e-4b3c-900a-1f8bc1e690d0 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.248895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 301/609] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:50:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:05.249980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50421d41-197b-435d-a5ed-9f048ba11050 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.250291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50421d41-197b-435d-a5ed-9f048ba11050 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.250551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50421d41-197b-435d-a5ed-9f048ba11050 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.256046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 302/610] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:05.256046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50421d41-197b-435d-a5ed-9f048ba11050 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.303836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 309/611] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:50:05 2022] PUT /identity/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/71539f69f3c8446ca7e9833d244d20fb/roles/c14c06359c8649ceaef626fadcc1fc3a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:05.303836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9d315-f71c-408c-93cb-808ea7e68086 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.353696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:05.379651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50421d41-197b-435d-a5ed-9f048ba11050 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.424779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1194b1a-160c-4598-90a2-cfe38aa54139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.425908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1194b1a-160c-4598-90a2-cfe38aa54139 None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.426290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1194b1a-160c-4598-90a2-cfe38aa54139 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.426674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1194b1a-160c-4598-90a2-cfe38aa54139 None admin] PATH_INFO: `/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/2d903a8e2ce4489fa7f5b7479ff0b7a2/roles/c14c06359c8649ceaef626fadcc1fc3a` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.447331 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1194b1a-160c-4598-90a2-cfe38aa54139 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27530ca8f8e4156a519c726bd98c2a0, user_id=2d903a8e2ce4489fa7f5b7479ff0b7a2, role_id=c14c06359c8649ceaef626fadcc1fc3a)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.449501 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1194b1a-160c-4598-90a2-cfe38aa54139 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.460568 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d9d315-f71c-408c-93cb-808ea7e68086 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.507542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b1bef-efbf-4cca-9cda-d12a378ed5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.508453 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1bef-efbf-4cca-9cda-d12a378ed5b4 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.508741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1bef-efbf-4cca-9cda-d12a378ed5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.510215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48b1bef-efbf-4cca-9cda-d12a378ed5b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.526135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b1bef-efbf-4cca-9cda-d12a378ed5b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.526581 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 303/612] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:50:05 2022] PUT /identity/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/2d903a8e2ce4489fa7f5b7479ff0b7a2/roles/c14c06359c8649ceaef626fadcc1fc3a => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:05.527671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48b1bef-efbf-4cca-9cda-d12a378ed5b4 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.528178 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bb64b-1e55-4ea3-bebf-30962460f93a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.528582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bb64b-1e55-4ea3-bebf-30962460f93a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.528869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395bb64b-1e55-4ea3-bebf-30962460f93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-b48b1bef-efbf-4cca-9cda-d12a378ed5b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:05.547334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:05.548413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:05.549324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:05.549324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:05.549324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:05.549324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:05.549324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 310/613] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:05.549658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-395bb64b-1e55-4ea3-bebf-30962460f93a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:05.551940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-395bb64b-1e55-4ea3-bebf-30962460f93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:05.556589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b1bef-efbf-4cca-9cda-d12a378ed5b4 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.640268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:05.701255 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 304/614] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:05.736471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bb64b-1e55-4ea3-bebf-30962460f93a None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.762525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48b1bef-efbf-4cca-9cda-d12a378ed5b4 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.801096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5057d4-7cae-4f9f-8c4a-ea87f4a7a2c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.801832 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5057d4-7cae-4f9f-8c4a-ea87f4a7a2c1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.802119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5057d4-7cae-4f9f-8c4a-ea87f4a7a2c1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.802403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5057d4-7cae-4f9f-8c4a-ea87f4a7a2c1 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.803191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5057d4-7cae-4f9f-8c4a-ea87f4a7a2c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:05.803504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5057d4-7cae-4f9f-8c4a-ea87f4a7a2c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:05.804924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5057d4-7cae-4f9f-8c4a-ea87f4a7a2c1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:05.812013 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:05.819298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 311/615] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:05.826914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5057d4-7cae-4f9f-8c4a-ea87f4a7a2c1 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.880708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395bb64b-1e55-4ea3-bebf-30962460f93a None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:05.919247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078a555-dd0f-4fb3-af8d-6d34a461ee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:05.920314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078a555-dd0f-4fb3-af8d-6d34a461ee9d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:05.920868 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078a555-dd0f-4fb3-af8d-6d34a461ee9d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:05.921358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078a555-dd0f-4fb3-af8d-6d34a461ee9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:05.934313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4078a555-dd0f-4fb3-af8d-6d34a461ee9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-4078a555-dd0f-4fb3-af8d-6d34a461ee9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:05.942943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:05.944165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:05.945188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:05.945188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:05.945188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:05.945188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:05.945188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:05.945188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:05.945188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:05.945188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:05.945188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:05.945188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:05.945188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:05.945188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:05.947538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 305/616] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:05.953008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078a555-dd0f-4fb3-af8d-6d34a461ee9d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:05.956486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:05.969823 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5057d4-7cae-4f9f-8c4a-ea87f4a7a2c1 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.041995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39890d54-e886-4049-a4fa-350979ba3c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:06.043060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39890d54-e886-4049-a4fa-350979ba3c88 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.043757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39890d54-e886-4049-a4fa-350979ba3c88 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.044210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39890d54-e886-4049-a4fa-350979ba3c88 None admin] PATH_INFO: `/v3/users/nova` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.061230 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39890d54-e886-4049-a4fa-350979ba3c88 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:06.063123 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39890d54-e886-4049-a4fa-350979ba3c88 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-39890d54-e886-4049-a4fa-350979ba3c88 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:06.094050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:06.095259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:06.096440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:06.096440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:06.096440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:06.096440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:06.096440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:06.096440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:06.096440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:06.096440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:06.096440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:50:06.096440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:06.109174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 312/617] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Jun 23 10:50:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:06.113745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39890d54-e886-4049-a4fa-350979ba3c88 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:06.186987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078a555-dd0f-4fb3-af8d-6d34a461ee9d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.225193 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:06.263410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39890d54-e886-4049-a4fa-350979ba3c88 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.268597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e19d2-f69f-4aaf-9706-16fb3089b943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:06.269399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e19d2-f69f-4aaf-9706-16fb3089b943 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.269789 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e19d2-f69f-4aaf-9706-16fb3089b943 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.270173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e19d2-f69f-4aaf-9706-16fb3089b943 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.271027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e19d2-f69f-4aaf-9706-16fb3089b943 None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:06.271408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e19d2-f69f-4aaf-9706-16fb3089b943 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:06.273219 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e19d2-f69f-4aaf-9706-16fb3089b943 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:06.294503 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 306/618] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:50:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:06.299435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e19d2-f69f-4aaf-9706-16fb3089b943 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:06.303171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1de88-6d61-4996-a7a5-0e102d53e818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:06.304207 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1de88-6d61-4996-a7a5-0e102d53e818 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.304676 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1de88-6d61-4996-a7a5-0e102d53e818 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.305135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1de88-6d61-4996-a7a5-0e102d53e818 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.306187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1de88-6d61-4996-a7a5-0e102d53e818 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:06.306703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1de88-6d61-4996-a7a5-0e102d53e818 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:06.308912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1de88-6d61-4996-a7a5-0e102d53e818 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:06.328202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 313/619] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Jun 23 10:50:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:06.333880 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1de88-6d61-4996-a7a5-0e102d53e818 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:06.353328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:06.447023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1de88-6d61-4996-a7a5-0e102d53e818 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.484244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6657b390-8914-47c4-9520-e4d7729ac2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:06.485223 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657b390-8914-47c4-9520-e4d7729ac2d8 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.485696 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657b390-8914-47c4-9520-e4d7729ac2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.486156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6657b390-8914-47c4-9520-e4d7729ac2d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.521652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e19d2-f69f-4aaf-9706-16fb3089b943 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.562124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657b390-8914-47c4-9520-e4d7729ac2d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:06.564112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6657b390-8914-47c4-9520-e4d7729ac2d8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:06.584061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:06.595664 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89f369b-5eac-4808-ba93-b91328ae1c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:06.596547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f369b-5eac-4808-ba93-b91328ae1c21 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.596836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f369b-5eac-4808-ba93-b91328ae1c21 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.597115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89f369b-5eac-4808-ba93-b91328ae1c21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.608844 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f369b-5eac-4808-ba93-b91328ae1c21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:06.610517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89f369b-5eac-4808-ba93-b91328ae1c21 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-e89f369b-5eac-4808-ba93-b91328ae1c21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:06.631668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:06.632646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:06.633540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:06.633540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:06.633540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:06.633540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:06.636614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 307/620] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:06.638320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b84ac-4197-4b17-88e0-2bd1e7829cb5 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.638778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b84ac-4197-4b17-88e0-2bd1e7829cb5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.639540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b84ac-4197-4b17-88e0-2bd1e7829cb5 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.641795 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 308/621] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:06.642647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b84ac-4197-4b17-88e0-2bd1e7829cb5 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:06.686279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:06.694115 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 314/622] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 23 10:50:06.694115 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08356c-9991-482c-bfa1-b6184ac411a7 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.694115 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08356c-9991-482c-bfa1-b6184ac411a7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.694115 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08356c-9991-482c-bfa1-b6184ac411a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.709623 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-8b08356c-9991-482c-bfa1-b6184ac411a7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:06.710825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8b08356c-9991-482c-bfa1-b6184ac411a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:06.785309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b84ac-4197-4b17-88e0-2bd1e7829cb5 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.790013 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 315/623] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:06.796632 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08356c-9991-482c-bfa1-b6184ac411a7 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:06.825642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a007deb-dda3-44d6-89e4-c1a9ae04bc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:06.826949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a007deb-dda3-44d6-89e4-c1a9ae04bc3e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.828010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a007deb-dda3-44d6-89e4-c1a9ae04bc3e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.828327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a007deb-dda3-44d6-89e4-c1a9ae04bc3e None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:06.829072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a007deb-dda3-44d6-89e4-c1a9ae04bc3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:06.829383 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a007deb-dda3-44d6-89e4-c1a9ae04bc3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:06.830769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a007deb-dda3-44d6-89e4-c1a9ae04bc3e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:06.847904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 309/624] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:06.849566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a007deb-dda3-44d6-89e4-c1a9ae04bc3e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:06.872756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:06.942974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08356c-9991-482c-bfa1-b6184ac411a7 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.961682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:06.972946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a007deb-dda3-44d6-89e4-c1a9ae04bc3e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:06.990375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c5bbc-2aa3-4d8f-a1ab-3978fc54e224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:06.991179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c5bbc-2aa3-4d8f-a1ab-3978fc54e224 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:06.991463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c5bbc-2aa3-4d8f-a1ab-3978fc54e224 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:06.991738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c5bbc-2aa3-4d8f-a1ab-3978fc54e224 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.006712 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c5bbc-2aa3-4d8f-a1ab-3978fc54e224 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.008469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210c5bbc-2aa3-4d8f-a1ab-3978fc54e224 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.015129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3c5e3-20df-4965-bf7e-865dceb4e26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.016353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3c5e3-20df-4965-bf7e-865dceb4e26c None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.016841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3c5e3-20df-4965-bf7e-865dceb4e26c None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.017387 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3c5e3-20df-4965-bf7e-865dceb4e26c None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.029340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3c5e3-20df-4965-bf7e-865dceb4e26c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-210c5bbc-2aa3-4d8f-a1ab-3978fc54e224 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:07.029608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:07.030468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:07.031353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:07.031353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:07.031353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:07.031353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:07.035313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 316/625] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:07.036163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c5bbc-2aa3-4d8f-a1ab-3978fc54e224 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-d2f3c5e3-20df-4965-bf7e-865dceb4e26c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:07.040815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:07.041792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:07.042657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:07.042657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:07.042657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:07.042657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:07.042657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:07.042657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:07.042657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:07.042657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:07.042657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:07.042657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:07.042657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:07.042657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:07.045446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 310/626] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:07.046435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3c5e3-20df-4965-bf7e-865dceb4e26c None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.155033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:07.159230 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210c5bbc-2aa3-4d8f-a1ab-3978fc54e224 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.173695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3c5e3-20df-4965-bf7e-865dceb4e26c None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.197091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e50961-91ec-442c-b386-790ea34286d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.198743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e50961-91ec-442c-b386-790ea34286d9 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.199258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e50961-91ec-442c-b386-790ea34286d9 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.199741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e50961-91ec-442c-b386-790ea34286d9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.207674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e50961-91ec-442c-b386-790ea34286d9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.209424 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e50961-91ec-442c-b386-790ea34286d9 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.217529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe31079-a261-4c94-bf24-80d4de455233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.218153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe31079-a261-4c94-bf24-80d4de455233 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.218414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe31079-a261-4c94-bf24-80d4de455233 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.218694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe31079-a261-4c94-bf24-80d4de455233 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.219415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe31079-a261-4c94-bf24-80d4de455233 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:07.219725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe31079-a261-4c94-bf24-80d4de455233 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.221137 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe31079-a261-4c94-bf24-80d4de455233 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-79e50961-91ec-442c-b386-790ea34286d9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:07.227235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:07.228198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:07.229718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:07.229718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:07.229718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:07.229718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:07.229718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:07.229718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:07.229718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:07.229718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:07.229718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:50:07.229718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:07.232189 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 317/627] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:07.233205 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e50961-91ec-442c-b386-790ea34286d9 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.238915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 311/628] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:07.240903 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe31079-a261-4c94-bf24-80d4de455233 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.259356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:07.364403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e50961-91ec-442c-b386-790ea34286d9 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.364998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe31079-a261-4c94-bf24-80d4de455233 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.404468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19685e1b-b529-44a3-aa4d-a37323bb18cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.405640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19685e1b-b529-44a3-aa4d-a37323bb18cf None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.406169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19685e1b-b529-44a3-aa4d-a37323bb18cf None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.406657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19685e1b-b529-44a3-aa4d-a37323bb18cf None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.407718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19685e1b-b529-44a3-aa4d-a37323bb18cf None admin] RBAC: Adding query filter params (name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:07.408364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19685e1b-b529-44a3-aa4d-a37323bb18cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.410090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19685e1b-b529-44a3-aa4d-a37323bb18cf None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.413945 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f1ad9-efa9-4710-969f-f4adaf3027b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.414620 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1ad9-efa9-4710-969f-f4adaf3027b7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.414965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1ad9-efa9-4710-969f-f4adaf3027b7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.415251 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9f1ad9-efa9-4710-969f-f4adaf3027b7 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.416141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f1ad9-efa9-4710-969f-f4adaf3027b7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:07.416489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f1ad9-efa9-4710-969f-f4adaf3027b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.418601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9f1ad9-efa9-4710-969f-f4adaf3027b7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.422164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 318/629] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:07.423360 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19685e1b-b529-44a3-aa4d-a37323bb18cf None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.445546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 312/630] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:07.446405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f1ad9-efa9-4710-969f-f4adaf3027b7 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.452152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:07.530513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:07.563091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19685e1b-b529-44a3-aa4d-a37323bb18cf None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.575204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9f1ad9-efa9-4710-969f-f4adaf3027b7 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.609435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe627379-74fb-47a7-8e72-39af24340af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.610582 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe627379-74fb-47a7-8e72-39af24340af3 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.611067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe627379-74fb-47a7-8e72-39af24340af3 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.611547 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe627379-74fb-47a7-8e72-39af24340af3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.618137 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970d072-5a5c-476c-8a5f-6763e13631e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.619072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970d072-5a5c-476c-8a5f-6763e13631e7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.619361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970d072-5a5c-476c-8a5f-6763e13631e7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.620179 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970d072-5a5c-476c-8a5f-6763e13631e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.620457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe627379-74fb-47a7-8e72-39af24340af3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.622127 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe627379-74fb-47a7-8e72-39af24340af3 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.632326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970d072-5a5c-476c-8a5f-6763e13631e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.633907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970d072-5a5c-476c-8a5f-6763e13631e7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-fe627379-74fb-47a7-8e72-39af24340af3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:07.638045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:07.638933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:07.639825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:07.639825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:07.639825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:07.639825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:07.639825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:07.639825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:07.639825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:07.639825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:07.642344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 319/631] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:07.643445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe627379-74fb-47a7-8e72-39af24340af3 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-4970d072-5a5c-476c-8a5f-6763e13631e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:07.654741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:07.655666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:07.657023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:07.657023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:07.657023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:07.657023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:07.659882 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 313/632] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:07.662277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970d072-5a5c-476c-8a5f-6763e13631e7 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.744160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:07.766452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe627379-74fb-47a7-8e72-39af24340af3 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.770303 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970d072-5a5c-476c-8a5f-6763e13631e7 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.794021 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:07.803145 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e0070-2518-445f-a9d1-3878222ecf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.804153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e0070-2518-445f-a9d1-3878222ecf83 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.804636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e0070-2518-445f-a9d1-3878222ecf83 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.804729 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e0070-2518-445f-a9d1-3878222ecf83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.806047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52dde1-3524-4d76-bb25-7f5db63d58a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.806711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52dde1-3524-4d76-bb25-7f5db63d58a9 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.807517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52dde1-3524-4d76-bb25-7f5db63d58a9 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.807802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b52dde1-3524-4d76-bb25-7f5db63d58a9 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.808623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52dde1-3524-4d76-bb25-7f5db63d58a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:07.808933 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52dde1-3524-4d76-bb25-7f5db63d58a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.810474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b52dde1-3524-4d76-bb25-7f5db63d58a9 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.817194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e0070-2518-445f-a9d1-3878222ecf83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.818705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e0070-2518-445f-a9d1-3878222ecf83 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.827172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 314/633] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:07.827969 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52dde1-3524-4d76-bb25-7f5db63d58a9 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-592e0070-2518-445f-a9d1-3878222ecf83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:07.837923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:07.839559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:07.840504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:07.840504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:07.840504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:07.840504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:07.840504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 320/634] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:07.841146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856b60c-d7f4-475b-9e03-c36d160422db None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.841146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856b60c-d7f4-475b-9e03-c36d160422db None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.841425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8856b60c-d7f4-475b-9e03-c36d160422db None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.842831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 321/635] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:07.847565 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856b60c-d7f4-475b-9e03-c36d160422db None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.939481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b52dde1-3524-4d76-bb25-7f5db63d58a9 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.950723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8856b60c-d7f4-475b-9e03-c36d160422db None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:07.973186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42248059-ad88-43ee-adce-5e276087b363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.973838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42248059-ad88-43ee-adce-5e276087b363 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.974116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42248059-ad88-43ee-adce-5e276087b363 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.974643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42248059-ad88-43ee-adce-5e276087b363 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.975349 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42248059-ad88-43ee-adce-5e276087b363 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:07.975651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42248059-ad88-43ee-adce-5e276087b363 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.977061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42248059-ad88-43ee-adce-5e276087b363 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:07.979835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:07.988790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e24a89f-b222-4696-97d9-9f955e207a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:07.993315 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 315/636] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:07.993482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24a89f-b222-4696-97d9-9f955e207a26 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:07.993913 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42248059-ad88-43ee-adce-5e276087b363 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:07.994000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24a89f-b222-4696-97d9-9f955e207a26 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:07.994000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e24a89f-b222-4696-97d9-9f955e207a26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:07.994000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24a89f-b222-4696-97d9-9f955e207a26 None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=a020e7fe06574a108b46f9f48bddc4e4) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:07.994000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24a89f-b222-4696-97d9-9f955e207a26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:07.994000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e24a89f-b222-4696-97d9-9f955e207a26 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:08.000067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 322/637] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/role_assignments?user.id=a020e7fe06574a108b46f9f48bddc4e4&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:08.001406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8de4-4b2a-4287-a935-fbcf5a640d77 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.002221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8de4-4b2a-4287-a935-fbcf5a640d77 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.002518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c8de4-4b2a-4287-a935-fbcf5a640d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.026407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-273c8de4-4b2a-4287-a935-fbcf5a640d77 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:08.028464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-273c8de4-4b2a-4287-a935-fbcf5a640d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:08.040290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:08.108118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 323/638] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:08.109893 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee14834-432f-40a1-95bc-1b66ba4d7815 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.110251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee14834-432f-40a1-95bc-1b66ba4d7815 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.110634 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee14834-432f-40a1-95bc-1b66ba4d7815 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.115850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 324/639] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:08.115850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee14834-432f-40a1-95bc-1b66ba4d7815 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.131780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42248059-ad88-43ee-adce-5e276087b363 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.178442 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3495d9a-0679-4bef-81d8-eec179c92ddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.179109 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3495d9a-0679-4bef-81d8-eec179c92ddc None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.179381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3495d9a-0679-4bef-81d8-eec179c92ddc None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.179652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3495d9a-0679-4bef-81d8-eec179c92ddc None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.180405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3495d9a-0679-4bef-81d8-eec179c92ddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:08.180713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3495d9a-0679-4bef-81d8-eec179c92ddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:08.182775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3495d9a-0679-4bef-81d8-eec179c92ddc None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:08.196550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 316/640] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:08.198190 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78e86a-9b28-4505-a6a6-6e19a566dc5a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.198578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78e86a-9b28-4505-a6a6-6e19a566dc5a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.198794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd78e86a-9b28-4505-a6a6-6e19a566dc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.216865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-dd78e86a-9b28-4505-a6a6-6e19a566dc5a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:08.218066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-dd78e86a-9b28-4505-a6a6-6e19a566dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:08.241860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee14834-432f-40a1-95bc-1b66ba4d7815 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.273212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:08.282442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ab5c-de46-4024-b7a8-acab7f753b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.283236 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ab5c-de46-4024-b7a8-acab7f753b5e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.283517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ab5c-de46-4024-b7a8-acab7f753b5e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.283797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c7ab5c-de46-4024-b7a8-acab7f753b5e None admin] PATH_INFO: `/v3/users/glance` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.291216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 317/641] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:08.291514 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7ab5c-de46-4024-b7a8-acab7f753b5e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:08.292769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c7ab5c-de46-4024-b7a8-acab7f753b5e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:08.296308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78e86a-9b28-4505-a6a6-6e19a566dc5a None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-21c7ab5c-de46-4024-b7a8-acab7f753b5e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:08.308379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:08.309550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:08.310495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:08.310495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:08.310495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:08.310495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:08.310495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:08.310495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:08.310495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:08.310495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:08.310495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 23 10:50:08.310495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:08.310495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 325/642] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:08.311081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ab5c-de46-4024-b7a8-acab7f753b5e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.335078 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:08.413154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd78e86a-9b28-4505-a6a6-6e19a566dc5a None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.419601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c7ab5c-de46-4024-b7a8-acab7f753b5e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.449978 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6617d-7fc2-466b-9598-2a81d907c480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.450766 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6617d-7fc2-466b-9598-2a81d907c480 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.451049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6617d-7fc2-466b-9598-2a81d907c480 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.451328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be6617d-7fc2-466b-9598-2a81d907c480 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.458264 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957880-a173-490d-b08d-cfdd6c36088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.459057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957880-a173-490d-b08d-cfdd6c36088e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.459337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957880-a173-490d-b08d-cfdd6c36088e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.459612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7957880-a173-490d-b08d-cfdd6c36088e None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.462176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be6617d-7fc2-466b-9598-2a81d907c480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:08.466763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7957880-a173-490d-b08d-cfdd6c36088e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:08.468316 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7957880-a173-490d-b08d-cfdd6c36088e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-3be6617d-7fc2-466b-9598-2a81d907c480 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:08.469950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:08.471134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:08.472197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:08.472197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:08.472197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:08.472197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:08.472197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:08.472197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:08.472197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:08.472197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:08.472197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:08.472197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:08.472197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:08.472197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:08.476145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 318/643] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:08.476982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6617d-7fc2-466b-9598-2a81d907c480 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-e7957880-a173-490d-b08d-cfdd6c36088e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:08.485666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:08.486574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:08.487641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:08.487641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:08.487641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:08.487641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:08.487641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:08.487641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:08.487641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:08.487641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:08.487641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 326/644] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:08.487641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957880-a173-490d-b08d-cfdd6c36088e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.540054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:08.584354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:08.594508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be6617d-7fc2-466b-9598-2a81d907c480 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.601960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7957880-a173-490d-b08d-cfdd6c36088e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.631497 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c94eb3-e602-40cc-b744-369ff77eef36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.632311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c94eb3-e602-40cc-b744-369ff77eef36 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.632589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c94eb3-e602-40cc-b744-369ff77eef36 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.632864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c94eb3-e602-40cc-b744-369ff77eef36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.638031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda2fcd-0081-4610-b023-ac56f24edeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.638888 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda2fcd-0081-4610-b023-ac56f24edeb6 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.639177 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda2fcd-0081-4610-b023-ac56f24edeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.639456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda2fcd-0081-4610-b023-ac56f24edeb6 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.640333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda2fcd-0081-4610-b023-ac56f24edeb6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:08.640654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda2fcd-0081-4610-b023-ac56f24edeb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:08.642162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda2fcd-0081-4610-b023-ac56f24edeb6 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:08.643378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c94eb3-e602-40cc-b744-369ff77eef36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-93c94eb3-e602-40cc-b744-369ff77eef36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:08.651623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:08.652575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:08.653402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 319/645] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:08.654073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c94eb3-e602-40cc-b744-369ff77eef36 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.664031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 327/646] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:08.665124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda2fcd-0081-4610-b023-ac56f24edeb6 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.771168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c94eb3-e602-40cc-b744-369ff77eef36 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.777299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda2fcd-0081-4610-b023-ac56f24edeb6 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.780821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:08.808633 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d4575-0b25-4da9-b205-aaaa9e30a369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.809301 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d4575-0b25-4da9-b205-aaaa9e30a369 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.809720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d4575-0b25-4da9-b205-aaaa9e30a369 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.810062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d4575-0b25-4da9-b205-aaaa9e30a369 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.810904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d4575-0b25-4da9-b205-aaaa9e30a369 None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:08.811207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d4575-0b25-4da9-b205-aaaa9e30a369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:08.812377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d9c26-4bd0-4c9a-b07b-0c98bf38ba1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.812731 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d4575-0b25-4da9-b205-aaaa9e30a369 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:08.813042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d9c26-4bd0-4c9a-b07b-0c98bf38ba1e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.813370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d9c26-4bd0-4c9a-b07b-0c98bf38ba1e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.813653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d9c26-4bd0-4c9a-b07b-0c98bf38ba1e None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.814553 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d9c26-4bd0-4c9a-b07b-0c98bf38ba1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:08.815541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d9c26-4bd0-4c9a-b07b-0c98bf38ba1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:08.817470 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888d9c26-4bd0-4c9a-b07b-0c98bf38ba1e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:08.826289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 320/647] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:08.827099 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d4575-0b25-4da9-b205-aaaa9e30a369 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.831324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 328/648] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:08.832196 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d9c26-4bd0-4c9a-b07b-0c98bf38ba1e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:08.846844 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:08.941153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d4575-0b25-4da9-b205-aaaa9e30a369 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.946645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d9c26-4bd0-4c9a-b07b-0c98bf38ba1e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:08.983009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5230e0-5828-4d50-89f9-74c06a50e5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.983209 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6831c51-f820-4b9f-a305-1a2e3c6d80da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:08.983653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5230e0-5828-4d50-89f9-74c06a50e5cf None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.983895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6831c51-f820-4b9f-a305-1a2e3c6d80da None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:08.984038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5230e0-5828-4d50-89f9-74c06a50e5cf None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.984247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6831c51-f820-4b9f-a305-1a2e3c6d80da None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:08.984343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5230e0-5828-4d50-89f9-74c06a50e5cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.984504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6831c51-f820-4b9f-a305-1a2e3c6d80da None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:08.985699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6831c51-f820-4b9f-a305-1a2e3c6d80da None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:08.986054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6831c51-f820-4b9f-a305-1a2e3c6d80da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:08.988511 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6831c51-f820-4b9f-a305-1a2e3c6d80da None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.002408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 321/649] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:09.002408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6831c51-f820-4b9f-a305-1a2e3c6d80da None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.021300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:09.064167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5230e0-5828-4d50-89f9-74c06a50e5cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.065763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5230e0-5828-4d50-89f9-74c06a50e5cf None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.082465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:09.107435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6831c51-f820-4b9f-a305-1a2e3c6d80da None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.145821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88011d79-9f1a-4eb4-a4a5-8bb6b73cebdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.146876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88011d79-9f1a-4eb4-a4a5-8bb6b73cebdc None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.147443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88011d79-9f1a-4eb4-a4a5-8bb6b73cebdc None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.147730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88011d79-9f1a-4eb4-a4a5-8bb6b73cebdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.162716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88011d79-9f1a-4eb4-a4a5-8bb6b73cebdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.165131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88011d79-9f1a-4eb4-a4a5-8bb6b73cebdc None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.173398 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 329/650] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:09.173398 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5230e0-5828-4d50-89f9-74c06a50e5cf None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-88011d79-9f1a-4eb4-a4a5-8bb6b73cebdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:09.188723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:09.189680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:09.195468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:09.195468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:09.195468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:09.195468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:09.195468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 322/651] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:09.195468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88011d79-9f1a-4eb4-a4a5-8bb6b73cebdc None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.234746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:09.275426 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5230e0-5828-4d50-89f9-74c06a50e5cf None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.310012 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88011d79-9f1a-4eb4-a4a5-8bb6b73cebdc None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.318212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703ecc1-0ed3-4f21-99e1-44541b09fac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.318996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703ecc1-0ed3-4f21-99e1-44541b09fac8 None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.319282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703ecc1-0ed3-4f21-99e1-44541b09fac8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.319561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703ecc1-0ed3-4f21-99e1-44541b09fac8 None admin] PATH_INFO: `/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/dd54976bc4b541a89a0c15788bfb71ed/roles/c14c06359c8649ceaef626fadcc1fc3a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.335236 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703ecc1-0ed3-4f21-99e1-44541b09fac8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27530ca8f8e4156a519c726bd98c2a0, user_id=dd54976bc4b541a89a0c15788bfb71ed, role_id=c14c06359c8649ceaef626fadcc1fc3a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.336741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703ecc1-0ed3-4f21-99e1-44541b09fac8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.342156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:09.349927 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e726a6-7440-4634-b47a-32db6c971e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.350770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e726a6-7440-4634-b47a-32db6c971e32 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.351058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e726a6-7440-4634-b47a-32db6c971e32 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.351338 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e726a6-7440-4634-b47a-32db6c971e32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.362094 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e726a6-7440-4634-b47a-32db6c971e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.363552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e726a6-7440-4634-b47a-32db6c971e32 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-24e726a6-7440-4634-b47a-32db6c971e32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:09.382946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:09.384098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:09.385085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:09.385085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:09.385085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:09.385085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:09.385085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 323/652] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:09.385085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e726a6-7440-4634-b47a-32db6c971e32 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.415841 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 330/653] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:50:09 2022] PUT /identity/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/dd54976bc4b541a89a0c15788bfb71ed/roles/c14c06359c8649ceaef626fadcc1fc3a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:09.415841 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703ecc1-0ed3-4f21-99e1-44541b09fac8 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.512487 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e726a6-7440-4634-b47a-32db6c971e32 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.559546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102da3e3-dcd0-4952-befc-fda4a7d6c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.561003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102da3e3-dcd0-4952-befc-fda4a7d6c808 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.561495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102da3e3-dcd0-4952-befc-fda4a7d6c808 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.562076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102da3e3-dcd0-4952-befc-fda4a7d6c808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.575881 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102da3e3-dcd0-4952-befc-fda4a7d6c808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.577750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102da3e3-dcd0-4952-befc-fda4a7d6c808 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-102da3e3-dcd0-4952-befc-fda4a7d6c808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:09.597784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:09.598724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:09.599902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:09.599902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:09.599902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:09.599902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:09.600137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703ecc1-0ed3-4f21-99e1-44541b09fac8 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.602177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 324/654] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:09.603225 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102da3e3-dcd0-4952-befc-fda4a7d6c808 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.618760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:09.640527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:09.642077 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d8269-7676-4ea9-9b2e-484e1c243bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.642759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8269-7676-4ea9-9b2e-484e1c243bca None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.643049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8269-7676-4ea9-9b2e-484e1c243bca None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.643331 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6d8269-7676-4ea9-9b2e-484e1c243bca None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.644173 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d8269-7676-4ea9-9b2e-484e1c243bca None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:09.644444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d8269-7676-4ea9-9b2e-484e1c243bca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.646126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6d8269-7676-4ea9-9b2e-484e1c243bca None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.662023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 331/655] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:09.663162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d8269-7676-4ea9-9b2e-484e1c243bca None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.738093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102da3e3-dcd0-4952-befc-fda4a7d6c808 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.775737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6d8269-7676-4ea9-9b2e-484e1c243bca None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.781774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb819cd-7906-4da6-a526-489b4057175d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.782444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb819cd-7906-4da6-a526-489b4057175d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.782727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb819cd-7906-4da6-a526-489b4057175d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.783007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb819cd-7906-4da6-a526-489b4057175d None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.784182 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb819cd-7906-4da6-a526-489b4057175d None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:09.784498 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb819cd-7906-4da6-a526-489b4057175d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.785888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb819cd-7906-4da6-a526-489b4057175d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.803912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 325/656] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:09.804842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb819cd-7906-4da6-a526-489b4057175d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.821805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763e66d-ee1c-4ad1-a883-7da43c2f9649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.822504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e66d-ee1c-4ad1-a883-7da43c2f9649 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.823732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e66d-ee1c-4ad1-a883-7da43c2f9649 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.824055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d763e66d-ee1c-4ad1-a883-7da43c2f9649 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.825362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763e66d-ee1c-4ad1-a883-7da43c2f9649 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:09.825688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763e66d-ee1c-4ad1-a883-7da43c2f9649 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.827541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d763e66d-ee1c-4ad1-a883-7da43c2f9649 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:09.844904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 332/657] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:09.846000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763e66d-ee1c-4ad1-a883-7da43c2f9649 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:09.891210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:09.938657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb819cd-7906-4da6-a526-489b4057175d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.974898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:09.978276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d763e66d-ee1c-4ad1-a883-7da43c2f9649 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:09.981713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043d09c-955b-4118-a2f0-2ab71ff8a6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:09.982543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043d09c-955b-4118-a2f0-2ab71ff8a6f0 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:09.982951 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043d09c-955b-4118-a2f0-2ab71ff8a6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:09.983237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043d09c-955b-4118-a2f0-2ab71ff8a6f0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:09.991103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043d09c-955b-4118-a2f0-2ab71ff8a6f0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:09.992728 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043d09c-955b-4118-a2f0-2ab71ff8a6f0 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-0043d09c-955b-4118-a2f0-2ab71ff8a6f0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:10.008479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:10.009473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:10.010448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:10.010448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:10.010448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:10.010448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:10.010448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:10.010448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:10.010448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:10.010448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:10.010448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:50:10.010448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:10.014586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 326/658] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:50:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:10.015649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043d09c-955b-4118-a2f0-2ab71ff8a6f0 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.028342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c13d2a-67b4-4ba3-a433-cef326700c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.030301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c13d2a-67b4-4ba3-a433-cef326700c3b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.030792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c13d2a-67b4-4ba3-a433-cef326700c3b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.031618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c13d2a-67b4-4ba3-a433-cef326700c3b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.041006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c13d2a-67b4-4ba3-a433-cef326700c3b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.042864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c13d2a-67b4-4ba3-a433-cef326700c3b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-a4c13d2a-67b4-4ba3-a433-cef326700c3b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:10.059579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:10.060618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:10.061554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:10.061554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:10.061554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:10.061554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:10.061554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:10.061554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:10.061554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:10.061554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:10.061554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 23 10:50:10.061554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:10.068586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 333/659] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:10.069833 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c13d2a-67b4-4ba3-a433-cef326700c3b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.127072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043d09c-955b-4118-a2f0-2ab71ff8a6f0 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.166427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538302-6500-4f38-a271-21acefaf59d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.167743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538302-6500-4f38-a271-21acefaf59d5 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.168054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538302-6500-4f38-a271-21acefaf59d5 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.168332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da538302-6500-4f38-a271-21acefaf59d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.172536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:10.175782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da538302-6500-4f38-a271-21acefaf59d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.177252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da538302-6500-4f38-a271-21acefaf59d5 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.180253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c13d2a-67b4-4ba3-a433-cef326700c3b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-da538302-6500-4f38-a271-21acefaf59d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:10.191038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:10.191985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:10.193479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:10.193479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:10.193479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:10.193479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:10.193479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:10.193479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:10.193479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:10.193479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:10.193479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 327/660] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:10.193479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538302-6500-4f38-a271-21acefaf59d5 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.210527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:10.221920 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dd0e4a-bac7-4fe3-9af4-482c07fade8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.224455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd0e4a-bac7-4fe3-9af4-482c07fade8f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.224455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd0e4a-bac7-4fe3-9af4-482c07fade8f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.224455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd0e4a-bac7-4fe3-9af4-482c07fade8f None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.224455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd0e4a-bac7-4fe3-9af4-482c07fade8f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:10.224834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd0e4a-bac7-4fe3-9af4-482c07fade8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.226220 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dd0e4a-bac7-4fe3-9af4-482c07fade8f None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.246604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 334/661] 10.222.0.52 () {56 vars in 1137 bytes} [Thu Jun 23 10:50:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:10.247970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e648f83-a485-4a7e-8c2d-8917f95e9bb5 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.248266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e648f83-a485-4a7e-8c2d-8917f95e9bb5 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.248546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e648f83-a485-4a7e-8c2d-8917f95e9bb5 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.249905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 335/662] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:10.250465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e648f83-a485-4a7e-8c2d-8917f95e9bb5 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.314129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da538302-6500-4f38-a271-21acefaf59d5 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.348947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09775d85-f10a-4ead-9e19-bfb16c7d92be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.349868 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09775d85-f10a-4ead-9e19-bfb16c7d92be None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.350153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09775d85-f10a-4ead-9e19-bfb16c7d92be None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.350430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09775d85-f10a-4ead-9e19-bfb16c7d92be None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.351415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09775d85-f10a-4ead-9e19-bfb16c7d92be None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:10.351577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09775d85-f10a-4ead-9e19-bfb16c7d92be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.353257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09775d85-f10a-4ead-9e19-bfb16c7d92be None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.361509 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e648f83-a485-4a7e-8c2d-8917f95e9bb5 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.376533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 328/663] 10.222.0.52 () {56 vars in 1139 bytes} [Thu Jun 23 10:50:10 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:10.377749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09775d85-f10a-4ead-9e19-bfb16c7d92be None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.403677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7692697-c18d-4f4a-81aa-8e187a0e1654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.404274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7692697-c18d-4f4a-81aa-8e187a0e1654 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.404559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7692697-c18d-4f4a-81aa-8e187a0e1654 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.405418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7692697-c18d-4f4a-81aa-8e187a0e1654 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.406233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7692697-c18d-4f4a-81aa-8e187a0e1654 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:10.406567 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7692697-c18d-4f4a-81aa-8e187a0e1654 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.408018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7692697-c18d-4f4a-81aa-8e187a0e1654 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.420977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 336/664] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:10.422280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef786ee-bf89-4e35-9a61-46863261e12b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.422575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef786ee-bf89-4e35-9a61-46863261e12b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.422858 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef786ee-bf89-4e35-9a61-46863261e12b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.440951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-eef786ee-bf89-4e35-9a61-46863261e12b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:10.442160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-eef786ee-bf89-4e35-9a61-46863261e12b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:10.450112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:10.461149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:10.492310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09775d85-f10a-4ead-9e19-bfb16c7d92be None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.513269 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 337/665] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:10.514305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef786ee-bf89-4e35-9a61-46863261e12b None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.543437 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d068a8-a98a-4b0d-ba6a-f00b6eb84a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.544113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d068a8-a98a-4b0d-ba6a-f00b6eb84a28 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.544399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d068a8-a98a-4b0d-ba6a-f00b6eb84a28 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.544672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d068a8-a98a-4b0d-ba6a-f00b6eb84a28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.622058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d068a8-a98a-4b0d-ba6a-f00b6eb84a28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.623628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d068a8-a98a-4b0d-ba6a-f00b6eb84a28 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.635912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef786ee-bf89-4e35-9a61-46863261e12b None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.676838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84baf2-e6ac-45c0-acd4-21eef046aa5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.677795 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84baf2-e6ac-45c0-acd4-21eef046aa5d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.677795 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84baf2-e6ac-45c0-acd4-21eef046aa5d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.678044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84baf2-e6ac-45c0-acd4-21eef046aa5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.691078 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:10.701594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:10.737988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 329/666] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:10.739648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d068a8-a98a-4b0d-ba6a-f00b6eb84a28 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.754217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84baf2-e6ac-45c0-acd4-21eef046aa5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.755671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84baf2-e6ac-45c0-acd4-21eef046aa5d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.850801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d068a8-a98a-4b0d-ba6a-f00b6eb84a28 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:10.872285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 338/667] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:10.873071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84baf2-e6ac-45c0-acd4-21eef046aa5d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.889121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c8866-4be8-4acd-9cb4-6e6db7f89c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:10.889780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c8866-4be8-4acd-9cb4-6e6db7f89c70 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:10.890070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c8866-4be8-4acd-9cb4-6e6db7f89c70 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:10.890425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262c8866-4be8-4acd-9cb4-6e6db7f89c70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:10.891261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c8866-4be8-4acd-9cb4-6e6db7f89c70 None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=5211ed409a3f43d281bca44382aa03fe) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:10.891601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c8866-4be8-4acd-9cb4-6e6db7f89c70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:10.893837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262c8866-4be8-4acd-9cb4-6e6db7f89c70 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:10.911925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 330/668] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:10 2022] GET /identity/v3/role_assignments?user.id=5211ed409a3f43d281bca44382aa03fe&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:10.911925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c8866-4be8-4acd-9cb4-6e6db7f89c70 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:10.939148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:10.957884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:11.014128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84baf2-e6ac-45c0-acd4-21eef046aa5d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.046312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262c8866-4be8-4acd-9cb4-6e6db7f89c70 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.054828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e72307-653e-4016-8584-7b0649a1a8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.055791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e72307-653e-4016-8584-7b0649a1a8e7 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.056232 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e72307-653e-4016-8584-7b0649a1a8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.056645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e72307-653e-4016-8584-7b0649a1a8e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.070144 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e72307-653e-4016-8584-7b0649a1a8e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-11e72307-653e-4016-8584-7b0649a1a8e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:11.078616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:11.079593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:11.080900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 339/669] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:50:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:11.082636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e72307-653e-4016-8584-7b0649a1a8e7 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.088859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c08d9-095d-412a-b44a-d48ae25bf108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.089711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c08d9-095d-412a-b44a-d48ae25bf108 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.089935 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c08d9-095d-412a-b44a-d48ae25bf108 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.090195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c08d9-095d-412a-b44a-d48ae25bf108 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.102973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c08d9-095d-412a-b44a-d48ae25bf108 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.105366 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328c08d9-095d-412a-b44a-d48ae25bf108 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-328c08d9-095d-412a-b44a-d48ae25bf108 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:11.124732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:11.125663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:11.126527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:11.126527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:11.126527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:11.126527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:11.128658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 331/670] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:11.129812 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c08d9-095d-412a-b44a-d48ae25bf108 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.212421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e72307-653e-4016-8584-7b0649a1a8e7 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.214829 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:11.245820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:11.255778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7431bf3-0509-4865-8026-2a2f88a05add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.256628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7431bf3-0509-4865-8026-2a2f88a05add None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.257220 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7431bf3-0509-4865-8026-2a2f88a05add None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.257575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7431bf3-0509-4865-8026-2a2f88a05add None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.266545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328c08d9-095d-412a-b44a-d48ae25bf108 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.271768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7431bf3-0509-4865-8026-2a2f88a05add None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.273408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7431bf3-0509-4865-8026-2a2f88a05add None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-d7431bf3-0509-4865-8026-2a2f88a05add None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:11.294549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:11.295679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:11.296763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:11.296763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:11.296763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:11.296763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:11.298430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 340/671] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:11.299370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7431bf3-0509-4865-8026-2a2f88a05add None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.310814 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f088b-da59-4fcc-bb40-3b4088e97e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.311708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f088b-da59-4fcc-bb40-3b4088e97e13 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.312167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f088b-da59-4fcc-bb40-3b4088e97e13 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.312613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f088b-da59-4fcc-bb40-3b4088e97e13 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.313495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f088b-da59-4fcc-bb40-3b4088e97e13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:11.314487 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f088b-da59-4fcc-bb40-3b4088e97e13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.316937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f088b-da59-4fcc-bb40-3b4088e97e13 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.332986 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 332/672] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:11.332986 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f088b-da59-4fcc-bb40-3b4088e97e13 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.440808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7431bf3-0509-4865-8026-2a2f88a05add None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.452543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f088b-da59-4fcc-bb40-3b4088e97e13 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.478526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6b066-057b-4ca3-8a5b-d20856acd8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.479260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6b066-057b-4ca3-8a5b-d20856acd8c3 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.479542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6b066-057b-4ca3-8a5b-d20856acd8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.479833 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6b066-057b-4ca3-8a5b-d20856acd8c3 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.480574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6b066-057b-4ca3-8a5b-d20856acd8c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:11.480882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6b066-057b-4ca3-8a5b-d20856acd8c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.482421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6b066-057b-4ca3-8a5b-d20856acd8c3 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.501705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 341/673] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:11.501705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6b066-057b-4ca3-8a5b-d20856acd8c3 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.506429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece8f13-711a-4ea5-a3ca-834418572525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.507336 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece8f13-711a-4ea5-a3ca-834418572525 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.515302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece8f13-711a-4ea5-a3ca-834418572525 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.515302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece8f13-711a-4ea5-a3ca-834418572525 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.515302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece8f13-711a-4ea5-a3ca-834418572525 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:11.515302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece8f13-711a-4ea5-a3ca-834418572525 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.515302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece8f13-711a-4ea5-a3ca-834418572525 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.520273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:11.528505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 333/674] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:11.529434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece8f13-711a-4ea5-a3ca-834418572525 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.541300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:11.630619 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6b066-057b-4ca3-8a5b-d20856acd8c3 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.646156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece8f13-711a-4ea5-a3ca-834418572525 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.668455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8e8f0-69b1-4f44-8c09-fec306e7a7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.669273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8e8f0-69b1-4f44-8c09-fec306e7a7c7 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.669558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8e8f0-69b1-4f44-8c09-fec306e7a7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.669928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c8e8f0-69b1-4f44-8c09-fec306e7a7c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.680886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8e8f0-69b1-4f44-8c09-fec306e7a7c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.681517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa9da7-a5a5-4ce5-aa82-bb1931bbef83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.682870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa9da7-a5a5-4ce5-aa82-bb1931bbef83 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.682972 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c8e8f0-69b1-4f44-8c09-fec306e7a7c7 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.683151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa9da7-a5a5-4ce5-aa82-bb1931bbef83 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.683425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa9da7-a5a5-4ce5-aa82-bb1931bbef83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.690636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa9da7-a5a5-4ce5-aa82-bb1931bbef83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.692212 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa9da7-a5a5-4ce5-aa82-bb1931bbef83 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-a5c8e8f0-69b1-4f44-8c09-fec306e7a7c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:11.701973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:11.702864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:11.708574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:11.708574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:11.708574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:11.708574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:11.708574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 342/675] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:11.708574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8e8f0-69b1-4f44-8c09-fec306e7a7c7 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-8cfa9da7-a5a5-4ce5-aa82-bb1931bbef83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:11.708922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:11.709723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:11.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:11.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:11.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:11.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:11.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:11.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:11.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:11.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:11.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 334/676] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:11.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0144a-7bfb-4f64-8fc2-5109e42b5d62 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0144a-7bfb-4f64-8fc2-5109e42b5d62 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.711210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f0144a-7bfb-4f64-8fc2-5109e42b5d62 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.716612 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 335/677] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:11.716612 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0144a-7bfb-4f64-8fc2-5109e42b5d62 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.784054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:11.786374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:11.822181 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c8e8f0-69b1-4f44-8c09-fec306e7a7c7 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.823186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f0144a-7bfb-4f64-8fc2-5109e42b5d62 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:11.860495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f2aa74-5cba-44e7-982f-63eae2e16516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.861283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb70d5-7bc1-4723-b360-885ddc2b017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:11.861827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2aa74-5cba-44e7-982f-63eae2e16516 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.862071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb70d5-7bc1-4723-b360-885ddc2b017f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.862352 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb70d5-7bc1-4723-b360-885ddc2b017f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.862628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb70d5-7bc1-4723-b360-885ddc2b017f None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.862920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2aa74-5cba-44e7-982f-63eae2e16516 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.863406 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2aa74-5cba-44e7-982f-63eae2e16516 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.864623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2aa74-5cba-44e7-982f-63eae2e16516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:11.865425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2aa74-5cba-44e7-982f-63eae2e16516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.867013 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f2aa74-5cba-44e7-982f-63eae2e16516 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.869460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb70d5-7bc1-4723-b360-885ddc2b017f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:11.870891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb70d5-7bc1-4723-b360-885ddc2b017f None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:11.881100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 336/678] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:11.882664 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59860e-171a-4a10-b331-2cafd5115204 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:11.883162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59860e-171a-4a10-b331-2cafd5115204 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:11.883645 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59860e-171a-4a10-b331-2cafd5115204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-7ddb70d5-7bc1-4723-b360-885ddc2b017f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:11.884611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:11.886029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:11.886946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:11.886946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:11.886946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:11.886946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:11.886946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:11.886946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:11.886946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:11.886946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:11.891137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 343/679] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:11.892010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb70d5-7bc1-4723-b360-885ddc2b017f None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:11.903966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5e59860e-171a-4a10-b331-2cafd5115204 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:11.906077 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5e59860e-171a-4a10-b331-2cafd5115204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:11.988341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 337/680] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:11.988341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59860e-171a-4a10-b331-2cafd5115204 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.001259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb70d5-7bc1-4723-b360-885ddc2b017f None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.027614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:12.037822 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d132a-c1f5-47ac-8ac3-13c4fa60c552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.038485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d132a-c1f5-47ac-8ac3-13c4fa60c552 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.038771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d132a-c1f5-47ac-8ac3-13c4fa60c552 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.039055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d132a-c1f5-47ac-8ac3-13c4fa60c552 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.039859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d132a-c1f5-47ac-8ac3-13c4fa60c552 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:12.040175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d132a-c1f5-47ac-8ac3-13c4fa60c552 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.041708 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d132a-c1f5-47ac-8ac3-13c4fa60c552 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:12.053927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 344/681] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:12.056335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:12.056440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d132a-c1f5-47ac-8ac3-13c4fa60c552 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.102786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59860e-171a-4a10-b331-2cafd5115204 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.139025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f39c-b0f5-4c9e-9a39-516c23a8024e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.139995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f39c-b0f5-4c9e-9a39-516c23a8024e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.140651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f39c-b0f5-4c9e-9a39-516c23a8024e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.140927 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125f39c-b0f5-4c9e-9a39-516c23a8024e None admin] PATH_INFO: `/v3/users/nova` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.148838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125f39c-b0f5-4c9e-9a39-516c23a8024e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.150307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125f39c-b0f5-4c9e-9a39-516c23a8024e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:12.162896 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d132a-c1f5-47ac-8ac3-13c4fa60c552 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-3125f39c-b0f5-4c9e-9a39-516c23a8024e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:12.165980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:12.167580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:12.168565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:12.168565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:12.168565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:12.168565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:12.168565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:12.168565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:12.168565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:12.168565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:12.168565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:50:12.168565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:12.168565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 338/682] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Jun 23 10:50:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:12.168565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f39c-b0f5-4c9e-9a39-516c23a8024e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.207452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77eb86-9c70-4435-992b-ed623fee000b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.208124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77eb86-9c70-4435-992b-ed623fee000b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.208409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77eb86-9c70-4435-992b-ed623fee000b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.208687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77eb86-9c70-4435-992b-ed623fee000b None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.209471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77eb86-9c70-4435-992b-ed623fee000b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:12.209778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77eb86-9c70-4435-992b-ed623fee000b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.211210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb77eb86-9c70-4435-992b-ed623fee000b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:12.226600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 345/683] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:12.227709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77eb86-9c70-4435-992b-ed623fee000b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.281345 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125f39c-b0f5-4c9e-9a39-516c23a8024e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.291022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:12.301544 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:12.318423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223774e3-5483-4a66-ad09-5c3682550da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.319991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223774e3-5483-4a66-ad09-5c3682550da1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.320237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223774e3-5483-4a66-ad09-5c3682550da1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.320569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223774e3-5483-4a66-ad09-5c3682550da1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.331752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223774e3-5483-4a66-ad09-5c3682550da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-223774e3-5483-4a66-ad09-5c3682550da1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:12.340163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:12.341239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:12.342346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 339/684] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:12.343049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223774e3-5483-4a66-ad09-5c3682550da1 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.353963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb77eb86-9c70-4435-992b-ed623fee000b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.392684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e551a87-9490-41e5-826d-aa0f8a0a7ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.393350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e551a87-9490-41e5-826d-aa0f8a0a7ae3 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.393637 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e551a87-9490-41e5-826d-aa0f8a0a7ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.393915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e551a87-9490-41e5-826d-aa0f8a0a7ae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.394750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e551a87-9490-41e5-826d-aa0f8a0a7ae3 None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=71539f69f3c8446ca7e9833d244d20fb) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:12.395066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e551a87-9490-41e5-826d-aa0f8a0a7ae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.396543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e551a87-9490-41e5-826d-aa0f8a0a7ae3 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:12.411854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 346/685] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:12 2022] GET /identity/v3/role_assignments?user.id=71539f69f3c8446ca7e9833d244d20fb&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:12.411854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e551a87-9490-41e5-826d-aa0f8a0a7ae3 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.462440 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223774e3-5483-4a66-ad09-5c3682550da1 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.502792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e81570-2657-4c6d-a0ec-3b844c46d906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.504209 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e81570-2657-4c6d-a0ec-3b844c46d906 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.504573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e81570-2657-4c6d-a0ec-3b844c46d906 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.505220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e81570-2657-4c6d-a0ec-3b844c46d906 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.506188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e81570-2657-4c6d-a0ec-3b844c46d906 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:12.506579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e81570-2657-4c6d-a0ec-3b844c46d906 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.509324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e81570-2657-4c6d-a0ec-3b844c46d906 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:12.534934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 340/686] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Jun 23 10:50:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:12.535991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e81570-2657-4c6d-a0ec-3b844c46d906 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.560194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e551a87-9490-41e5-826d-aa0f8a0a7ae3 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.577693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:12.588353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:12.609964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49f4a2-74e3-4758-9ea6-9dd921d9b5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.610581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49f4a2-74e3-4758-9ea6-9dd921d9b5be None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.610869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49f4a2-74e3-4758-9ea6-9dd921d9b5be None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.611151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49f4a2-74e3-4758-9ea6-9dd921d9b5be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.612020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49f4a2-74e3-4758-9ea6-9dd921d9b5be None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=2d903a8e2ce4489fa7f5b7479ff0b7a2) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:12.612342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49f4a2-74e3-4758-9ea6-9dd921d9b5be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.617407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49f4a2-74e3-4758-9ea6-9dd921d9b5be None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:12.620875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 347/687] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:12 2022] GET /identity/v3/role_assignments?user.id=2d903a8e2ce4489fa7f5b7479ff0b7a2&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:12.621675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49f4a2-74e3-4758-9ea6-9dd921d9b5be None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.688811 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e81570-2657-4c6d-a0ec-3b844c46d906 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.735367 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716223-1891-4fa2-93a7-1cfbd3ce6bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.736197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716223-1891-4fa2-93a7-1cfbd3ce6bf6 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.736507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716223-1891-4fa2-93a7-1cfbd3ce6bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.736789 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5716223-1891-4fa2-93a7-1cfbd3ce6bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.737549 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5716223-1891-4fa2-93a7-1cfbd3ce6bf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:12.737861 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5716223-1891-4fa2-93a7-1cfbd3ce6bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.739265 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5716223-1891-4fa2-93a7-1cfbd3ce6bf6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:12.749668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 341/688] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:50:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:12.755328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716223-1891-4fa2-93a7-1cfbd3ce6bf6 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:12.812110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49f4a2-74e3-4758-9ea6-9dd921d9b5be None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.871058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b83be-d24e-4e8b-8982-bbe01094a0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.872047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b83be-d24e-4e8b-8982-bbe01094a0a9 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.872495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b83be-d24e-4e8b-8982-bbe01094a0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.872920 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977b83be-d24e-4e8b-8982-bbe01094a0a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.913962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:12.922382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5716223-1891-4fa2-93a7-1cfbd3ce6bf6 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:12.943629 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:12.967565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b969d-542c-4cfb-978d-72ab38eac2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:12.968682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b969d-542c-4cfb-978d-72ab38eac2d3 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:12.969183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b969d-542c-4cfb-978d-72ab38eac2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:12.969687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9b969d-542c-4cfb-978d-72ab38eac2d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:12.972370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b83be-d24e-4e8b-8982-bbe01094a0a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.973847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977b83be-d24e-4e8b-8982-bbe01094a0a9 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:12.982550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b969d-542c-4cfb-978d-72ab38eac2d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:12.984475 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9b969d-542c-4cfb-978d-72ab38eac2d3 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-dc9b969d-542c-4cfb-978d-72ab38eac2d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:13.003556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:13.004543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:13.005420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:13.005420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:13.005420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:13.005420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:13.007710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 342/689] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:13.013789 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b969d-542c-4cfb-978d-72ab38eac2d3 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.090872 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 348/690] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:13.096330 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b83be-d24e-4e8b-8982-bbe01094a0a9 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.157845 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9b969d-542c-4cfb-978d-72ab38eac2d3 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.195934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81e0c30-44dd-4bbe-8b23-75a2fb308f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.196950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e0c30-44dd-4bbe-8b23-75a2fb308f75 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.198003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e0c30-44dd-4bbe-8b23-75a2fb308f75 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.198477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81e0c30-44dd-4bbe-8b23-75a2fb308f75 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.199401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e0c30-44dd-4bbe-8b23-75a2fb308f75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:13.199946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e0c30-44dd-4bbe-8b23-75a2fb308f75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.201531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81e0c30-44dd-4bbe-8b23-75a2fb308f75 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.212211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:13.217652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 343/691] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:13.219207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1fdf1-0111-4b31-b7e3-a25a98b38fcb None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.219691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1fdf1-0111-4b31-b7e3-a25a98b38fcb None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.220183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa1fdf1-0111-4b31-b7e3-a25a98b38fcb None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.226477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 344/692] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:13.226477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1fdf1-0111-4b31-b7e3-a25a98b38fcb None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.240874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:13.242249 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977b83be-d24e-4e8b-8982-bbe01094a0a9 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.284058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a34708-1d32-42b7-a5f7-42e5899673e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.285662 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a34708-1d32-42b7-a5f7-42e5899673e5 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.286062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a34708-1d32-42b7-a5f7-42e5899673e5 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.286655 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a34708-1d32-42b7-a5f7-42e5899673e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.302126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a34708-1d32-42b7-a5f7-42e5899673e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.304291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a34708-1d32-42b7-a5f7-42e5899673e5 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-f2a34708-1d32-42b7-a5f7-42e5899673e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:13.329381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:13.330406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:13.331298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:13.331298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:13.331298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:13.331298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:13.331298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 349/693] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:13.332309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784e927-99f5-477a-b55c-4adce2174df2 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.332598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784e927-99f5-477a-b55c-4adce2174df2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.332879 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784e927-99f5-477a-b55c-4adce2174df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.352638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa1fdf1-0111-4b31-b7e3-a25a98b38fcb None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.355882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-9784e927-99f5-477a-b55c-4adce2174df2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:13.358039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9784e927-99f5-477a-b55c-4adce2174df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:13.391017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba66446-b077-4a63-9953-ec0b64d16991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.392603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba66446-b077-4a63-9953-ec0b64d16991 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.393141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba66446-b077-4a63-9953-ec0b64d16991 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.393634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba66446-b077-4a63-9953-ec0b64d16991 None admin] PATH_INFO: `/v3/users/swift` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.402695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba66446-b077-4a63-9953-ec0b64d16991 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.404684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba66446-b077-4a63-9953-ec0b64d16991 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-6ba66446-b077-4a63-9953-ec0b64d16991 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:13.420994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:13.422017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:13.422938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:13.422938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:13.422938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:13.422938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:13.422938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:13.422938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:13.422938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:13.422938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:13.422938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:50:13.422938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:13.425708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 345/694] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:13.426720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba66446-b077-4a63-9953-ec0b64d16991 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.451838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 350/695] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:13.451838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784e927-99f5-477a-b55c-4adce2174df2 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.510403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:13.535900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:13.557802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784e927-99f5-477a-b55c-4adce2174df2 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.575386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba66446-b077-4a63-9953-ec0b64d16991 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.611416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920561d8-e3cf-4e4f-a55f-eef373333090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.612134 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920561d8-e3cf-4e4f-a55f-eef373333090 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.612425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920561d8-e3cf-4e4f-a55f-eef373333090 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.612704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920561d8-e3cf-4e4f-a55f-eef373333090 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.613667 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920561d8-e3cf-4e4f-a55f-eef373333090 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:13.613978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920561d8-e3cf-4e4f-a55f-eef373333090 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.615529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920561d8-e3cf-4e4f-a55f-eef373333090 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.618010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf68ae-3aba-4410-9450-f520ab743c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.618784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf68ae-3aba-4410-9450-f520ab743c46 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.619069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf68ae-3aba-4410-9450-f520ab743c46 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.619939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bf68ae-3aba-4410-9450-f520ab743c46 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.620685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf68ae-3aba-4410-9450-f520ab743c46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:13.620993 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf68ae-3aba-4410-9450-f520ab743c46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.622364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bf68ae-3aba-4410-9450-f520ab743c46 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.639646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 346/697] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:13.640532 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 351/697] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:13.640647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf68ae-3aba-4410-9450-f520ab743c46 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.641560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920561d8-e3cf-4e4f-a55f-eef373333090 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.752740 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920561d8-e3cf-4e4f-a55f-eef373333090 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.753201 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bf68ae-3aba-4410-9450-f520ab743c46 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.779443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:13.788298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:13.794580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692a3b4-bebe-405b-bf5e-30a2675a8513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.795595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692a3b4-bebe-405b-bf5e-30a2675a8513 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.796058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692a3b4-bebe-405b-bf5e-30a2675a8513 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.796481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b692a3b4-bebe-405b-bf5e-30a2675a8513 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.802480 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb14c-41fa-4e9d-af75-d9c72d551639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.803293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb14c-41fa-4e9d-af75-d9c72d551639 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.803575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb14c-41fa-4e9d-af75-d9c72d551639 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.803876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0cb14c-41fa-4e9d-af75-d9c72d551639 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.809653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692a3b4-bebe-405b-bf5e-30a2675a8513 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.811874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b692a3b4-bebe-405b-bf5e-30a2675a8513 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.812547 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cb14c-41fa-4e9d-af75-d9c72d551639 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.814440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0cb14c-41fa-4e9d-af75-d9c72d551639 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-2a0cb14c-41fa-4e9d-af75-d9c72d551639 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:13.830021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:13.831131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:13.832432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:13.832432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:13.832432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:13.832432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:13.832432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:13.832432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:13.832432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:13.832432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-b692a3b4-bebe-405b-bf5e-30a2675a8513 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:13.835332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:13.836456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:13.837578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:13.837578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:13.837578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:13.837578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:13.837806 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 352/698] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:13.837806 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb14c-41fa-4e9d-af75-d9c72d551639 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.839687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 347/699] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:13.840791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692a3b4-bebe-405b-bf5e-30a2675a8513 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:13.947876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0cb14c-41fa-4e9d-af75-d9c72d551639 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.950758 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b692a3b4-bebe-405b-bf5e-30a2675a8513 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:13.984337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69416710-2ca7-4d27-b8ec-1c45a7e00244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.984991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69416710-2ca7-4d27-b8ec-1c45a7e00244 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.985276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69416710-2ca7-4d27-b8ec-1c45a7e00244 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.985556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69416710-2ca7-4d27-b8ec-1c45a7e00244 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.987882 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de4eed-c104-414c-bfe9-aedd34ade186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:13.988865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de4eed-c104-414c-bfe9-aedd34ade186 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:13.989418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de4eed-c104-414c-bfe9-aedd34ade186 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:13.989877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4de4eed-c104-414c-bfe9-aedd34ade186 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:13.990871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de4eed-c104-414c-bfe9-aedd34ade186 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:13.991379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de4eed-c104-414c-bfe9-aedd34ade186 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:13.993033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4de4eed-c104-414c-bfe9-aedd34ade186 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:14.006903 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 348/700] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:14.008007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de4eed-c104-414c-bfe9-aedd34ade186 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:14.046983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:14.060236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:14.079858 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69416710-2ca7-4d27-b8ec-1c45a7e00244 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:14.082030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69416710-2ca7-4d27-b8ec-1c45a7e00244 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:14.126424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4de4eed-c104-414c-bfe9-aedd34ade186 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:14.171568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02394b-d255-46a6-a7ba-ab8be1730d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:14.172692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02394b-d255-46a6-a7ba-ab8be1730d0a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:14.173308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02394b-d255-46a6-a7ba-ab8be1730d0a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:14.173779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d02394b-d255-46a6-a7ba-ab8be1730d0a None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:14.174685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02394b-d255-46a6-a7ba-ab8be1730d0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:14.175173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02394b-d255-46a6-a7ba-ab8be1730d0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:14.176980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d02394b-d255-46a6-a7ba-ab8be1730d0a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:14.192603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 349/701] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:14.193910 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02394b-d255-46a6-a7ba-ab8be1730d0a None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:14.223898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 353/702] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:14.226077 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69416710-2ca7-4d27-b8ec-1c45a7e00244 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:14.312824 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:14.324065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d02394b-d255-46a6-a7ba-ab8be1730d0a None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:14.338464 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:14.349700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69416710-2ca7-4d27-b8ec-1c45a7e00244 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:14.364922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c0665-8ea1-463c-98c8-3addfa11df37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:14.365650 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0665-8ea1-463c-98c8-3addfa11df37 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:14.365941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0665-8ea1-463c-98c8-3addfa11df37 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:14.366221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c0665-8ea1-463c-98c8-3addfa11df37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:14.367411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c0665-8ea1-463c-98c8-3addfa11df37 None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=a020e7fe06574a108b46f9f48bddc4e4) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:14.367628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c0665-8ea1-463c-98c8-3addfa11df37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:14.369815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9c0665-8ea1-463c-98c8-3addfa11df37 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:14.381477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 350/703] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:14 2022] GET /identity/v3/role_assignments?user.id=a020e7fe06574a108b46f9f48bddc4e4&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:14.381477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c0665-8ea1-463c-98c8-3addfa11df37 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:14.417348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9fc14-ea0b-4631-9820-10766c4656cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:14.418049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9fc14-ea0b-4631-9820-10766c4656cb None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:14.418334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9fc14-ea0b-4631-9820-10766c4656cb None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:14.418615 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce9fc14-ea0b-4631-9820-10766c4656cb None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:14.419347 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9fc14-ea0b-4631-9820-10766c4656cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:14.420867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce9fc14-ea0b-4631-9820-10766c4656cb None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:14.513831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 354/704] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:50:14 2022] POST /identity/v3/users => generated 254 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:14.549752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c0665-8ea1-463c-98c8-3addfa11df37 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:14.620408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365c9c2-fe97-4b93-893a-549c1fd0b6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:14.621223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365c9c2-fe97-4b93-893a-549c1fd0b6f3 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:14.621508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365c9c2-fe97-4b93-893a-549c1fd0b6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:14.621786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365c9c2-fe97-4b93-893a-549c1fd0b6f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:14.634943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365c9c2-fe97-4b93-893a-549c1fd0b6f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:14.636587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365c9c2-fe97-4b93-893a-549c1fd0b6f3 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-6365c9c2-fe97-4b93-893a-549c1fd0b6f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:14.657661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:14.658630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:14.660006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:14.660006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:14.660006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:14.660006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:14.660006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 351/705] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:14.666280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9fc14-ea0b-4631-9820-10766c4656cb None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:14.783516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce9fc14-ea0b-4631-9820-10766c4656cb None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:14.815664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:14.822887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c367c8-65ec-4252-a71b-6ad902f9deda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:14.823577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c367c8-65ec-4252-a71b-6ad902f9deda None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:14.825333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c367c8-65ec-4252-a71b-6ad902f9deda None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:14.825333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c367c8-65ec-4252-a71b-6ad902f9deda None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:14.825333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c367c8-65ec-4252-a71b-6ad902f9deda None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:14.825333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c367c8-65ec-4252-a71b-6ad902f9deda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:14.826846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c367c8-65ec-4252-a71b-6ad902f9deda None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:14.829327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c94658-5e9d-4493-9296-8a91bb40b262 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:14.829683 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c94658-5e9d-4493-9296-8a91bb40b262 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:14.830033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c94658-5e9d-4493-9296-8a91bb40b262 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:14.831634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 352/706] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:14.837502 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd147-7103-44e3-85c2-09b51c1c5588 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:14.837858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd147-7103-44e3-85c2-09b51c1c5588 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:14.838778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114bd147-7103-44e3-85c2-09b51c1c5588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:14.849941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 355/707] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:14.851964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c367c8-65ec-4252-a71b-6ad902f9deda None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:14.864198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-114bd147-7103-44e3-85c2-09b51c1c5588 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:14.865724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-114bd147-7103-44e3-85c2-09b51c1c5588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:14.880812 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:14.951531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 353/708] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:50:14.975280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c367c8-65ec-4252-a71b-6ad902f9deda None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:14.980231 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bd147-7103-44e3-85c2-09b51c1c5588 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:15.021574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc267c0-7000-49e9-b761-a7d7ae39bec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:15.022916 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc267c0-7000-49e9-b761-a7d7ae39bec8 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.024132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc267c0-7000-49e9-b761-a7d7ae39bec8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.024393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc267c0-7000-49e9-b761-a7d7ae39bec8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.036581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc267c0-7000-49e9-b761-a7d7ae39bec8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:15.039117 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc267c0-7000-49e9-b761-a7d7ae39bec8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-4bc267c0-7000-49e9-b761-a7d7ae39bec8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:15.058674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:15.059609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:15.061020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:15.061020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:15.061020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:15.061020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:15.061020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:15.061020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:15.061020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:15.061020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:15.061508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 356/709] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:15.068566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc267c0-7000-49e9-b761-a7d7ae39bec8 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:15.140030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114bd147-7103-44e3-85c2-09b51c1c5588 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:15.161295 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:15.197150 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2584d7ab-a5ea-46d9-b563-ccdd5e5dfe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:15.198166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d7ab-a5ea-46d9-b563-ccdd5e5dfe4a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.198451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d7ab-a5ea-46d9-b563-ccdd5e5dfe4a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.198730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2584d7ab-a5ea-46d9-b563-ccdd5e5dfe4a None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.199393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584d7ab-a5ea-46d9-b563-ccdd5e5dfe4a None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:15.200979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2584d7ab-a5ea-46d9-b563-ccdd5e5dfe4a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-2584d7ab-a5ea-46d9-b563-ccdd5e5dfe4a None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:15.220038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:15.221062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:15.222540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 354/710] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Jun 23 10:50:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:15.223387 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3acdcd-50cf-4b9f-a33c-0bbb00219f3e None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.223387 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3acdcd-50cf-4b9f-a33c-0bbb00219f3e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.223516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3acdcd-50cf-4b9f-a33c-0bbb00219f3e None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.225018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc267c0-7000-49e9-b761-a7d7ae39bec8 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:15.227899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 355/711] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:15.229241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3acdcd-50cf-4b9f-a33c-0bbb00219f3e None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:15.246541 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:15.273749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b49751-81a7-4a07-b52e-4fd163d38efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:15.274421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b49751-81a7-4a07-b52e-4fd163d38efa None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.274705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b49751-81a7-4a07-b52e-4fd163d38efa None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.274981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b49751-81a7-4a07-b52e-4fd163d38efa None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.276905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b49751-81a7-4a07-b52e-4fd163d38efa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:15.277224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b49751-81a7-4a07-b52e-4fd163d38efa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:15.278759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b49751-81a7-4a07-b52e-4fd163d38efa None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:15.295510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 357/712] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:15.297958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25e66d-1730-448b-9272-f801d92ab0a8 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.298251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25e66d-1730-448b-9272-f801d92ab0a8 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.298525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25e66d-1730-448b-9272-f801d92ab0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.321856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ba25e66d-1730-448b-9272-f801d92ab0a8 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:15.323658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ba25e66d-1730-448b-9272-f801d92ab0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:15.357623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3acdcd-50cf-4b9f-a33c-0bbb00219f3e None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:15.395701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a1857-3cf4-4bba-a8c0-65597162e404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:15.396450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1857-3cf4-4bba-a8c0-65597162e404 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.396737 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1857-3cf4-4bba-a8c0-65597162e404 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.397111 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a1857-3cf4-4bba-a8c0-65597162e404 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.397966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a1857-3cf4-4bba-a8c0-65597162e404 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:15.398325 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a1857-3cf4-4bba-a8c0-65597162e404 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:15.407830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712a1857-3cf4-4bba-a8c0-65597162e404 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:15.407830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 356/713] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Jun 23 10:50:15 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:15.407830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a1857-3cf4-4bba-a8c0-65597162e404 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:15.408543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 358/714] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:15.411745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25e66d-1730-448b-9272-f801d92ab0a8 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:15.468675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:15.494118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:15.519286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a1857-3cf4-4bba-a8c0-65597162e404 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:15.532042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25e66d-1730-448b-9272-f801d92ab0a8 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:15.556612 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514f027-bd31-40b5-9262-3b19c2e403ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:15.557257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514f027-bd31-40b5-9262-3b19c2e403ee None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.557705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514f027-bd31-40b5-9262-3b19c2e403ee None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.557999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7514f027-bd31-40b5-9262-3b19c2e403ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.559007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514f027-bd31-40b5-9262-3b19c2e403ee None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=dd54976bc4b541a89a0c15788bfb71ed) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:15.559346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514f027-bd31-40b5-9262-3b19c2e403ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:15.560834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7514f027-bd31-40b5-9262-3b19c2e403ee None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:15.575847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 357/715] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:15 2022] GET /identity/v3/role_assignments?user.id=dd54976bc4b541a89a0c15788bfb71ed&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:15.575847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514f027-bd31-40b5-9262-3b19c2e403ee None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:15.580413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36de428-86fd-473e-a80f-42725aab9983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:15.581351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36de428-86fd-473e-a80f-42725aab9983 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.581817 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36de428-86fd-473e-a80f-42725aab9983 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.582390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36de428-86fd-473e-a80f-42725aab9983 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.583300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36de428-86fd-473e-a80f-42725aab9983 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:15.583785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36de428-86fd-473e-a80f-42725aab9983 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:15.589742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36de428-86fd-473e-a80f-42725aab9983 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:15.596644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 359/716] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Jun 23 10:50:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:15.710979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7514f027-bd31-40b5-9262-3b19c2e403ee None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:15.761003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fda632-d034-4e64-ab3d-c23f9df2e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:15.761803 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fda632-d034-4e64-ab3d-c23f9df2e5c2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.762087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fda632-d034-4e64-ab3d-c23f9df2e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.762368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fda632-d034-4e64-ab3d-c23f9df2e5c2 None admin] PATH_INFO: `/v3/services/network` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.763045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fda632-d034-4e64-ab3d-c23f9df2e5c2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:15.764574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fda632-d034-4e64-ab3d-c23f9df2e5c2 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-a4fda632-d034-4e64-ab3d-c23f9df2e5c2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:15.778831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:15.779995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:50:15.780842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:15.781875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 358/717] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:15 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:15.788415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36de428-86fd-473e-a80f-42725aab9983 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:15.908901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36de428-86fd-473e-a80f-42725aab9983 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:15.911682 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:15.945221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c958fce1-1214-41ac-a222-39a81c583504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:15.945915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958fce1-1214-41ac-a222-39a81c583504 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:15.946183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958fce1-1214-41ac-a222-39a81c583504 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:15.946542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c958fce1-1214-41ac-a222-39a81c583504 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:15.947285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958fce1-1214-41ac-a222-39a81c583504 None admin] RBAC: Adding query filter params (name=network) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:15.948571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958fce1-1214-41ac-a222-39a81c583504 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:15.949990 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c958fce1-1214-41ac-a222-39a81c583504 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:15.955064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 360/718] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:15 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:15.960523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fda632-d034-4e64-ab3d-c23f9df2e5c2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:15.964488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:16.066294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fda632-d034-4e64-ab3d-c23f9df2e5c2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:16.102019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40d4c3d-2932-4d68-a29a-22f6ef808229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:16.102691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d4c3d-2932-4d68-a29a-22f6ef808229 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:16.102974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d4c3d-2932-4d68-a29a-22f6ef808229 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:16.103247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40d4c3d-2932-4d68-a29a-22f6ef808229 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:16.104044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d4c3d-2932-4d68-a29a-22f6ef808229 None admin] RBAC: Adding query filter params (type=network) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:16.104348 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d4c3d-2932-4d68-a29a-22f6ef808229 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:16.105720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40d4c3d-2932-4d68-a29a-22f6ef808229 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:16.112030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 359/719] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:15 2022] GET /identity/v3/services?type=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:16.854935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc02f1-ad21-444e-984b-a85d846ccb23 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:16.855515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc02f1-ad21-444e-984b-a85d846ccb23 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:16.855515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc02f1-ad21-444e-984b-a85d846ccb23 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:16.857119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 361/720] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:16.862668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e93de-079f-494c-8d2e-5aff26e64295 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:16.863117 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e93de-079f-494c-8d2e-5aff26e64295 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:16.863309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e93de-079f-494c-8d2e-5aff26e64295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:16.885750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-d01e93de-079f-494c-8d2e-5aff26e64295 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:16.886978 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d01e93de-079f-494c-8d2e-5aff26e64295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:16.978878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:16.984908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 360/721] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:17.009237 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc02f1-ad21-444e-984b-a85d846ccb23 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:17.159892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc02f1-ad21-444e-984b-a85d846ccb23 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:17.210334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c658a349-e8b6-4f0e-8574-1fa90956bfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:17.211132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658a349-e8b6-4f0e-8574-1fa90956bfac None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:17.211414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658a349-e8b6-4f0e-8574-1fa90956bfac None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:17.211687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c658a349-e8b6-4f0e-8574-1fa90956bfac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:17.228279 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c658a349-e8b6-4f0e-8574-1fa90956bfac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-c658a349-e8b6-4f0e-8574-1fa90956bfac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:17.240414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:17.241338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:17.242175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 362/722] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:50:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:17.247800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e93de-079f-494c-8d2e-5aff26e64295 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:17.310256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8c221-d2fb-451e-99be-15714003bdb2 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:17.310578 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8c221-d2fb-451e-99be-15714003bdb2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:17.310803 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8c221-d2fb-451e-99be-15714003bdb2 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:17.315248 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 363/723] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:17.320460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ba94b-8cc6-4f64-9f89-1a6a2e81ef57 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:17.320745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ba94b-8cc6-4f64-9f89-1a6a2e81ef57 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:17.321023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ba94b-8cc6-4f64-9f89-1a6a2e81ef57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:17.346779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a07ba94b-8cc6-4f64-9f89-1a6a2e81ef57 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:17.348022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a07ba94b-8cc6-4f64-9f89-1a6a2e81ef57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:17.373997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:17.434253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e93de-079f-494c-8d2e-5aff26e64295 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:17.443602 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 364/724] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 23 10:50:17.469659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254e092-5e68-444f-bc02-4ad1450737c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:17.470333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254e092-5e68-444f-bc02-4ad1450737c7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:17.470614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254e092-5e68-444f-bc02-4ad1450737c7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:17.470890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254e092-5e68-444f-bc02-4ad1450737c7 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:17.471629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254e092-5e68-444f-bc02-4ad1450737c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:17.471966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254e092-5e68-444f-bc02-4ad1450737c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:17.473348 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254e092-5e68-444f-bc02-4ad1450737c7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:17.482333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 361/725] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:50:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:17.487415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254e092-5e68-444f-bc02-4ad1450737c7 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:17.487537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ba94b-8cc6-4f64-9f89-1a6a2e81ef57 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:17.552202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:17.592672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254e092-5e68-444f-bc02-4ad1450737c7 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:17.629417 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cada61-99a9-4b0d-8966-3ff725d9777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:17.630360 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cada61-99a9-4b0d-8966-3ff725d9777b None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:17.630701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cada61-99a9-4b0d-8966-3ff725d9777b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:17.631035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cada61-99a9-4b0d-8966-3ff725d9777b None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:17.643032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cada61-99a9-4b0d-8966-3ff725d9777b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-f8cada61-99a9-4b0d-8966-3ff725d9777b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:17.652000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:17.653057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:17.653934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:17.653934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:17.653934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:17.653934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:17.653934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:17.653934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:17.653934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:17.653934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:17.653934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:17.653934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:17.653934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:17.653934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:17.655129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 362/726] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:17.660069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cada61-99a9-4b0d-8966-3ff725d9777b None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:17.773878 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ba94b-8cc6-4f64-9f89-1a6a2e81ef57 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:17.774227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cada61-99a9-4b0d-8966-3ff725d9777b None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:17.804887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:17.813165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50b4c7-98e3-4db4-bdfb-109dbbc0145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:17.813840 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50b4c7-98e3-4db4-bdfb-109dbbc0145f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:17.814122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50b4c7-98e3-4db4-bdfb-109dbbc0145f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:17.814397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50b4c7-98e3-4db4-bdfb-109dbbc0145f None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:17.815141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50b4c7-98e3-4db4-bdfb-109dbbc0145f None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:17.815448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50b4c7-98e3-4db4-bdfb-109dbbc0145f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:17.817448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50b4c7-98e3-4db4-bdfb-109dbbc0145f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:17.831971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 363/727] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:50:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:17.833453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50b4c7-98e3-4db4-bdfb-109dbbc0145f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:17.913109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3936b5-e341-4635-b175-d98d64e7623f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:17.913927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3936b5-e341-4635-b175-d98d64e7623f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:17.914218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3936b5-e341-4635-b175-d98d64e7623f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:17.914497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3936b5-e341-4635-b175-d98d64e7623f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:17.941850 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50b4c7-98e3-4db4-bdfb-109dbbc0145f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:17.944707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3936b5-e341-4635-b175-d98d64e7623f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:17.946210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3936b5-e341-4635-b175-d98d64e7623f None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:17.980061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc72359-e2ba-4377-a184-48ae75ff1d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:17.980870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc72359-e2ba-4377-a184-48ae75ff1d5d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:17.981152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc72359-e2ba-4377-a184-48ae75ff1d5d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:17.981424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc72359-e2ba-4377-a184-48ae75ff1d5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-7c3936b5-e341-4635-b175-d98d64e7623f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:17.984044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:17.984951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:17.985846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:17.985846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:17.985846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:17.985846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:17.992033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc72359-e2ba-4377-a184-48ae75ff1d5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:17.992687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 365/728] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 505 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:17.993640 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc72359-e2ba-4377-a184-48ae75ff1d5d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:17.998397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3936b5-e341-4635-b175-d98d64e7623f None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-bbc72359-e2ba-4377-a184-48ae75ff1d5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:18.013701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:18.014627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:18.016472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:18.016472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:18.016472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:18.016472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:18.016472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 364/729] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:18.021106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc72359-e2ba-4377-a184-48ae75ff1d5d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:18.030248 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:18.060282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:18.134158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc72359-e2ba-4377-a184-48ae75ff1d5d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:18.182573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd3bb5b-decc-4a92-8073-167433e1b59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:18.183270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3bb5b-decc-4a92-8073-167433e1b59f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.183552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3bb5b-decc-4a92-8073-167433e1b59f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.183847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd3bb5b-decc-4a92-8073-167433e1b59f None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.184572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3bb5b-decc-4a92-8073-167433e1b59f None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:18.184875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3bb5b-decc-4a92-8073-167433e1b59f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:18.187069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd3bb5b-decc-4a92-8073-167433e1b59f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:18.198395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3936b5-e341-4635-b175-d98d64e7623f None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:18.203210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 365/730] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:18.208697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529bf02-b510-473c-b7d8-c796723f0a56 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.208987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529bf02-b510-473c-b7d8-c796723f0a56 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.209268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529bf02-b510-473c-b7d8-c796723f0a56 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.210718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 366/731] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:18.211310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529bf02-b510-473c-b7d8-c796723f0a56 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:18.241649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27acd7-8681-4ea7-a57a-4f9fda25dc3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:18.242059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27acd7-8681-4ea7-a57a-4f9fda25dc3a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.242348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27acd7-8681-4ea7-a57a-4f9fda25dc3a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.242628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27acd7-8681-4ea7-a57a-4f9fda25dc3a None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.243410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27acd7-8681-4ea7-a57a-4f9fda25dc3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:18.243725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27acd7-8681-4ea7-a57a-4f9fda25dc3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:18.245684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27acd7-8681-4ea7-a57a-4f9fda25dc3a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:18.258100 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 366/732] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:18.263740 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80272d1f-2e43-4126-970f-8c4326ef93b0 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.264092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80272d1f-2e43-4126-970f-8c4326ef93b0 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.264432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80272d1f-2e43-4126-970f-8c4326ef93b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.292513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-80272d1f-2e43-4126-970f-8c4326ef93b0 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:18.294052 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-80272d1f-2e43-4126-970f-8c4326ef93b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:18.328891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:18.337105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529bf02-b510-473c-b7d8-c796723f0a56 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:18.364375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:18.375878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d3df35-dadc-4ddb-b56b-873503c2e64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:18.376690 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3df35-dadc-4ddb-b56b-873503c2e64f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.376968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3df35-dadc-4ddb-b56b-873503c2e64f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.377240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d3df35-dadc-4ddb-b56b-873503c2e64f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.380170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 367/733] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:18.381022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80272d1f-2e43-4126-970f-8c4326ef93b0 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:18.386527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3df35-dadc-4ddb-b56b-873503c2e64f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:18.388020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d3df35-dadc-4ddb-b56b-873503c2e64f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-d7d3df35-dadc-4ddb-b56b-873503c2e64f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:18.404243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:18.405271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:18.406194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:18.406194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:18.406194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:18.406194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:18.406194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:18.406194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:18.406194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:18.406194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:18.406194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:50:18.406194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:18.410240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 367/734] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Jun 23 10:50:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:18.411220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae2efa-1530-41dc-acb1-e0f5e7117078 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.411500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae2efa-1530-41dc-acb1-e0f5e7117078 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.411777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ae2efa-1530-41dc-acb1-e0f5e7117078 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.413230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 368/735] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:18.413743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae2efa-1530-41dc-acb1-e0f5e7117078 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:18.497583 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80272d1f-2e43-4126-970f-8c4326ef93b0 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:18.522308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ae2efa-1530-41dc-acb1-e0f5e7117078 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:18.537919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050e235-562e-436a-98ab-7a6a2eb34e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:18.539097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050e235-562e-436a-98ab-7a6a2eb34e9e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.539563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050e235-562e-436a-98ab-7a6a2eb34e9e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.540212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6050e235-562e-436a-98ab-7a6a2eb34e9e None admin] PATH_INFO: `/v3/users/nova` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.549032 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050e235-562e-436a-98ab-7a6a2eb34e9e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:18.550523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6050e235-562e-436a-98ab-7a6a2eb34e9e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:18.556716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e60f72-16b2-48f6-aa89-2075ab5247ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:18.557436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60f72-16b2-48f6-aa89-2075ab5247ee None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.557716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60f72-16b2-48f6-aa89-2075ab5247ee None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.558040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e60f72-16b2-48f6-aa89-2075ab5247ee None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.558761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e60f72-16b2-48f6-aa89-2075ab5247ee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:18.560210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e60f72-16b2-48f6-aa89-2075ab5247ee None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-6050e235-562e-436a-98ab-7a6a2eb34e9e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:18.568873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:18.570084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:18.571020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:18.571020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:18.571020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:18.571020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:18.571020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:18.571020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:18.571020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:18.571020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:18.571020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:50:18.571020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:18.571020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 368/736] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Jun 23 10:50:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:18.571589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050e235-562e-436a-98ab-7a6a2eb34e9e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:18.642240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:18.666942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 369/737] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:50:18 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:18.668632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5392e-c025-47d4-b395-7ae0fb3b617a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.668992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5392e-c025-47d4-b395-7ae0fb3b617a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.669348 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5392e-c025-47d4-b395-7ae0fb3b617a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.688350 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-20f5392e-c025-47d4-b395-7ae0fb3b617a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:18.689810 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-20f5392e-c025-47d4-b395-7ae0fb3b617a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:18.696059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6050e235-562e-436a-98ab-7a6a2eb34e9e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:18.701636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:18.751760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa36d21-6353-4020-9df7-9f8ba0a4a7f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:18.752607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36d21-6353-4020-9df7-9f8ba0a4a7f8 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.752907 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36d21-6353-4020-9df7-9f8ba0a4a7f8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.753201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa36d21-6353-4020-9df7-9f8ba0a4a7f8 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.754001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa36d21-6353-4020-9df7-9f8ba0a4a7f8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:18.754319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa36d21-6353-4020-9df7-9f8ba0a4a7f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:18.755835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa36d21-6353-4020-9df7-9f8ba0a4a7f8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:18.771795 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 370/738] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:18.773158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5392e-c025-47d4-b395-7ae0fb3b617a None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:18.787938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 369/739] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Jun 23 10:50:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:18.787938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c71f0d-60a4-46c2-b8dd-e4a6861ad896 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.787938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c71f0d-60a4-46c2-b8dd-e4a6861ad896 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.787938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c71f0d-60a4-46c2-b8dd-e4a6861ad896 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.789438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 370/740] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:18.790541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c71f0d-60a4-46c2-b8dd-e4a6861ad896 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:18.922043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5392e-c025-47d4-b395-7ae0fb3b617a None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:18.925984 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c71f0d-60a4-46c2-b8dd-e4a6861ad896 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:18.942466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:18.959314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb91133c-36f4-4739-899f-88c9ed2ce716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:18.961119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91133c-36f4-4739-899f-88c9ed2ce716 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.961119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91133c-36f4-4739-899f-88c9ed2ce716 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.961119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb91133c-36f4-4739-899f-88c9ed2ce716 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.961631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91133c-36f4-4739-899f-88c9ed2ce716 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:18.961940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91133c-36f4-4739-899f-88c9ed2ce716 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:18.963433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb91133c-36f4-4739-899f-88c9ed2ce716 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:18.964654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab4355-769c-49aa-847b-52c59732b21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:18.965309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab4355-769c-49aa-847b-52c59732b21e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.965593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab4355-769c-49aa-847b-52c59732b21e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.965867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ab4355-769c-49aa-847b-52c59732b21e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.983539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 371/741] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Jun 23 10:50:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:18.984612 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadae6fd-c481-4a47-9386-eb7105a79aa2 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:18.984899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadae6fd-c481-4a47-9386-eb7105a79aa2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:18.985234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadae6fd-c481-4a47-9386-eb7105a79aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:18.991612 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:19.005250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-aadae6fd-c481-4a47-9386-eb7105a79aa2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:19.006530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-aadae6fd-c481-4a47-9386-eb7105a79aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:19.049322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab4355-769c-49aa-847b-52c59732b21e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.050783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ab4355-769c-49aa-847b-52c59732b21e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.081101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 372/742] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:18 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 23 10:50:19.082373 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadae6fd-c481-4a47-9386-eb7105a79aa2 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.169276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 371/743] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:18 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 23 10:50:19.169956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab4355-769c-49aa-847b-52c59732b21e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.187256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:19.202576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadae6fd-c481-4a47-9386-eb7105a79aa2 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.235479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:19.240666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f07a0-e2f0-425d-ad67-0821e9a71cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.241461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f07a0-e2f0-425d-ad67-0821e9a71cd9 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.241746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f07a0-e2f0-425d-ad67-0821e9a71cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.242024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f07a0-e2f0-425d-ad67-0821e9a71cd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.253540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f07a0-e2f0-425d-ad67-0821e9a71cd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-b93f07a0-e2f0-425d-ad67-0821e9a71cd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:19.261955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:19.263151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 373/744] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:50:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:19.264597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f07a0-e2f0-425d-ad67-0821e9a71cd9 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.278903 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ab4355-769c-49aa-847b-52c59732b21e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.316320 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f656c-e4eb-48f5-8f3e-ced38814f2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.317145 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f656c-e4eb-48f5-8f3e-ced38814f2bc None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.317429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f656c-e4eb-48f5-8f3e-ced38814f2bc None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.317750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8f656c-e4eb-48f5-8f3e-ced38814f2bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.329205 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f656c-e4eb-48f5-8f3e-ced38814f2bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.330688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8f656c-e4eb-48f5-8f3e-ced38814f2bc None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-ce8f656c-e4eb-48f5-8f3e-ced38814f2bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:19.352200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:19.353169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:19.354646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:19.354646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:19.354646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:19.354646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:19.354646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 372/745] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:19.354916 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f656c-e4eb-48f5-8f3e-ced38814f2bc None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.379450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f07a0-e2f0-425d-ad67-0821e9a71cd9 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.417223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2e6c9-4ea4-4ae2-b5d7-2742ff2b25c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.418237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2e6c9-4ea4-4ae2-b5d7-2742ff2b25c2 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.418667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2e6c9-4ea4-4ae2-b5d7-2742ff2b25c2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.419089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2e6c9-4ea4-4ae2-b5d7-2742ff2b25c2 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.420019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2e6c9-4ea4-4ae2-b5d7-2742ff2b25c2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.421552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b2e6c9-4ea4-4ae2-b5d7-2742ff2b25c2 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.427031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:19.461658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8f656c-e4eb-48f5-8f3e-ced38814f2bc None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.495858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 374/746] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:50:19 2022] POST /identity/v3/services => generated 240 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:19.496963 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2e6c9-4ea4-4ae2-b5d7-2742ff2b25c2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.512786 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67476c1c-d05a-406f-9e0c-afed6e91baf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.513874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67476c1c-d05a-406f-9e0c-afed6e91baf0 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.514365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67476c1c-d05a-406f-9e0c-afed6e91baf0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.514898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67476c1c-d05a-406f-9e0c-afed6e91baf0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.528527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67476c1c-d05a-406f-9e0c-afed6e91baf0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.530231 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67476c1c-d05a-406f-9e0c-afed6e91baf0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-67476c1c-d05a-406f-9e0c-afed6e91baf0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:19.551731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:19.552873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:19.553767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:19.553767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:19.553767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:19.553767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:19.553767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 373/747] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:19.554486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67476c1c-d05a-406f-9e0c-afed6e91baf0 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.570238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:19.640044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2e6c9-4ea4-4ae2-b5d7-2742ff2b25c2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.683055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67476c1c-d05a-406f-9e0c-afed6e91baf0 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.689493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf57c88-0db3-44dd-9c6e-febb3e6c105f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.690514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf57c88-0db3-44dd-9c6e-febb3e6c105f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.690994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf57c88-0db3-44dd-9c6e-febb3e6c105f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.692048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf57c88-0db3-44dd-9c6e-febb3e6c105f None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.692847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf57c88-0db3-44dd-9c6e-febb3e6c105f None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:19.693164 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf57c88-0db3-44dd-9c6e-febb3e6c105f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.694575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf57c88-0db3-44dd-9c6e-febb3e6c105f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.710146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:19.710396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 375/748] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:50:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:19.711333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf57c88-0db3-44dd-9c6e-febb3e6c105f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.745900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c0245-ccf9-46cc-8057-6a6c481da99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.747423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c0245-ccf9-46cc-8057-6a6c481da99c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.747423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c0245-ccf9-46cc-8057-6a6c481da99c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.747423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404c0245-ccf9-46cc-8057-6a6c481da99c None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.748086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c0245-ccf9-46cc-8057-6a6c481da99c None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:19.748429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c0245-ccf9-46cc-8057-6a6c481da99c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.749823 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404c0245-ccf9-46cc-8057-6a6c481da99c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.764106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 374/749] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:19.765029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c0245-ccf9-46cc-8057-6a6c481da99c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.864676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf57c88-0db3-44dd-9c6e-febb3e6c105f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.884536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:19.908190 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cfe48-9136-4da6-8e58-b0f5dff541a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.908935 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cfe48-9136-4da6-8e58-b0f5dff541a9 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.909221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cfe48-9136-4da6-8e58-b0f5dff541a9 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.909494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542cfe48-9136-4da6-8e58-b0f5dff541a9 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.910223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cfe48-9136-4da6-8e58-b0f5dff541a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:19.910534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cfe48-9136-4da6-8e58-b0f5dff541a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.913083 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542cfe48-9136-4da6-8e58-b0f5dff541a9 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:19.919020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404c0245-ccf9-46cc-8057-6a6c481da99c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:19.931723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 376/750] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:19.931723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cfe48-9136-4da6-8e58-b0f5dff541a9 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:19.970090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c29239-54a9-400e-8145-2b7ecc1a7596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:19.971384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c29239-54a9-400e-8145-2b7ecc1a7596 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:19.971988 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c29239-54a9-400e-8145-2b7ecc1a7596 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:19.972281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c29239-54a9-400e-8145-2b7ecc1a7596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:19.988190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c29239-54a9-400e-8145-2b7ecc1a7596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:19.990187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c29239-54a9-400e-8145-2b7ecc1a7596 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-d7c29239-54a9-400e-8145-2b7ecc1a7596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:20.015742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:20.016716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:20.017898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:20.017898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:20.017898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:20.017898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:20.017898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 375/751] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:20.018186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c29239-54a9-400e-8145-2b7ecc1a7596 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:20.060628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:20.081565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542cfe48-9136-4da6-8e58-b0f5dff541a9 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:20.129603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a9c7b-c0e0-453e-adf7-252bfb25cad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:20.130517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9c7b-c0e0-453e-adf7-252bfb25cad6 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:20.130870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9c7b-c0e0-453e-adf7-252bfb25cad6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:20.131224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a9c7b-c0e0-453e-adf7-252bfb25cad6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:20.139067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a9c7b-c0e0-453e-adf7-252bfb25cad6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:20.140731 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3a9c7b-c0e0-453e-adf7-252bfb25cad6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-cc3a9c7b-c0e0-453e-adf7-252bfb25cad6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:20.156288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:20.157452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:20.158546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:20.158546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:20.158546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:20.158546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:20.158546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:20.158546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:20.158546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:20.158546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:20.163800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 377/752] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:20.163800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a9c7b-c0e0-453e-adf7-252bfb25cad6 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:20.170018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c29239-54a9-400e-8145-2b7ecc1a7596 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:20.199516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:20.209837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc809a6f-73b8-4a0c-9a42-ccacc0637598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:20.210884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc809a6f-73b8-4a0c-9a42-ccacc0637598 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:20.211343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc809a6f-73b8-4a0c-9a42-ccacc0637598 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:20.211767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc809a6f-73b8-4a0c-9a42-ccacc0637598 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:20.219492 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc809a6f-73b8-4a0c-9a42-ccacc0637598 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:20.221246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc809a6f-73b8-4a0c-9a42-ccacc0637598 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-cc809a6f-73b8-4a0c-9a42-ccacc0637598 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:20.242261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:20.243377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:20.244989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:20.244989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:20.244989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:20.244989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:20.244989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:20.244989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:20.244989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:20.244989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:20.247015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 376/753] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:20.248216 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc809a6f-73b8-4a0c-9a42-ccacc0637598 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:20.286454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a9c7b-c0e0-453e-adf7-252bfb25cad6 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:20.328283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8481e8-a33a-407a-9dcc-d2751d4a36fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:20.329100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8481e8-a33a-407a-9dcc-d2751d4a36fa None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:20.329486 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8481e8-a33a-407a-9dcc-d2751d4a36fa None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:20.329970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8481e8-a33a-407a-9dcc-d2751d4a36fa None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:20.331533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8481e8-a33a-407a-9dcc-d2751d4a36fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:20.331533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8481e8-a33a-407a-9dcc-d2751d4a36fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:20.332780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8481e8-a33a-407a-9dcc-d2751d4a36fa None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:20.351822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 378/754] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:20.352922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8481e8-a33a-407a-9dcc-d2751d4a36fa None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:20.355109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:20.376530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc809a6f-73b8-4a0c-9a42-ccacc0637598 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:20.417759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8d395-912a-4136-a673-e901419fc731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:20.418854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8d395-912a-4136-a673-e901419fc731 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:20.419599 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8d395-912a-4136-a673-e901419fc731 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:20.420233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf8d395-912a-4136-a673-e901419fc731 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:20.421249 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8d395-912a-4136-a673-e901419fc731 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:20.421793 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8d395-912a-4136-a673-e901419fc731 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:20.423471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf8d395-912a-4136-a673-e901419fc731 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:20.438220 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 377/755] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:20.439566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8d395-912a-4136-a673-e901419fc731 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:20.457479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:20.464520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8481e8-a33a-407a-9dcc-d2751d4a36fa None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:20.500415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34e55b-6fbb-4f90-bf63-1e98375a24e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:20.501755 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34e55b-6fbb-4f90-bf63-1e98375a24e4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:20.502021 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34e55b-6fbb-4f90-bf63-1e98375a24e4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:20.502398 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34e55b-6fbb-4f90-bf63-1e98375a24e4 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:20.503352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34e55b-6fbb-4f90-bf63-1e98375a24e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:20.503727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34e55b-6fbb-4f90-bf63-1e98375a24e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:20.505363 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34e55b-6fbb-4f90-bf63-1e98375a24e4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:20.518015 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 379/756] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:20.519036 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34e55b-6fbb-4f90-bf63-1e98375a24e4 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:20.557587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf8d395-912a-4136-a673-e901419fc731 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:20.601765 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb6152-424f-4ede-b807-986928fb8359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:20.602902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6152-424f-4ede-b807-986928fb8359 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:20.603454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6152-424f-4ede-b807-986928fb8359 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:20.603995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb6152-424f-4ede-b807-986928fb8359 None admin] PATH_INFO: `/v3/users/swift` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:20.614476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb6152-424f-4ede-b807-986928fb8359 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:20.616003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb6152-424f-4ede-b807-986928fb8359 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-c2cb6152-424f-4ede-b807-986928fb8359 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:20.632465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:20.633459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:20.634382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:20.634382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:20.634382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:20.634382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:20.634382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:20.634382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:20.634382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:20.634382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:20.634382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:50:20.634382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:20.638316 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 378/757] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:50:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:20.639297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb6152-424f-4ede-b807-986928fb8359 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:20.646134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34e55b-6fbb-4f90-bf63-1e98375a24e4 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:20.648297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:20.694625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412dd1d-ddc2-43b1-9870-b423817cc4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:20.695514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412dd1d-ddc2-43b1-9870-b423817cc4ee None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:20.695798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412dd1d-ddc2-43b1-9870-b423817cc4ee None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:20.696095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412dd1d-ddc2-43b1-9870-b423817cc4ee None admin] PATH_INFO: `/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/a020e7fe06574a108b46f9f48bddc4e4/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:20.700600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412dd1d-ddc2-43b1-9870-b423817cc4ee None admin] RBAC: Authorizing `identity:create_grant(project_id=d27530ca8f8e4156a519c726bd98c2a0, user_id=a020e7fe06574a108b46f9f48bddc4e4, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:20.703024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412dd1d-ddc2-43b1-9870-b423817cc4ee None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:20.754715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb6152-424f-4ede-b807-986928fb8359 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:20.795226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe57086-ea43-416e-b328-a0670f21b1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:20.796263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe57086-ea43-416e-b328-a0670f21b1a1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:20.796263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe57086-ea43-416e-b328-a0670f21b1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:20.796624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe57086-ea43-416e-b328-a0670f21b1a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:20.797389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe57086-ea43-416e-b328-a0670f21b1a1 None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=d2bf9ab55d984c3ea3b99126d063e47a) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:20.797785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe57086-ea43-416e-b328-a0670f21b1a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:20.799259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe57086-ea43-416e-b328-a0670f21b1a1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:20.801824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 380/758] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:50:20 2022] PUT /identity/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/a020e7fe06574a108b46f9f48bddc4e4/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:20.803403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412dd1d-ddc2-43b1-9870-b423817cc4ee None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:20.810598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 379/759] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:20 2022] GET /identity/v3/role_assignments?user.id=d2bf9ab55d984c3ea3b99126d063e47a&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:20.811956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eea57-3516-4796-85a6-603a64991dae None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:20.812255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eea57-3516-4796-85a6-603a64991dae None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:20.812543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eea57-3516-4796-85a6-603a64991dae None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:20.815860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 380/760] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:20.820571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c631ed-e661-4d4f-a9d2-a54db4f99644 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:20.821010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c631ed-e661-4d4f-a9d2-a54db4f99644 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:20.821400 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c631ed-e661-4d4f-a9d2-a54db4f99644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:20.844215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:20.844769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-65c631ed-e661-4d4f-a9d2-a54db4f99644 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:20.846909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-65c631ed-e661-4d4f-a9d2-a54db4f99644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:20.935248 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:20.941672 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 381/761] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:20.969725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c631ed-e661-4d4f-a9d2-a54db4f99644 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:21.047364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412dd1d-ddc2-43b1-9870-b423817cc4ee None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:21.095339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29154530-e8f6-4a33-b81f-f1dcfa5bf8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:21.096697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29154530-e8f6-4a33-b81f-f1dcfa5bf8f7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.097644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29154530-e8f6-4a33-b81f-f1dcfa5bf8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.097932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29154530-e8f6-4a33-b81f-f1dcfa5bf8f7 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.099027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29154530-e8f6-4a33-b81f-f1dcfa5bf8f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:21.099341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29154530-e8f6-4a33-b81f-f1dcfa5bf8f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:21.100803 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29154530-e8f6-4a33-b81f-f1dcfa5bf8f7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:21.111227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c631ed-e661-4d4f-a9d2-a54db4f99644 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:21.139897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 381/762] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Jun 23 10:50:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:21.143593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29154530-e8f6-4a33-b81f-f1dcfa5bf8f7 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:21.179371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a576-3a9f-4780-9244-016dc103baf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:21.182759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a576-3a9f-4780-9244-016dc103baf0 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.183045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a576-3a9f-4780-9244-016dc103baf0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.183318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e58a576-3a9f-4780-9244-016dc103baf0 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.184010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58a576-3a9f-4780-9244-016dc103baf0 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:21.185395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e58a576-3a9f-4780-9244-016dc103baf0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-6e58a576-3a9f-4780-9244-016dc103baf0 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:21.205942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:21.206926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:50:21.207736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:21.211927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 382/763] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Jun 23 10:50:20 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:21.213947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a576-3a9f-4780-9244-016dc103baf0 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:21.297261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:21.330006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e58a576-3a9f-4780-9244-016dc103baf0 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:21.342466 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:21.368424 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f9b0c-f213-4533-bac5-ab2e883161c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:21.370000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9b0c-f213-4533-bac5-ab2e883161c3 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.370482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9b0c-f213-4533-bac5-ab2e883161c3 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.370949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646f9b0c-f213-4533-bac5-ab2e883161c3 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.371835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f9b0c-f213-4533-bac5-ab2e883161c3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:21.372357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f9b0c-f213-4533-bac5-ab2e883161c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:21.373923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646f9b0c-f213-4533-bac5-ab2e883161c3 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:21.384008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 383/764] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Jun 23 10:50:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:21.386065 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f9b0c-f213-4533-bac5-ab2e883161c3 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:21.402663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29154530-e8f6-4a33-b81f-f1dcfa5bf8f7 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:21.500361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fa25d-0d52-47dc-9359-9d9a283c0219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:21.501293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fa25d-0d52-47dc-9359-9d9a283c0219 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.501723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fa25d-0d52-47dc-9359-9d9a283c0219 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.502145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63fa25d-0d52-47dc-9359-9d9a283c0219 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.507167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646f9b0c-f213-4533-bac5-ab2e883161c3 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:21.564235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:21.589885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67497ad9-2d3a-47ec-818b-309189d9e874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:21.590612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67497ad9-2d3a-47ec-818b-309189d9e874 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.590964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67497ad9-2d3a-47ec-818b-309189d9e874 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.591291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67497ad9-2d3a-47ec-818b-309189d9e874 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.592039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67497ad9-2d3a-47ec-818b-309189d9e874 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:21.592349 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67497ad9-2d3a-47ec-818b-309189d9e874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:21.593750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67497ad9-2d3a-47ec-818b-309189d9e874 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:21.604337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 384/765] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Jun 23 10:50:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:21.607376 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67497ad9-2d3a-47ec-818b-309189d9e874 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:21.651298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fa25d-0d52-47dc-9359-9d9a283c0219 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:21.652713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63fa25d-0d52-47dc-9359-9d9a283c0219 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:21.736696 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67497ad9-2d3a-47ec-818b-309189d9e874 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:21.771659 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39d1fc-ea75-4600-b60b-32d387878c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:21.772410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39d1fc-ea75-4600-b60b-32d387878c93 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.772698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39d1fc-ea75-4600-b60b-32d387878c93 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.772978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe39d1fc-ea75-4600-b60b-32d387878c93 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.773775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39d1fc-ea75-4600-b60b-32d387878c93 None admin] RBAC: Adding query filter params (interface=public, service_id=f1247f4395d04b148be8ca4b7820df28, region_id=RegionOne) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:21.774092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39d1fc-ea75-4600-b60b-32d387878c93 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:21.776079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe39d1fc-ea75-4600-b60b-32d387878c93 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:21.787931 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 385/766] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Jun 23 10:50:21 2022] GET /identity/v3/endpoints?service_id=f1247f4395d04b148be8ca4b7820df28&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:21.789594 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39d1fc-ea75-4600-b60b-32d387878c93 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:21.808189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:21.836418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 382/767] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:21 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:50:21.841873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fa25d-0d52-47dc-9359-9d9a283c0219 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:21.849137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:21.895821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe39d1fc-ea75-4600-b60b-32d387878c93 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:21.933458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b836dee6-1aa1-4274-9d9d-275faa76c65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:21.934047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836dee6-1aa1-4274-9d9d-275faa76c65b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.934333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836dee6-1aa1-4274-9d9d-275faa76c65b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.934614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b836dee6-1aa1-4274-9d9d-275faa76c65b None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.935305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836dee6-1aa1-4274-9d9d-275faa76c65b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:21.936717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b836dee6-1aa1-4274-9d9d-275faa76c65b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:21.948554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 386/768] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Jun 23 10:50:21 2022] GET /identity/v3/services => generated 772 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:21.966092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0674b50-cf57-4bc4-9e0d-a531e416cb24 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.966408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0674b50-cf57-4bc4-9e0d-a531e416cb24 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.966668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0674b50-cf57-4bc4-9e0d-a531e416cb24 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.968590 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 387/769] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:21.978499 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e44d9-566a-481d-914d-e3ec023fdd1e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:21.978817 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e44d9-566a-481d-914d-e3ec023fdd1e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:21.979076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e44d9-566a-481d-914d-e3ec023fdd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:21.999886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-9b6e44d9-566a-481d-914d-e3ec023fdd1e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:22.001104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9b6e44d9-566a-481d-914d-e3ec023fdd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:22.090087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 388/770] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:22.106152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63fa25d-0d52-47dc-9359-9d9a283c0219 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:22.142388 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e44d9-566a-481d-914d-e3ec023fdd1e None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:22.157096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d0837-efe7-4521-a193-e5d4711b2ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:22.157951 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d0837-efe7-4521-a193-e5d4711b2ff2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:22.158202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d0837-efe7-4521-a193-e5d4711b2ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:22.158467 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80d0837-efe7-4521-a193-e5d4711b2ff2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:22.177994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d0837-efe7-4521-a193-e5d4711b2ff2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:22.179989 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80d0837-efe7-4521-a193-e5d4711b2ff2 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-c80d0837-efe7-4521-a193-e5d4711b2ff2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:22.204762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:22.205665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:22.206547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:22.206547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:22.206547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:22.206547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:22.209126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 383/771] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:22.214969 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d0837-efe7-4521-a193-e5d4711b2ff2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:22.223912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:22.255226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:22.311862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e44d9-566a-481d-914d-e3ec023fdd1e None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:22.344368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724530de-430c-40a1-9fa9-48d78a7026ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:22.345175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724530de-430c-40a1-9fa9-48d78a7026ba None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:22.345462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724530de-430c-40a1-9fa9-48d78a7026ba None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:22.345742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724530de-430c-40a1-9fa9-48d78a7026ba None admin] PATH_INFO: `/v3/services/network` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:22.346404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724530de-430c-40a1-9fa9-48d78a7026ba None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:22.347800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724530de-430c-40a1-9fa9-48d78a7026ba None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-724530de-430c-40a1-9fa9-48d78a7026ba None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:22.361350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:22.362402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:22.363944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 389/772] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:22 2022] GET /identity/v3/services/network => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:22.374684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724530de-430c-40a1-9fa9-48d78a7026ba None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:22.424644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80d0837-efe7-4521-a193-e5d4711b2ff2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:22.496163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550ff6b-66db-4470-83af-340c1ea996ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:22.496835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550ff6b-66db-4470-83af-340c1ea996ea None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:22.497121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550ff6b-66db-4470-83af-340c1ea996ea None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:22.497404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b550ff6b-66db-4470-83af-340c1ea996ea None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:22.498132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550ff6b-66db-4470-83af-340c1ea996ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:22.498444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550ff6b-66db-4470-83af-340c1ea996ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:22.505006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b550ff6b-66db-4470-83af-340c1ea996ea None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:22.530409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 384/773] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:22.539524 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550ff6b-66db-4470-83af-340c1ea996ea None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:22.614053 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724530de-430c-40a1-9fa9-48d78a7026ba None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:22.651710 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:22.664136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:22.689227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b550ff6b-66db-4470-83af-340c1ea996ea None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:22.722008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4159f-b3c6-48ea-9cbe-880be59adcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:22.722693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4159f-b3c6-48ea-9cbe-880be59adcf0 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:22.722981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4159f-b3c6-48ea-9cbe-880be59adcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:22.723266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f4159f-b3c6-48ea-9cbe-880be59adcf0 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:22.724270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4159f-b3c6-48ea-9cbe-880be59adcf0 None admin] RBAC: Adding query filter params (name=network) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:22.724581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4159f-b3c6-48ea-9cbe-880be59adcf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:22.725991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f4159f-b3c6-48ea-9cbe-880be59adcf0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:22.737546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 390/774] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:22 2022] GET /identity/v3/services?name=network => generated 124 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:22.744770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4159f-b3c6-48ea-9cbe-880be59adcf0 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:22.749579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a667b2-5050-426a-85bf-6a1a657d09d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:22.750600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a667b2-5050-426a-85bf-6a1a657d09d5 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:22.752092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a667b2-5050-426a-85bf-6a1a657d09d5 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:22.758257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a667b2-5050-426a-85bf-6a1a657d09d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:22.778598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a667b2-5050-426a-85bf-6a1a657d09d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:22.781922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a667b2-5050-426a-85bf-6a1a657d09d5 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-93a667b2-5050-426a-85bf-6a1a657d09d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:22.808696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:22.810493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:22.812392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:22.812392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:22.812392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:22.812392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:22.812392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:22.812392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:22.812392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:22.812392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:22.816217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 385/775] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:22.821537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a667b2-5050-426a-85bf-6a1a657d09d5 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:22.965300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f4159f-b3c6-48ea-9cbe-880be59adcf0 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:23.009184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1ad9a-b3aa-46fc-b041-2f949842c914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:23.011249 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1ad9a-b3aa-46fc-b041-2f949842c914 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:23.011755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1ad9a-b3aa-46fc-b041-2f949842c914 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:23.012288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d1ad9a-b3aa-46fc-b041-2f949842c914 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:23.014784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1ad9a-b3aa-46fc-b041-2f949842c914 None admin] RBAC: Adding query filter params (type=network) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:23.015322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1ad9a-b3aa-46fc-b041-2f949842c914 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:23.017100 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d1ad9a-b3aa-46fc-b041-2f949842c914 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:23.026853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 391/776] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:22 2022] GET /identity/v3/services?type=network => generated 350 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:23.041022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1ad9a-b3aa-46fc-b041-2f949842c914 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:23.046317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a667b2-5050-426a-85bf-6a1a657d09d5 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:23.092534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bf9c32-4dcb-4cb6-9fe2-36a59824f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:23.093233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf9c32-4dcb-4cb6-9fe2-36a59824f839 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:23.093768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf9c32-4dcb-4cb6-9fe2-36a59824f839 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:23.094057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bf9c32-4dcb-4cb6-9fe2-36a59824f839 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:23.095273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf9c32-4dcb-4cb6-9fe2-36a59824f839 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:23.095596 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf9c32-4dcb-4cb6-9fe2-36a59824f839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:23.097339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bf9c32-4dcb-4cb6-9fe2-36a59824f839 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:23.109365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:23.113744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 386/777] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:23.117395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c6532-0abc-4fa8-87f9-283f7aac8da5 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:23.117863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c6532-0abc-4fa8-87f9-283f7aac8da5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:23.118301 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c6532-0abc-4fa8-87f9-283f7aac8da5 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:23.121905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 387/778] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:23.126428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c6532-0abc-4fa8-87f9-283f7aac8da5 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:23.130436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:23.186517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d1ad9a-b3aa-46fc-b041-2f949842c914 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:23.227540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cd6dff-5bdd-435d-b74f-bcb8f3a192f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:23.229156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6dff-5bdd-435d-b74f-bcb8f3a192f7 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:23.229617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6dff-5bdd-435d-b74f-bcb8f3a192f7 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:23.230096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cd6dff-5bdd-435d-b74f-bcb8f3a192f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:23.231152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd6dff-5bdd-435d-b74f-bcb8f3a192f7 None admin] RBAC: Adding query filter params (interface=public, service_id=ec9c111ae0584dc5953120287a3f8b1e, region_id=RegionOne) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:23.231642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd6dff-5bdd-435d-b74f-bcb8f3a192f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:23.233548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cd6dff-5bdd-435d-b74f-bcb8f3a192f7 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:23.240202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 392/779] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Jun 23 10:50:23 2022] GET /identity/v3/endpoints?service_id=ec9c111ae0584dc5953120287a3f8b1e&interface=public®ion_id=RegionOne => generated 194 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:23.241933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8642e45-0741-44ed-9c6e-e8d18a2b288a None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:23.242671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8642e45-0741-44ed-9c6e-e8d18a2b288a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:23.243125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8642e45-0741-44ed-9c6e-e8d18a2b288a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:23.263753 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-e8642e45-0741-44ed-9c6e-e8d18a2b288a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:23.265574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e8642e45-0741-44ed-9c6e-e8d18a2b288a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:23.266916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c6532-0abc-4fa8-87f9-283f7aac8da5 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:23.313767 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a93de1-a990-434c-b22d-d39dcae2deda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:23.314430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a93de1-a990-434c-b22d-d39dcae2deda None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:23.314793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a93de1-a990-434c-b22d-d39dcae2deda None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:23.315071 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a93de1-a990-434c-b22d-d39dcae2deda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:23.316439 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a93de1-a990-434c-b22d-d39dcae2deda None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=dd54976bc4b541a89a0c15788bfb71ed) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:23.316774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a93de1-a990-434c-b22d-d39dcae2deda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:23.318242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a93de1-a990-434c-b22d-d39dcae2deda None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:23.327952 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 388/780] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:23 2022] GET /identity/v3/role_assignments?user.id=dd54976bc4b541a89a0c15788bfb71ed&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:23.329396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a93de1-a990-434c-b22d-d39dcae2deda None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:23.366454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 393/781] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:23.368436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6cac6-4c2b-4aba-889c-38c3dd748a1c None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:23.368961 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6cac6-4c2b-4aba-889c-38c3dd748a1c None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:23.369436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb6cac6-4c2b-4aba-889c-38c3dd748a1c None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:23.371683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 394/782] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:23.376990 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8313a-26af-4c99-ac9b-922744ebcc5d None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:23.377600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8313a-26af-4c99-ac9b-922744ebcc5d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:23.378108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea8313a-26af-4c99-ac9b-922744ebcc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:23.404268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-cea8313a-26af-4c99-ac9b-922744ebcc5d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:23.406240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-cea8313a-26af-4c99-ac9b-922744ebcc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:23.443495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:23.453790 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:23.499712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a93de1-a990-434c-b22d-d39dcae2deda None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:23.503947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 395/783] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:23.505040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8313a-26af-4c99-ac9b-922744ebcc5d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:23.558082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e39fee-70f6-4565-9c97-fd96f84cb80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:23.558672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e39fee-70f6-4565-9c97-fd96f84cb80c None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:23.558961 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e39fee-70f6-4565-9c97-fd96f84cb80c None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:23.559245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e39fee-70f6-4565-9c97-fd96f84cb80c None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:23.559983 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e39fee-70f6-4565-9c97-fd96f84cb80c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:23.561712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e39fee-70f6-4565-9c97-fd96f84cb80c None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:23.567766 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 389/784] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Jun 23 10:50:23 2022] GET /identity/v3/services => generated 772 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:23.568755 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e39fee-70f6-4565-9c97-fd96f84cb80c None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:23.691584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea8313a-26af-4c99-ac9b-922744ebcc5d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:23.747372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e39fee-70f6-4565-9c97-fd96f84cb80c None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:23.765266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde1bf1-fb19-45ea-a4f4-b269ac763a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:23.766084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde1bf1-fb19-45ea-a4f4-b269ac763a3a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:23.766367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde1bf1-fb19-45ea-a4f4-b269ac763a3a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:23.766643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde1bf1-fb19-45ea-a4f4-b269ac763a3a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:23.780971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde1bf1-fb19-45ea-a4f4-b269ac763a3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:23.787188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-9dde1bf1-fb19-45ea-a4f4-b269ac763a3a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:23.789830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:23.791271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:23.792141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:23.792141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:23.792141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:23.792141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:23.792141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:23.792141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:23.792141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:23.792141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:23.792141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:23.792141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:23.792141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:23.792141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:23.796039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 396/785] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:50:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:23.796456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abdf91-7f79-4755-9245-f79ef2fccfa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:23.797724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abdf91-7f79-4755-9245-f79ef2fccfa2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:23.801724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde1bf1-fb19-45ea-a4f4-b269ac763a3a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:23.801854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abdf91-7f79-4755-9245-f79ef2fccfa2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:23.801854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abdf91-7f79-4755-9245-f79ef2fccfa2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:23.811436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19abdf91-7f79-4755-9245-f79ef2fccfa2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-19abdf91-7f79-4755-9245-f79ef2fccfa2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:23.819158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:23.820149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:23.821272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 390/786] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:23.827027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abdf91-7f79-4755-9245-f79ef2fccfa2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:23.833760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:23.956922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abdf91-7f79-4755-9245-f79ef2fccfa2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:23.981251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde1bf1-fb19-45ea-a4f4-b269ac763a3a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:23.992375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f466f-7bdc-4a99-ae97-54e559563610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:23.993045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f466f-7bdc-4a99-ae97-54e559563610 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:23.993332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f466f-7bdc-4a99-ae97-54e559563610 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:23.993613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85f466f-7bdc-4a99-ae97-54e559563610 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:23.994420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f466f-7bdc-4a99-ae97-54e559563610 None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:23.994733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f466f-7bdc-4a99-ae97-54e559563610 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:23.996151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85f466f-7bdc-4a99-ae97-54e559563610 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:24.004810 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 391/787] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:50:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:24.013186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f466f-7bdc-4a99-ae97-54e559563610 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:24.059769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d69995-46ed-45a9-8742-112dae25a2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:24.060522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d69995-46ed-45a9-8742-112dae25a2dd None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:24.060813 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d69995-46ed-45a9-8742-112dae25a2dd None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:24.061091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d69995-46ed-45a9-8742-112dae25a2dd None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:24.061901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d69995-46ed-45a9-8742-112dae25a2dd None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:24.062206 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d69995-46ed-45a9-8742-112dae25a2dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:24.063602 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d69995-46ed-45a9-8742-112dae25a2dd None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:24.079855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 397/788] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:50:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:24.085568 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d69995-46ed-45a9-8742-112dae25a2dd None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:24.116971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:24.166244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85f466f-7bdc-4a99-ae97-54e559563610 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:24.203658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c834d9c-6c62-4a0c-8f5f-b503db6baf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:24.204540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834d9c-6c62-4a0c-8f5f-b503db6baf26 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:24.204826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834d9c-6c62-4a0c-8f5f-b503db6baf26 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:24.205102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c834d9c-6c62-4a0c-8f5f-b503db6baf26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:24.216824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c834d9c-6c62-4a0c-8f5f-b503db6baf26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:24.218282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c834d9c-6c62-4a0c-8f5f-b503db6baf26 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-8c834d9c-6c62-4a0c-8f5f-b503db6baf26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:24.236858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:24.237775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:24.239093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:24.239093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:24.239093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:24.239093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:24.239093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 392/789] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:24.244407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c834d9c-6c62-4a0c-8f5f-b503db6baf26 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:24.254094 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:24.274800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d69995-46ed-45a9-8742-112dae25a2dd None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:24.354343 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c834d9c-6c62-4a0c-8f5f-b503db6baf26 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:24.361534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508fc2c-2b58-4125-b11b-f802067c605b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:24.362354 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508fc2c-2b58-4125-b11b-f802067c605b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:24.362642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508fc2c-2b58-4125-b11b-f802067c605b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:24.362919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508fc2c-2b58-4125-b11b-f802067c605b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:24.385209 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:24.392043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e361c1-aafc-460d-885d-090a7a16c36a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:24.392795 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e361c1-aafc-460d-885d-090a7a16c36a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:24.393139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e361c1-aafc-460d-885d-090a7a16c36a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:24.393420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e361c1-aafc-460d-885d-090a7a16c36a None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:24.394196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e361c1-aafc-460d-885d-090a7a16c36a None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:24.394507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e361c1-aafc-460d-885d-090a7a16c36a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:24.396066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e361c1-aafc-460d-885d-090a7a16c36a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:24.401299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508fc2c-2b58-4125-b11b-f802067c605b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:24.403392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508fc2c-2b58-4125-b11b-f802067c605b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:24.422642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 393/790] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:24.431550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e361c1-aafc-460d-885d-090a7a16c36a None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-8508fc2c-2b58-4125-b11b-f802067c605b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:24.448328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:24.450440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:24.452556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:24.452556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:24.452556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:24.452556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:24.452556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 398/791] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:24.461862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508fc2c-2b58-4125-b11b-f802067c605b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:24.623594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e361c1-aafc-460d-885d-090a7a16c36a None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:24.671723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508fc2c-2b58-4125-b11b-f802067c605b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:24.700132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d347a-aea7-4a26-b211-c4a3843461fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:24.701001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d347a-aea7-4a26-b211-c4a3843461fc None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:24.701286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d347a-aea7-4a26-b211-c4a3843461fc None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:24.701578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d347a-aea7-4a26-b211-c4a3843461fc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:24.709749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d347a-aea7-4a26-b211-c4a3843461fc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:24.711522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14d347a-aea7-4a26-b211-c4a3843461fc None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:24.723416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2bdb-8fb7-4339-8c67-58283266eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:24.724416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2bdb-8fb7-4339-8c67-58283266eb68 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:24.724755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2bdb-8fb7-4339-8c67-58283266eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:24.725038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383c2bdb-8fb7-4339-8c67-58283266eb68 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:24.725766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c2bdb-8fb7-4339-8c67-58283266eb68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:24.726079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c2bdb-8fb7-4339-8c67-58283266eb68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:24.727539 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383c2bdb-8fb7-4339-8c67-58283266eb68 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-c14d347a-aea7-4a26-b211-c4a3843461fc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:24.730242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:24.731163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:24.732125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:24.732125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:24.732125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:24.732125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:24.732125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:24.732125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:24.732125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:24.732125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:24.732125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:50:24.732125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:24.734757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 394/792] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Jun 23 10:50:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:24.736415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e18e7-a2cb-4213-ae5e-dae251a859f9 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:24.736929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e18e7-a2cb-4213-ae5e-dae251a859f9 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:24.737429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e18e7-a2cb-4213-ae5e-dae251a859f9 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:24.738965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 395/793] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:24.741336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 399/794] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:24.745819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:24.745955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e18e7-a2cb-4213-ae5e-dae251a859f9 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:24.746961 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2bdb-8fb7-4339-8c67-58283266eb68 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:24.775963 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:24.863293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e18e7-a2cb-4213-ae5e-dae251a859f9 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:24.880505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383c2bdb-8fb7-4339-8c67-58283266eb68 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:24.902684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b121537-5466-4b55-a5db-d431280ec7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:24.903459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121537-5466-4b55-a5db-d431280ec7df None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:24.903837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121537-5466-4b55-a5db-d431280ec7df None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:24.904204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b121537-5466-4b55-a5db-d431280ec7df None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:24.905147 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b121537-5466-4b55-a5db-d431280ec7df None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:24.905676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b121537-5466-4b55-a5db-d431280ec7df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:24.907255 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b121537-5466-4b55-a5db-d431280ec7df None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:24.931693 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 396/795] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Jun 23 10:50:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:24.931693 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12850-aec0-486b-b479-5594a132de45 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:24.931693 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12850-aec0-486b-b479-5594a132de45 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:24.931693 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c12850-aec0-486b-b479-5594a132de45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:24.933706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad57864-36e3-45c1-a98b-4279651a81d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:24.934774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad57864-36e3-45c1-a98b-4279651a81d5 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:24.935242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad57864-36e3-45c1-a98b-4279651a81d5 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:24.936058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad57864-36e3-45c1-a98b-4279651a81d5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:24.946197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad57864-36e3-45c1-a98b-4279651a81d5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:24.948146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad57864-36e3-45c1-a98b-4279651a81d5 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:24.948259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-28c12850-aec0-486b-b479-5594a132de45 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:24.949453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-28c12850-aec0-486b-b479-5594a132de45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-5ad57864-36e3-45c1-a98b-4279651a81d5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:24.964679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:24.965669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:24.966593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:24.966593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:24.966593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:24.966593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:24.966593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:24.966593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:24.966593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:24.966593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:24.966593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:50:24.966593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:24.969325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 400/796] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Jun 23 10:50:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:24.970405 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad57864-36e3-45c1-a98b-4279651a81d5 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:25.035956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 397/797] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:25.036994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12850-aec0-486b-b479-5594a132de45 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:25.038848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:25.067264 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:25.094143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad57864-36e3-45c1-a98b-4279651a81d5 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:25.135281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87907fc-0c68-43dc-b872-4c58c9736b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:25.136479 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87907fc-0c68-43dc-b872-4c58c9736b2d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:25.137001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87907fc-0c68-43dc-b872-4c58c9736b2d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:25.137489 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87907fc-0c68-43dc-b872-4c58c9736b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:25.149590 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87907fc-0c68-43dc-b872-4c58c9736b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:25.151503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87907fc-0c68-43dc-b872-4c58c9736b2d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-c87907fc-0c68-43dc-b872-4c58c9736b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:25.171551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:25.172557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:25.173474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:25.173474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:25.173474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:25.173474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:25.173702 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c12850-aec0-486b-b479-5594a132de45 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:25.176239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 401/798] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:25.181727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87907fc-0c68-43dc-b872-4c58c9736b2d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:25.208952 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc6ed1-e5d8-449b-a3d1-782953303431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:25.209682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc6ed1-e5d8-449b-a3d1-782953303431 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:25.209931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc6ed1-e5d8-449b-a3d1-782953303431 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:25.210209 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abc6ed1-e5d8-449b-a3d1-782953303431 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:25.211066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc6ed1-e5d8-449b-a3d1-782953303431 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:25.211561 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc6ed1-e5d8-449b-a3d1-782953303431 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:25.213408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abc6ed1-e5d8-449b-a3d1-782953303431 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:25.232598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 398/799] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Jun 23 10:50:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:25.233458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc6ed1-e5d8-449b-a3d1-782953303431 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:25.294756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87907fc-0c68-43dc-b872-4c58c9736b2d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:25.310231 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:25.332253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:25.334067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257a4d6-ed7a-40ed-8018-3a7c13f76f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:25.335244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257a4d6-ed7a-40ed-8018-3a7c13f76f2e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:25.335765 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257a4d6-ed7a-40ed-8018-3a7c13f76f2e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:25.336291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257a4d6-ed7a-40ed-8018-3a7c13f76f2e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:25.337165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257a4d6-ed7a-40ed-8018-3a7c13f76f2e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:25.337774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abc6ed1-e5d8-449b-a3d1-782953303431 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:25.339125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b257a4d6-ed7a-40ed-8018-3a7c13f76f2e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-b257a4d6-ed7a-40ed-8018-3a7c13f76f2e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:25.354283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:25.355299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 23 10:50:25.356513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:25.359081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 402/800] 10.222.0.52 () {56 vars in 1129 bytes} [Thu Jun 23 10:50:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:25.359644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257a4d6-ed7a-40ed-8018-3a7c13f76f2e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:25.385154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c58ca2-e831-4033-bf6c-b7c485fb8626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:25.385893 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c58ca2-e831-4033-bf6c-b7c485fb8626 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:25.386654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c58ca2-e831-4033-bf6c-b7c485fb8626 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:25.386654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c58ca2-e831-4033-bf6c-b7c485fb8626 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:25.387145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c58ca2-e831-4033-bf6c-b7c485fb8626 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:25.387453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c58ca2-e831-4033-bf6c-b7c485fb8626 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:25.389085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c58ca2-e831-4033-bf6c-b7c485fb8626 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:25.405407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 399/801] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:25.406333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c58ca2-e831-4033-bf6c-b7c485fb8626 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:25.482741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257a4d6-ed7a-40ed-8018-3a7c13f76f2e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:25.519119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9f584-93be-4106-83b0-a67a5e962f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:25.519860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9f584-93be-4106-83b0-a67a5e962f15 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:25.520150 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9f584-93be-4106-83b0-a67a5e962f15 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:25.523320 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb9f584-93be-4106-83b0-a67a5e962f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:25.536728 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c58ca2-e831-4033-bf6c-b7c485fb8626 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:25.569837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:25.571839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:25.584458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee07a5a-20a1-4d1e-a4c9-a30959e57367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:25.585142 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee07a5a-20a1-4d1e-a4c9-a30959e57367 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:25.585424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee07a5a-20a1-4d1e-a4c9-a30959e57367 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:25.585701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee07a5a-20a1-4d1e-a4c9-a30959e57367 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:25.587022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee07a5a-20a1-4d1e-a4c9-a30959e57367 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:25.587894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee07a5a-20a1-4d1e-a4c9-a30959e57367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:25.589642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee07a5a-20a1-4d1e-a4c9-a30959e57367 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:25.600931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 400/802] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Jun 23 10:50:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:25.600931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee07a5a-20a1-4d1e-a4c9-a30959e57367 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:25.613797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9f584-93be-4106-83b0-a67a5e962f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:25.616132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb9f584-93be-4106-83b0-a67a5e962f15 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:25.731602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee07a5a-20a1-4d1e-a4c9-a30959e57367 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:25.750249 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 403/803] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:50:25.750249 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9f584-93be-4106-83b0-a67a5e962f15 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:25.773318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b3fbca-26db-4b1a-a6a3-8e1184d9647c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:25.774111 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3fbca-26db-4b1a-a6a3-8e1184d9647c None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:25.774399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3fbca-26db-4b1a-a6a3-8e1184d9647c None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:25.774675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b3fbca-26db-4b1a-a6a3-8e1184d9647c None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:25.781580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3fbca-26db-4b1a-a6a3-8e1184d9647c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:25.783324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b3fbca-26db-4b1a-a6a3-8e1184d9647c None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-95b3fbca-26db-4b1a-a6a3-8e1184d9647c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:25.797930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:25.798894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:25.799773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:25.799773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:25.799773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:25.799773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:25.799773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:25.799773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:25.799773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:25.799773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:25.799773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 401/804] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:25.800957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf988e-b3f7-44be-bd70-a2360052271c None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:25.800957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf988e-b3f7-44be-bd70-a2360052271c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:25.801221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebf988e-b3f7-44be-bd70-a2360052271c None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:25.802713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 402/805] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:25.808423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf988e-b3f7-44be-bd70-a2360052271c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:25.839224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:25.867663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb9f584-93be-4106-83b0-a67a5e962f15 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:25.878425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:25.912709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef7ff-9acc-4bb4-93dd-7b46a505f36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:25.913390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef7ff-9acc-4bb4-93dd-7b46a505f36d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:25.913993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef7ff-9acc-4bb4-93dd-7b46a505f36d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:25.914275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2ef7ff-9acc-4bb4-93dd-7b46a505f36d None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:25.915263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ef7ff-9acc-4bb4-93dd-7b46a505f36d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:25.916197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ef7ff-9acc-4bb4-93dd-7b46a505f36d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:25.918333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2ef7ff-9acc-4bb4-93dd-7b46a505f36d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:25.923981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 404/806] 10.222.0.52 () {56 vars in 1124 bytes} [Thu Jun 23 10:50:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:25.924287 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebf988e-b3f7-44be-bd70-a2360052271c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:25.924801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef7ff-9acc-4bb4-93dd-7b46a505f36d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:25.966599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701e271-a7aa-45d8-9c84-554ea5e1aff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:25.967391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e271-a7aa-45d8-9c84-554ea5e1aff7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:25.967676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e271-a7aa-45d8-9c84-554ea5e1aff7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:25.967996 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701e271-a7aa-45d8-9c84-554ea5e1aff7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:25.978372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701e271-a7aa-45d8-9c84-554ea5e1aff7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:25.979848 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701e271-a7aa-45d8-9c84-554ea5e1aff7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-6701e271-a7aa-45d8-9c84-554ea5e1aff7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:25.997434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:25.998513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:25.999606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:25.999606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:25.999606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:25.999606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:25.999957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 403/807] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:26.001200 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02044730-469c-47e8-92f5-1850f5c4b57d None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:26.001482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02044730-469c-47e8-92f5-1850f5c4b57d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:26.001756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02044730-469c-47e8-92f5-1850f5c4b57d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:26.018815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-02044730-469c-47e8-92f5-1850f5c4b57d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:26.020064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-02044730-469c-47e8-92f5-1850f5c4b57d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:26.038156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2ef7ff-9acc-4bb4-93dd-7b46a505f36d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:26.073770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13474190-ffef-4a63-863e-52427dcd6649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:26.074424 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13474190-ffef-4a63-863e-52427dcd6649 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:26.074703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13474190-ffef-4a63-863e-52427dcd6649 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:26.074976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13474190-ffef-4a63-863e-52427dcd6649 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:26.075755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13474190-ffef-4a63-863e-52427dcd6649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:26.076093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13474190-ffef-4a63-863e-52427dcd6649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:26.077516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13474190-ffef-4a63-863e-52427dcd6649 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:26.086182 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 404/808] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:26.086336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:26.086905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02044730-469c-47e8-92f5-1850f5c4b57d None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:26.099366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 405/809] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:26.105399 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3faa0-22fe-46d4-9542-4518ca5b4763 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:26.105712 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3faa0-22fe-46d4-9542-4518ca5b4763 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:26.105964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e3faa0-22fe-46d4-9542-4518ca5b4763 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:26.107242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 406/810] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:26.107961 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3faa0-22fe-46d4-9542-4518ca5b4763 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:26.134774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:26.193373 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02044730-469c-47e8-92f5-1850f5c4b57d None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:26.212935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e3faa0-22fe-46d4-9542-4518ca5b4763 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:26.227743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a35260-98ac-4f6c-b821-17543f922986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:26.228962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a35260-98ac-4f6c-b821-17543f922986 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:26.229503 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a35260-98ac-4f6c-b821-17543f922986 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:26.229800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a35260-98ac-4f6c-b821-17543f922986 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:26.230516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a35260-98ac-4f6c-b821-17543f922986 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:26.231931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a35260-98ac-4f6c-b821-17543f922986 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:26.247286 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b12c1c-b7c5-40b7-bb78-5ad8c05f8397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:26.248036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b12c1c-b7c5-40b7-bb78-5ad8c05f8397 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:26.248271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b12c1c-b7c5-40b7-bb78-5ad8c05f8397 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:26.248549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b12c1c-b7c5-40b7-bb78-5ad8c05f8397 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:26.249270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b12c1c-b7c5-40b7-bb78-5ad8c05f8397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:26.249574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b12c1c-b7c5-40b7-bb78-5ad8c05f8397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:26.250930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b12c1c-b7c5-40b7-bb78-5ad8c05f8397 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:26.262552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 407/811] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:26.268778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b12c1c-b7c5-40b7-bb78-5ad8c05f8397 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:26.320094 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:26.361297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b12c1c-b7c5-40b7-bb78-5ad8c05f8397 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:26.364882 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 405/812] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Jun 23 10:50:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:26.365820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a35260-98ac-4f6c-b821-17543f922986 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:26.407431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b53811-0432-4d18-812a-c1440740bae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:26.408517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b53811-0432-4d18-812a-c1440740bae1 None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:26.408972 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b53811-0432-4d18-812a-c1440740bae1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:26.409245 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b53811-0432-4d18-812a-c1440740bae1 None admin] PATH_INFO: `/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/d2bf9ab55d984c3ea3b99126d063e47a/roles/c14c06359c8649ceaef626fadcc1fc3a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:26.429289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b53811-0432-4d18-812a-c1440740bae1 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27530ca8f8e4156a519c726bd98c2a0, user_id=d2bf9ab55d984c3ea3b99126d063e47a, role_id=c14c06359c8649ceaef626fadcc1fc3a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:26.430885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b53811-0432-4d18-812a-c1440740bae1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:26.483388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:26.490988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a35260-98ac-4f6c-b821-17543f922986 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:26.505203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 408/813] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:50:26 2022] PUT /identity/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/d2bf9ab55d984c3ea3b99126d063e47a/roles/c14c06359c8649ceaef626fadcc1fc3a => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:26.505203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200a74b-4571-498f-aa1b-57faf4366881 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:26.505203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200a74b-4571-498f-aa1b-57faf4366881 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:26.505203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200a74b-4571-498f-aa1b-57faf4366881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:26.526618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-9200a74b-4571-498f-aa1b-57faf4366881 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:26.528062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9200a74b-4571-498f-aa1b-57faf4366881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:26.550748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7cc26-1061-41b1-96bf-7aa8cc4528a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:26.551999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7cc26-1061-41b1-96bf-7aa8cc4528a3 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:26.552469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7cc26-1061-41b1-96bf-7aa8cc4528a3 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:26.552968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e7cc26-1061-41b1-96bf-7aa8cc4528a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:26.567504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e7cc26-1061-41b1-96bf-7aa8cc4528a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-39e7cc26-1061-41b1-96bf-7aa8cc4528a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:26.584601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:26.585566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:26.586400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:26.586400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:26.586400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:26.586400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:26.586400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:26.586400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:26.586400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:26.586400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:26.586400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:26.586400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:26.586400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:26.586400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:26.589011 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 406/814] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:26.590076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7cc26-1061-41b1-96bf-7aa8cc4528a3 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:26.623044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 409/815] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:26.624404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200a74b-4571-498f-aa1b-57faf4366881 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:26.677375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:26.743634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e7cc26-1061-41b1-96bf-7aa8cc4528a3 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:26.763989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200a74b-4571-498f-aa1b-57faf4366881 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:26.788595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f6801-a437-4031-bc4e-4f8592bc77f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:26.789886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f6801-a437-4031-bc4e-4f8592bc77f1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:26.790180 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f6801-a437-4031-bc4e-4f8592bc77f1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:26.790499 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5f6801-a437-4031-bc4e-4f8592bc77f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:26.800548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f6801-a437-4031-bc4e-4f8592bc77f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:26.802225 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5f6801-a437-4031-bc4e-4f8592bc77f1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:26.804676 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2053c-4792-4e67-b81f-ca329d7ff228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:26.805809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2053c-4792-4e67-b81f-ca329d7ff228 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:26.806192 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2053c-4792-4e67-b81f-ca329d7ff228 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:26.806533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be2053c-4792-4e67-b81f-ca329d7ff228 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:26.807350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2053c-4792-4e67-b81f-ca329d7ff228 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:26.807819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2053c-4792-4e67-b81f-ca329d7ff228 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:26.809575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be2053c-4792-4e67-b81f-ca329d7ff228 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-9c5f6801-a437-4031-bc4e-4f8592bc77f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:26.818589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:26.819493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:26.820734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:26.820734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:26.820734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:26.820734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:26.820734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:26.820734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:26.820734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:26.820734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:26.821161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 410/816] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:50:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:26.821161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2053c-4792-4e67-b81f-ca329d7ff228 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:26.821285 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 407/817] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:26.824713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f6801-a437-4031-bc4e-4f8592bc77f1 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:26.848191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:26.948908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5f6801-a437-4031-bc4e-4f8592bc77f1 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:26.967959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:26.973365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be2053c-4792-4e67-b81f-ca329d7ff228 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:26.991994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019549b-49fa-4a07-9705-69c28c03eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:26.993336 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019549b-49fa-4a07-9705-69c28c03eaec None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:26.994038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019549b-49fa-4a07-9705-69c28c03eaec None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:26.994465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019549b-49fa-4a07-9705-69c28c03eaec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:27.010622 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019549b-49fa-4a07-9705-69c28c03eaec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:27.012794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019549b-49fa-4a07-9705-69c28c03eaec None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:27.013613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242842df-6ce7-4183-914e-b0649a925924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:27.014572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242842df-6ce7-4183-914e-b0649a925924 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:27.014863 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242842df-6ce7-4183-914e-b0649a925924 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:27.015201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242842df-6ce7-4183-914e-b0649a925924 None admin] PATH_INFO: `/v3/services/network` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:27.015955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242842df-6ce7-4183-914e-b0649a925924 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:27.017404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242842df-6ce7-4183-914e-b0649a925924 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-242842df-6ce7-4183-914e-b0649a925924 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:27.032738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:27.033915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:27.035095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 411/818] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:26 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:27.036097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242842df-6ce7-4183-914e-b0649a925924 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-6019549b-49fa-4a07-9705-69c28c03eaec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:27.036203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:27.036992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:27.043399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:27.043399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:27.043399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:27.043399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:27.043399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 408/819] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:27.043399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019549b-49fa-4a07-9705-69c28c03eaec None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:27.116901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:27.151660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242842df-6ce7-4183-914e-b0649a925924 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:27.153781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019549b-49fa-4a07-9705-69c28c03eaec None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:27.189434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1941e6-4ca4-4818-aa29-54c7866cb0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:27.189988 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b17b24-8592-4ff7-b6bf-937847657b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:27.190703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b17b24-8592-4ff7-b6bf-937847657b26 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:27.190910 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1941e6-4ca4-4818-aa29-54c7866cb0e2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:27.191009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b17b24-8592-4ff7-b6bf-937847657b26 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:27.191253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b17b24-8592-4ff7-b6bf-937847657b26 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:27.191689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1941e6-4ca4-4818-aa29-54c7866cb0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:27.192087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b17b24-8592-4ff7-b6bf-937847657b26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:27.192400 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b17b24-8592-4ff7-b6bf-937847657b26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:27.192500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1941e6-4ca4-4818-aa29-54c7866cb0e2 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:27.193438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1941e6-4ca4-4818-aa29-54c7866cb0e2 None admin] RBAC: Adding query filter params (name=network) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:27.193977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b17b24-8592-4ff7-b6bf-937847657b26 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:27.194470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1941e6-4ca4-4818-aa29-54c7866cb0e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:27.196133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1941e6-4ca4-4818-aa29-54c7866cb0e2 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:27.202277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 409/820] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:27.203448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1941e6-4ca4-4818-aa29-54c7866cb0e2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:27.208517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 412/821] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:27.209359 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b17b24-8592-4ff7-b6bf-937847657b26 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:27.236913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:27.307901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1941e6-4ca4-4818-aa29-54c7866cb0e2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:27.323094 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b17b24-8592-4ff7-b6bf-937847657b26 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:27.343561 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:27.349826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00eead-d632-4650-831a-6ddc2334635e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:27.350608 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00eead-d632-4650-831a-6ddc2334635e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:27.350989 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00eead-d632-4650-831a-6ddc2334635e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:27.351380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00eead-d632-4650-831a-6ddc2334635e None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:27.352656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00eead-d632-4650-831a-6ddc2334635e None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:27.352656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00eead-d632-4650-831a-6ddc2334635e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:27.354259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00eead-d632-4650-831a-6ddc2334635e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:27.369205 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8145d08-4dc3-4d11-9e1a-727ed412560a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:27.370196 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145d08-4dc3-4d11-9e1a-727ed412560a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:27.370704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145d08-4dc3-4d11-9e1a-727ed412560a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:27.371200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8145d08-4dc3-4d11-9e1a-727ed412560a None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:27.372248 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8145d08-4dc3-4d11-9e1a-727ed412560a None admin] RBAC: Adding query filter params (type=network) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:27.372921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8145d08-4dc3-4d11-9e1a-727ed412560a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:27.374135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 410/822] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:27.375030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8145d08-4dc3-4d11-9e1a-727ed412560a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:27.375345 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00eead-d632-4650-831a-6ddc2334635e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:27.381905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 413/823] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:27.387598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8145d08-4dc3-4d11-9e1a-727ed412560a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:27.478323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:27.478830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00eead-d632-4650-831a-6ddc2334635e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:27.494407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8145d08-4dc3-4d11-9e1a-727ed412560a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:27.513862 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5f53-9056-4fe3-bce1-9ca7350961e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:27.514503 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5f53-9056-4fe3-bce1-9ca7350961e7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:27.514786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5f53-9056-4fe3-bce1-9ca7350961e7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:27.515058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fe5f53-9056-4fe3-bce1-9ca7350961e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:27.515901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe5f53-9056-4fe3-bce1-9ca7350961e7 None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=a020e7fe06574a108b46f9f48bddc4e4) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:27.516238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe5f53-9056-4fe3-bce1-9ca7350961e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:27.517668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fe5f53-9056-4fe3-bce1-9ca7350961e7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:27.524128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 411/824] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:27 2022] GET /identity/v3/role_assignments?user.id=a020e7fe06574a108b46f9f48bddc4e4&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:27.525069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5f53-9056-4fe3-bce1-9ca7350961e7 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:27.534433 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9f0c0-a4de-421e-995c-992c1289be1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:27.536021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9f0c0-a4de-421e-995c-992c1289be1e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:27.536574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9f0c0-a4de-421e-995c-992c1289be1e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:27.537053 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9f0c0-a4de-421e-995c-992c1289be1e None admin] PATH_INFO: `/v3/users/swift` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:27.546016 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9f0c0-a4de-421e-995c-992c1289be1e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:27.547772 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9f0c0-a4de-421e-995c-992c1289be1e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-7dc9f0c0-a4de-421e-995c-992c1289be1e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:27.564386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:27.565428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:27.566419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:27.566419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:27.566419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:27.566419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:27.566419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:27.566419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:27.566419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:27.566419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:27.566419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:50:27.566419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:27.569197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 414/825] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:50:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:27.585206 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9f0c0-a4de-421e-995c-992c1289be1e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:27.617299 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:27.704108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fe5f53-9056-4fe3-bce1-9ca7350961e7 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:27.753943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9f0c0-a4de-421e-995c-992c1289be1e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:27.761456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1c8a-5fb8-42a6-b64c-b6b584a842dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:27.762128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1c8a-5fb8-42a6-b64c-b6b584a842dc None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:27.762412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1c8a-5fb8-42a6-b64c-b6b584a842dc None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:27.762692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1c8a-5fb8-42a6-b64c-b6b584a842dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:27.763446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb1c8a-5fb8-42a6-b64c-b6b584a842dc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:27.765045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb1c8a-5fb8-42a6-b64c-b6b584a842dc None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:27.795278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d93a50-93be-4bf7-8838-c90e00f34fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:27.795991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d93a50-93be-4bf7-8838-c90e00f34fe2 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:27.796280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d93a50-93be-4bf7-8838-c90e00f34fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:27.796558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d93a50-93be-4bf7-8838-c90e00f34fe2 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:27.797442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d93a50-93be-4bf7-8838-c90e00f34fe2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:27.797751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d93a50-93be-4bf7-8838-c90e00f34fe2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:27.799208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d93a50-93be-4bf7-8838-c90e00f34fe2 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:27.819687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 415/826] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Jun 23 10:50:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:27.825722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d93a50-93be-4bf7-8838-c90e00f34fe2 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:27.830411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:27.839339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 412/827] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Jun 23 10:50:27 2022] POST /identity/v3/endpoints => generated 327 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:27.957915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d93a50-93be-4bf7-8838-c90e00f34fe2 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:28.122585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c4f62-8d77-4908-aef6-eccebb4e1618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:28.123780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c4f62-8d77-4908-aef6-eccebb4e1618 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.124313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c4f62-8d77-4908-aef6-eccebb4e1618 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.124803 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c4f62-8d77-4908-aef6-eccebb4e1618 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.137584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c4f62-8d77-4908-aef6-eccebb4e1618 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:28.139448 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c4f62-8d77-4908-aef6-eccebb4e1618 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-c14c4f62-8d77-4908-aef6-eccebb4e1618 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:28.159091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:28.160095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:28.160970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:28.160970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:28.160970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:28.160970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:28.163234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 416/828] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:28.172954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1c8a-5fb8-42a6-b64c-b6b584a842dc None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:28.292350 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1c8a-5fb8-42a6-b64c-b6b584a842dc None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:28.305437 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:28.332730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3d80b-0c84-42cf-8e23-4e5390b654f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:28.333818 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3d80b-0c84-42cf-8e23-4e5390b654f6 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.334202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3d80b-0c84-42cf-8e23-4e5390b654f6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.334584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3d80b-0c84-42cf-8e23-4e5390b654f6 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.335420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3d80b-0c84-42cf-8e23-4e5390b654f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:28.335854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3d80b-0c84-42cf-8e23-4e5390b654f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:28.337375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c3d80b-0c84-42cf-8e23-4e5390b654f6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:28.354330 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 413/829] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:28.359867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c4f62-8d77-4908-aef6-eccebb4e1618 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:28.423563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:28.480069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c4f62-8d77-4908-aef6-eccebb4e1618 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:28.519629 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f359067-ad8c-4620-8865-37c4abe564a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:28.520621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f359067-ad8c-4620-8865-37c4abe564a6 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.521012 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f359067-ad8c-4620-8865-37c4abe564a6 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.521546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f359067-ad8c-4620-8865-37c4abe564a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.530447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f359067-ad8c-4620-8865-37c4abe564a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:28.532167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f359067-ad8c-4620-8865-37c4abe564a6 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-2f359067-ad8c-4620-8865-37c4abe564a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:28.547859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:28.549033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:28.550211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:28.550211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:28.550211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:28.550211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:28.550211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:28.550211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:28.550211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:28.550211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:28.552326 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 417/830] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:28.558648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3d80b-0c84-42cf-8e23-4e5390b654f6 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:28.676152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3d80b-0c84-42cf-8e23-4e5390b654f6 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:28.690844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8444887-a381-4172-b97c-d6565d0f241e None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.691440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8444887-a381-4172-b97c-d6565d0f241e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.692235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8444887-a381-4172-b97c-d6565d0f241e None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.694425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 418/831] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:28.701614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc86d6-1c5c-47f3-aae0-f07798307f6c None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.702033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc86d6-1c5c-47f3-aae0-f07798307f6c None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.702415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc86d6-1c5c-47f3-aae0-f07798307f6c None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.704411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 419/832] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:28.705563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b1f29-e412-412b-b96c-8451c8ccce64 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.705884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b1f29-e412-412b-b96c-8451c8ccce64 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.706265 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b1f29-e412-412b-b96c-8451c8ccce64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.719642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ceb3e4-9781-45d5-b43b-ee9550237770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:28.720476 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceb3e4-9781-45d5-b43b-ee9550237770 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.720857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceb3e4-9781-45d5-b43b-ee9550237770 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.721204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ceb3e4-9781-45d5-b43b-ee9550237770 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.722003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceb3e4-9781-45d5-b43b-ee9550237770 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:28.722320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceb3e4-9781-45d5-b43b-ee9550237770 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:28.724064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ceb3e4-9781-45d5-b43b-ee9550237770 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:28.725604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-138b1f29-e412-412b-b96c-8451c8ccce64 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:28.726922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-138b1f29-e412-412b-b96c-8451c8ccce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:28.737758 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 414/833] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:28.743482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf5c1d-241f-4f3e-974c-2557131b76fa None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.743773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf5c1d-241f-4f3e-974c-2557131b76fa None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.744079 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf5c1d-241f-4f3e-974c-2557131b76fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.761616 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-60bf5c1d-241f-4f3e-974c-2557131b76fa None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:28.762999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-60bf5c1d-241f-4f3e-974c-2557131b76fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:28.787768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:28.800344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 420/834] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:28.809808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b1f29-e412-412b-b96c-8451c8ccce64 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:28.835313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 415/835] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:28.836712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf5c1d-241f-4f3e-974c-2557131b76fa None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:28.858598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:28.923498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b1f29-e412-412b-b96c-8451c8ccce64 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:28.954885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bf5c1d-241f-4f3e-974c-2557131b76fa None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:28.962180 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea464b22-ed9c-4a96-9cc7-d6894e1ab6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:28.963645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea464b22-ed9c-4a96-9cc7-d6894e1ab6c6 None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:28.963962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea464b22-ed9c-4a96-9cc7-d6894e1ab6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:28.964244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea464b22-ed9c-4a96-9cc7-d6894e1ab6c6 None admin] PATH_INFO: `/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/dd54976bc4b541a89a0c15788bfb71ed/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:28.966388 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea464b22-ed9c-4a96-9cc7-d6894e1ab6c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27530ca8f8e4156a519c726bd98c2a0, user_id=dd54976bc4b541a89a0c15788bfb71ed, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:28.968073 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea464b22-ed9c-4a96-9cc7-d6894e1ab6c6 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:29.039561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 421/836] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:50:28 2022] PUT /identity/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/dd54976bc4b541a89a0c15788bfb71ed/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:50:29.040810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea464b22-ed9c-4a96-9cc7-d6894e1ab6c6 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:29.124821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9de8a-de27-466f-af17-5d72f63274b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:29.126056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9de8a-de27-466f-af17-5d72f63274b5 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:29.126350 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9de8a-de27-466f-af17-5d72f63274b5 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:29.126626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b9de8a-de27-466f-af17-5d72f63274b5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:29.127367 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9de8a-de27-466f-af17-5d72f63274b5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:29.129699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b9de8a-de27-466f-af17-5d72f63274b5 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-88b9de8a-de27-466f-af17-5d72f63274b5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:29.147563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:29.148697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:50:29.149535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:29.154716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 416/837] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:50:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:29.156875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9de8a-de27-466f-af17-5d72f63274b5 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:29.188418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:29.188618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea464b22-ed9c-4a96-9cc7-d6894e1ab6c6 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:29.190821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:29.235327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898d640-6314-4d91-9d2f-8f89f523ab75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:29.236652 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898d640-6314-4d91-9d2f-8f89f523ab75 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:29.236944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898d640-6314-4d91-9d2f-8f89f523ab75 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:29.237219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8898d640-6314-4d91-9d2f-8f89f523ab75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:29.256245 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8898d640-6314-4d91-9d2f-8f89f523ab75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-8898d640-6314-4d91-9d2f-8f89f523ab75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:29.264792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:29.265788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:29.266614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 422/838] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:50:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:29.275466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898d640-6314-4d91-9d2f-8f89f523ab75 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:29.285556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b9de8a-de27-466f-af17-5d72f63274b5 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:29.329455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c23d2-986e-40f5-a3dd-32e6111a1e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:29.330298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c23d2-986e-40f5-a3dd-32e6111a1e7f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:29.330732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c23d2-986e-40f5-a3dd-32e6111a1e7f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:29.331349 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4c23d2-986e-40f5-a3dd-32e6111a1e7f None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:29.332742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c23d2-986e-40f5-a3dd-32e6111a1e7f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:29.333211 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c23d2-986e-40f5-a3dd-32e6111a1e7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:29.335056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4c23d2-986e-40f5-a3dd-32e6111a1e7f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:29.342146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 417/839] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:50:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:29.347756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c23d2-986e-40f5-a3dd-32e6111a1e7f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:29.408778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8898d640-6314-4d91-9d2f-8f89f523ab75 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:29.451145 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa5b7-2587-4fad-b239-368f692c7a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:29.451882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa5b7-2587-4fad-b239-368f692c7a33 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:29.452168 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa5b7-2587-4fad-b239-368f692c7a33 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:29.452445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21aa5b7-2587-4fad-b239-368f692c7a33 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:29.454028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aa5b7-2587-4fad-b239-368f692c7a33 None admin] RBAC: Adding query filter params (name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:29.454343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aa5b7-2587-4fad-b239-368f692c7a33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:29.455727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21aa5b7-2587-4fad-b239-368f692c7a33 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:29.470545 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 423/840] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:50:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:29.472272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa5b7-2587-4fad-b239-368f692c7a33 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:29.476240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:29.488537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4c23d2-986e-40f5-a3dd-32e6111a1e7f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:29.503105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:29.527747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079412f-1d58-401f-a3da-00760730fd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:29.528479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079412f-1d58-401f-a3da-00760730fd20 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:29.528802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079412f-1d58-401f-a3da-00760730fd20 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:29.529118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079412f-1d58-401f-a3da-00760730fd20 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:29.529825 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079412f-1d58-401f-a3da-00760730fd20 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:29.530136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079412f-1d58-401f-a3da-00760730fd20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:29.531874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1079412f-1d58-401f-a3da-00760730fd20 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:29.539907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 418/841] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:50:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:29.600057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21aa5b7-2587-4fad-b239-368f692c7a33 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:29.640996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b982f-3a7a-4d99-9947-b6fa77da8633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:29.642304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b982f-3a7a-4d99-9947-b6fa77da8633 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:29.642815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b982f-3a7a-4d99-9947-b6fa77da8633 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:29.643312 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3b982f-3a7a-4d99-9947-b6fa77da8633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:29.656847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b982f-3a7a-4d99-9947-b6fa77da8633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:29.658778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3b982f-3a7a-4d99-9947-b6fa77da8633 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-1e3b982f-3a7a-4d99-9947-b6fa77da8633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:29.682096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:29.683155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:29.684076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:29.684076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:29.684076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:29.684076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:29.686424 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 424/842] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:29.693024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079412f-1d58-401f-a3da-00760730fd20 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:29.873446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1079412f-1d58-401f-a3da-00760730fd20 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:29.929304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccccaf-da5f-4ca3-b247-bd7800f6b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:29.930348 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccccaf-da5f-4ca3-b247-bd7800f6b6ba None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:29.930832 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccccaf-da5f-4ca3-b247-bd7800f6b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:29.931934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccccaf-da5f-4ca3-b247-bd7800f6b6ba None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:29.932870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccccaf-da5f-4ca3-b247-bd7800f6b6ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:29.933433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccccaf-da5f-4ca3-b247-bd7800f6b6ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:29.935073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccccaf-da5f-4ca3-b247-bd7800f6b6ba None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:29.947629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 419/843] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:29.954136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b982f-3a7a-4d99-9947-b6fa77da8633 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:30.074113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:30.097560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3b982f-3a7a-4d99-9947-b6fa77da8633 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:30.132253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5430e5-252f-4f90-88b2-0aa220c21ea8 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.132446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5430e5-252f-4f90-88b2-0aa220c21ea8 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.132722 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5430e5-252f-4f90-88b2-0aa220c21ea8 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.134258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 420/844] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:30.137513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c416a-9bc7-403a-81e0-a8cc4d563dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:30.138589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c416a-9bc7-403a-81e0-a8cc4d563dfc None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.139154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c416a-9bc7-403a-81e0-a8cc4d563dfc None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.139637 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c416a-9bc7-403a-81e0-a8cc4d563dfc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.139748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f768c2-3083-4e97-a53c-4d0d829248cf None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.139979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f768c2-3083-4e97-a53c-4d0d829248cf None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.140260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f768c2-3083-4e97-a53c-4d0d829248cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.149297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c416a-9bc7-403a-81e0-a8cc4d563dfc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:30.151616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c416a-9bc7-403a-81e0-a8cc4d563dfc None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:30.160480 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-43f768c2-3083-4e97-a53c-4d0d829248cf None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:30.161679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-43f768c2-3083-4e97-a53c-4d0d829248cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-6b5c416a-9bc7-403a-81e0-a8cc4d563dfc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:30.168099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:30.169045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:30.169997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:30.169997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:30.169997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:30.169997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:30.169997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:30.169997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:30.169997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:30.169997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:30.169997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:50:30.169997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:30.170529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:30.172878 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 425/845] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Jun 23 10:50:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:30.179576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c416a-9bc7-403a-81e0-a8cc4d563dfc None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:30.249565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 421/846] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:30 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:30.275451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f768c2-3083-4e97-a53c-4d0d829248cf None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:30.294950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c416a-9bc7-403a-81e0-a8cc4d563dfc None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:30.332201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8afc2-e859-42a9-a124-71946ad0e3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:30.332889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8afc2-e859-42a9-a124-71946ad0e3b8 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.333175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8afc2-e859-42a9-a124-71946ad0e3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.333453 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8afc2-e859-42a9-a124-71946ad0e3b8 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.334300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8afc2-e859-42a9-a124-71946ad0e3b8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:30.334611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8afc2-e859-42a9-a124-71946ad0e3b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:30.336567 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8afc2-e859-42a9-a124-71946ad0e3b8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:30.340466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:30.361256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 426/847] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Jun 23 10:50:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:30.367894 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8afc2-e859-42a9-a124-71946ad0e3b8 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:30.396708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f768c2-3083-4e97-a53c-4d0d829248cf None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:30.439023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7df228-9abe-471e-aba3-68fea93d6a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:30.440031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df228-9abe-471e-aba3-68fea93d6a67 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.440411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df228-9abe-471e-aba3-68fea93d6a67 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.440787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7df228-9abe-471e-aba3-68fea93d6a67 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.441537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7df228-9abe-471e-aba3-68fea93d6a67 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:30.443013 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7df228-9abe-471e-aba3-68fea93d6a67 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-ae7df228-9abe-471e-aba3-68fea93d6a67 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:30.456101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:30.457229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:50:30.458246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:30.466289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 422/848] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Jun 23 10:50:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:30.466508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7df228-9abe-471e-aba3-68fea93d6a67 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:30.477174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:30.507341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8afc2-e859-42a9-a124-71946ad0e3b8 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:30.549449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3708b-1333-47c2-8bb2-71775c40c2bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:30.550269 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3708b-1333-47c2-8bb2-71775c40c2bc None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.550618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3708b-1333-47c2-8bb2-71775c40c2bc None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.550967 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3708b-1333-47c2-8bb2-71775c40c2bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.597639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7df228-9abe-471e-aba3-68fea93d6a67 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:30.627426 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:30.637102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3708b-1333-47c2-8bb2-71775c40c2bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:30.638986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3708b-1333-47c2-8bb2-71775c40c2bc None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:30.644479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be66f8-f7a2-480c-9e98-7fe38c04b9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:30.645293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be66f8-f7a2-480c-9e98-7fe38c04b9a5 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.645674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be66f8-f7a2-480c-9e98-7fe38c04b9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.646049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53be66f8-f7a2-480c-9e98-7fe38c04b9a5 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.646915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be66f8-f7a2-480c-9e98-7fe38c04b9a5 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:30.647289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be66f8-f7a2-480c-9e98-7fe38c04b9a5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:30.649277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53be66f8-f7a2-480c-9e98-7fe38c04b9a5 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:30.659858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 423/849] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Jun 23 10:50:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:30.662940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be66f8-f7a2-480c-9e98-7fe38c04b9a5 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:30.756659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:30.767372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 427/850] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:30 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 10:50:30.770534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3708b-1333-47c2-8bb2-71775c40c2bc None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:30.800607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53be66f8-f7a2-480c-9e98-7fe38c04b9a5 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:30.838137 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae305f-9354-48f2-813c-505140d37a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:30.839774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae305f-9354-48f2-813c-505140d37a81 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.840299 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae305f-9354-48f2-813c-505140d37a81 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.840940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae305f-9354-48f2-813c-505140d37a81 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.842202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae305f-9354-48f2-813c-505140d37a81 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:30.842961 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae305f-9354-48f2-813c-505140d37a81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:30.844551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eae305f-9354-48f2-813c-505140d37a81 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:30.852068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 424/851] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Jun 23 10:50:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:30.884946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:30.893203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3708b-1333-47c2-8bb2-71775c40c2bc None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:30.933743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4208e6-3c65-4c41-8d9d-29883164ab20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:30.934877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4208e6-3c65-4c41-8d9d-29883164ab20 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:30.935412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4208e6-3c65-4c41-8d9d-29883164ab20 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:30.935901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4208e6-3c65-4c41-8d9d-29883164ab20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:30.949003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4208e6-3c65-4c41-8d9d-29883164ab20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:30.950841 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4208e6-3c65-4c41-8d9d-29883164ab20 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-3e4208e6-3c65-4c41-8d9d-29883164ab20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:30.970693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:30.971647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:30.972664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:30.972664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:30.972664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:30.972664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:30.979449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 428/852] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:30.981148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae305f-9354-48f2-813c-505140d37a81 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.086123 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eae305f-9354-48f2-813c-505140d37a81 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.133836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe98fb4-c712-4ffd-b65e-e0dd04979ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.134713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe98fb4-c712-4ffd-b65e-e0dd04979ef6 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.135000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe98fb4-c712-4ffd-b65e-e0dd04979ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.135282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe98fb4-c712-4ffd-b65e-e0dd04979ef6 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.136046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe98fb4-c712-4ffd-b65e-e0dd04979ef6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:31.136354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe98fb4-c712-4ffd-b65e-e0dd04979ef6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.137743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe98fb4-c712-4ffd-b65e-e0dd04979ef6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.139391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:31.151133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 425/853] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:31.162025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4208e6-3c65-4c41-8d9d-29883164ab20 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.224107 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757824fb-8069-43ca-b1cb-63e000ae8e26 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.224443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757824fb-8069-43ca-b1cb-63e000ae8e26 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.224665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757824fb-8069-43ca-b1cb-63e000ae8e26 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.226425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 426/854] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:31.231454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31eb5d-7864-4eac-adaf-69f4e198d971 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.231738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31eb5d-7864-4eac-adaf-69f4e198d971 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.232034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c31eb5d-7864-4eac-adaf-69f4e198d971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.248355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-0c31eb5d-7864-4eac-adaf-69f4e198d971 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:31.249538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0c31eb5d-7864-4eac-adaf-69f4e198d971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:31.272763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4208e6-3c65-4c41-8d9d-29883164ab20 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.321035 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb931f8a-0361-4f7a-bac4-d89ebc431c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.322357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb931f8a-0361-4f7a-bac4-d89ebc431c92 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.322637 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb931f8a-0361-4f7a-bac4-d89ebc431c92 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.322908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb931f8a-0361-4f7a-bac4-d89ebc431c92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.324929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 427/855] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:31.334679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb931f8a-0361-4f7a-bac4-d89ebc431c92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.336476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb931f8a-0361-4f7a-bac4-d89ebc431c92 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.349174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31eb5d-7864-4eac-adaf-69f4e198d971 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-eb931f8a-0361-4f7a-bac4-d89ebc431c92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:31.353577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:31.354462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:31.355368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:31.355368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:31.355368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:31.355368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:31.355368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:31.355368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:31.355368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:31.355368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:31.362298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 429/856] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:31.363907 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb931f8a-0361-4f7a-bac4-d89ebc431c92 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.373909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:31.456707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c31eb5d-7864-4eac-adaf-69f4e198d971 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.473795 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb931f8a-0361-4f7a-bac4-d89ebc431c92 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.492292 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:31.496830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e19d4a-56f4-418e-9900-1130fe1b6279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.498047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e19d4a-56f4-418e-9900-1130fe1b6279 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.498606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e19d4a-56f4-418e-9900-1130fe1b6279 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.499066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e19d4a-56f4-418e-9900-1130fe1b6279 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.510293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049c8b-8c4f-472c-8d95-14fc728137e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.511064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049c8b-8c4f-472c-8d95-14fc728137e6 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.511382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049c8b-8c4f-472c-8d95-14fc728137e6 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.511741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db049c8b-8c4f-472c-8d95-14fc728137e6 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.512343 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e19d4a-56f4-418e-9900-1130fe1b6279 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:31.512774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049c8b-8c4f-472c-8d95-14fc728137e6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:31.513155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049c8b-8c4f-472c-8d95-14fc728137e6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.514684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db049c8b-8c4f-472c-8d95-14fc728137e6 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-a4e19d4a-56f4-418e-9900-1130fe1b6279 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:31.521047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:31.521974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:31.522794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:31.522794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:31.522794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:31.522794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:31.522794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:31.522794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:31.522794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:31.522794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:31.522794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:31.522794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:31.522794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:31.522794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:31.531184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 428/858] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:50:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:31.535040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 430/858] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:31.535169 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e19d4a-56f4-418e-9900-1130fe1b6279 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.535972 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049c8b-8c4f-472c-8d95-14fc728137e6 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.617063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:31.656057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db049c8b-8c4f-472c-8d95-14fc728137e6 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.679047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e19d4a-56f4-418e-9900-1130fe1b6279 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.693948 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa8761-f3a5-4f8b-b2b0-667a45c09e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.694731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa8761-f3a5-4f8b-b2b0-667a45c09e99 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.695077 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa8761-f3a5-4f8b-b2b0-667a45c09e99 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.695420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa8761-f3a5-4f8b-b2b0-667a45c09e99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.696382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa8761-f3a5-4f8b-b2b0-667a45c09e99 None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=d2bf9ab55d984c3ea3b99126d063e47a) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:31.697316 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa8761-f3a5-4f8b-b2b0-667a45c09e99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.698911 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7faa8761-f3a5-4f8b-b2b0-667a45c09e99 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.711843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 431/859] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:31 2022] GET /identity/v3/role_assignments?user.id=d2bf9ab55d984c3ea3b99126d063e47a&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:31.731329 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf564af-73e5-414e-b794-01302ebb9dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.732042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf564af-73e5-414e-b794-01302ebb9dcb None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.732321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf564af-73e5-414e-b794-01302ebb9dcb None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.732591 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf564af-73e5-414e-b794-01302ebb9dcb None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.733347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf564af-73e5-414e-b794-01302ebb9dcb None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:31.733648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf564af-73e5-414e-b794-01302ebb9dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.735161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf564af-73e5-414e-b794-01302ebb9dcb None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.757424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 429/860] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:50:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:31.763788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa8761-f3a5-4f8b-b2b0-667a45c09e99 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.781393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af92be-9060-4661-bd8f-5ee2577f8437 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.781721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af92be-9060-4661-bd8f-5ee2577f8437 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.781965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5af92be-9060-4661-bd8f-5ee2577f8437 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.783488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 430/861] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:31.788779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cce6b-18ca-4368-8622-f5d3136a0e77 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.789095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cce6b-18ca-4368-8622-f5d3136a0e77 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.789347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866cce6b-18ca-4368-8622-f5d3136a0e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.814340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-866cce6b-18ca-4368-8622-f5d3136a0e77 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:31.816475 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-866cce6b-18ca-4368-8622-f5d3136a0e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:31.877972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:31.892797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa8761-f3a5-4f8b-b2b0-667a45c09e99 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:31.915981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 431/862] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:31 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:31.930373 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:31.938343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743491ff-892e-4ea2-bc32-08880c46e988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:31.939379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cce6b-18ca-4368-8622-f5d3136a0e77 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:31.939517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743491ff-892e-4ea2-bc32-08880c46e988 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:31.939663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743491ff-892e-4ea2-bc32-08880c46e988 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:31.939971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743491ff-892e-4ea2-bc32-08880c46e988 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:31.953409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743491ff-892e-4ea2-bc32-08880c46e988 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:31.955377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743491ff-892e-4ea2-bc32-08880c46e988 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-743491ff-892e-4ea2-bc32-08880c46e988 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:31.979099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:31.980082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:31.980974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:31.980974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:31.980974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:31.980974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:31.981298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 432/863] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:31.987654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743491ff-892e-4ea2-bc32-08880c46e988 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:32.085087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866cce6b-18ca-4368-8622-f5d3136a0e77 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:32.118256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743491ff-892e-4ea2-bc32-08880c46e988 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:32.131482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965252e4-abbd-412b-a039-0a6b18cf5843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:32.132290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965252e4-abbd-412b-a039-0a6b18cf5843 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:32.132728 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965252e4-abbd-412b-a039-0a6b18cf5843 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:32.133108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965252e4-abbd-412b-a039-0a6b18cf5843 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:32.134444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965252e4-abbd-412b-a039-0a6b18cf5843 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:32.136132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965252e4-abbd-412b-a039-0a6b18cf5843 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:32.166114 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce65dd4-1896-4e2d-991f-0f46e879846b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:32.166959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce65dd4-1896-4e2d-991f-0f46e879846b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:32.167230 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce65dd4-1896-4e2d-991f-0f46e879846b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:32.167780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce65dd4-1896-4e2d-991f-0f46e879846b None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:32.168667 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce65dd4-1896-4e2d-991f-0f46e879846b None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:32.169019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce65dd4-1896-4e2d-991f-0f46e879846b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:32.170396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce65dd4-1896-4e2d-991f-0f46e879846b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:32.183922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 433/864] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:32.188882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce65dd4-1896-4e2d-991f-0f46e879846b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:32.211845 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 432/865] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:50:31 2022] POST /identity/v3/services => generated 251 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:32.247859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:32.322091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce65dd4-1896-4e2d-991f-0f46e879846b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:32.366684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775854c0-21bb-4262-a18b-123459728650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:32.367403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775854c0-21bb-4262-a18b-123459728650 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:32.367684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775854c0-21bb-4262-a18b-123459728650 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:32.367985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775854c0-21bb-4262-a18b-123459728650 None admin] PATH_INFO: `/v3/users/swift` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:32.377116 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775854c0-21bb-4262-a18b-123459728650 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:32.378559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775854c0-21bb-4262-a18b-123459728650 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-775854c0-21bb-4262-a18b-123459728650 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:32.394001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:32.394983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:32.395994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:32.395994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:32.395994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:32.395994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:32.395994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:32.395994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:32.395994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:32.395994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:32.395994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 23 10:50:32.395994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:32.395994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 434/866] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:50:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:32.403785 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965252e4-abbd-412b-a039-0a6b18cf5843 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:32.443970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:32.512860 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965252e4-abbd-412b-a039-0a6b18cf5843 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:32.548410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8519c-a6d7-48bd-ade8-ea8f88bd783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:32.549428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8519c-a6d7-48bd-ade8-ea8f88bd783b None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:32.549934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8519c-a6d7-48bd-ade8-ea8f88bd783b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:32.550401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8519c-a6d7-48bd-ade8-ea8f88bd783b None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:32.551446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8519c-a6d7-48bd-ade8-ea8f88bd783b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:32.551973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8519c-a6d7-48bd-ade8-ea8f88bd783b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:32.553667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8519c-a6d7-48bd-ade8-ea8f88bd783b None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:32.573494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 433/867] 10.222.0.52 () {56 vars in 1135 bytes} [Thu Jun 23 10:50:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:32.580475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775854c0-21bb-4262-a18b-123459728650 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:32.684827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:32.688724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775854c0-21bb-4262-a18b-123459728650 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:32.724325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5310abd-d7db-4806-a73e-6986e3b26d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:32.724979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5310abd-d7db-4806-a73e-6986e3b26d48 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:32.725269 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5310abd-d7db-4806-a73e-6986e3b26d48 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:32.725549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5310abd-d7db-4806-a73e-6986e3b26d48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:32.799257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5310abd-d7db-4806-a73e-6986e3b26d48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:32.800752 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5310abd-d7db-4806-a73e-6986e3b26d48 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:32.898989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:32.908049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 435/868] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:32 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 10:50:32.908964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8519c-a6d7-48bd-ade8-ea8f88bd783b None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:33.005853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b490-5b77-4ca6-95c6-eaacf61b3637 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.006217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b490-5b77-4ca6-95c6-eaacf61b3637 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.006418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc9b490-5b77-4ca6-95c6-eaacf61b3637 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.007984 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 436/869] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:33.014122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:33.016548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8055-df8c-404c-a518-d2ba713f0086 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.016830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8055-df8c-404c-a518-d2ba713f0086 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.017103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6da8055-df8c-404c-a518-d2ba713f0086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.029934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8519c-a6d7-48bd-ade8-ea8f88bd783b None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:33.034787 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-d6da8055-df8c-404c-a518-d2ba713f0086 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:33.036015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d6da8055-df8c-404c-a518-d2ba713f0086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:33.076608 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df46740-7ce6-4b26-bcb5-65eebf390361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:33.077771 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df46740-7ce6-4b26-bcb5-65eebf390361 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.078293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df46740-7ce6-4b26-bcb5-65eebf390361 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.078771 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df46740-7ce6-4b26-bcb5-65eebf390361 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.093037 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df46740-7ce6-4b26-bcb5-65eebf390361 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:33.095354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df46740-7ce6-4b26-bcb5-65eebf390361 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-2df46740-7ce6-4b26-bcb5-65eebf390361 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:33.118130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:33.119987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:33.120916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:33.120916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:33.120916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:33.120916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:33.120916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 434/871] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:33.121500 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 437/871] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:33 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:33.124282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df46740-7ce6-4b26-bcb5-65eebf390361 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:33.142313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8055-df8c-404c-a518-d2ba713f0086 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:33.237136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df46740-7ce6-4b26-bcb5-65eebf390361 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:33.252261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6da8055-df8c-404c-a518-d2ba713f0086 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:33.272373 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b935-59f4-4706-a933-95b260d2dccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:33.272954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b935-59f4-4706-a933-95b260d2dccf None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.273233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b935-59f4-4706-a933-95b260d2dccf None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.273508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af49b935-59f4-4706-a933-95b260d2dccf None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.274222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b935-59f4-4706-a933-95b260d2dccf None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:33.275202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b935-59f4-4706-a933-95b260d2dccf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:33.276611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af49b935-59f4-4706-a933-95b260d2dccf None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:33.288405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 435/872] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:33.288570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:33.292804 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d7966-6a9f-4ffa-8ffd-9a4ba42979fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:33.294116 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d7966-6a9f-4ffa-8ffd-9a4ba42979fb None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.301415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b935-59f4-4706-a933-95b260d2dccf None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:33.301549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d7966-6a9f-4ffa-8ffd-9a4ba42979fb None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.301549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d7966-6a9f-4ffa-8ffd-9a4ba42979fb None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.301549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d7966-6a9f-4ffa-8ffd-9a4ba42979fb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:33.301549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d7966-6a9f-4ffa-8ffd-9a4ba42979fb None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:33.303776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:33.394047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af49b935-59f4-4706-a933-95b260d2dccf None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:33.417462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 438/873] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:50:33 2022] POST /identity/v3/services => generated 269 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:50:33.455910 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93721f30-d0a1-4ceb-bd0c-7de69198e8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:33.456797 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93721f30-d0a1-4ceb-bd0c-7de69198e8af None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.457090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93721f30-d0a1-4ceb-bd0c-7de69198e8af None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.457416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93721f30-d0a1-4ceb-bd0c-7de69198e8af None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.467319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93721f30-d0a1-4ceb-bd0c-7de69198e8af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:33.469039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93721f30-d0a1-4ceb-bd0c-7de69198e8af None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-93721f30-d0a1-4ceb-bd0c-7de69198e8af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:33.485533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:33.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:33.487800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:33.487800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:33.487800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:33.487800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:33.487800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:33.487800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:33.487800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:33.487800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:33.487800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 436/874] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:33.498136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d7966-6a9f-4ffa-8ffd-9a4ba42979fb None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:33.626625 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d7966-6a9f-4ffa-8ffd-9a4ba42979fb None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:33.662120 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba03414-5f86-481d-9bbf-137d6bb0c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:33.662793 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba03414-5f86-481d-9bbf-137d6bb0c751 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.663079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba03414-5f86-481d-9bbf-137d6bb0c751 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.663361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba03414-5f86-481d-9bbf-137d6bb0c751 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.664189 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba03414-5f86-481d-9bbf-137d6bb0c751 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:33.664499 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba03414-5f86-481d-9bbf-137d6bb0c751 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:33.666486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba03414-5f86-481d-9bbf-137d6bb0c751 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:33.679667 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 439/875] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:33.685655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93721f30-d0a1-4ceb-bd0c-7de69198e8af None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:33.749956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:33.789396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93721f30-d0a1-4ceb-bd0c-7de69198e8af None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:33.824970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98628317-932f-4cf7-942f-061e23af8faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:33.825628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98628317-932f-4cf7-942f-061e23af8faa None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.825909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98628317-932f-4cf7-942f-061e23af8faa None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.826185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98628317-932f-4cf7-942f-061e23af8faa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.827027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98628317-932f-4cf7-942f-061e23af8faa None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=dd54976bc4b541a89a0c15788bfb71ed) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:33.827337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98628317-932f-4cf7-942f-061e23af8faa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:33.828811 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98628317-932f-4cf7-942f-061e23af8faa None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:33.835638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 437/876] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:33 2022] GET /identity/v3/role_assignments?user.id=dd54976bc4b541a89a0c15788bfb71ed&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:33.963623 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29575828-07a7-47a3-a42f-830676db034a None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.964020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29575828-07a7-47a3-a42f-830676db034a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.964208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29575828-07a7-47a3-a42f-830676db034a None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.965908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 440/877] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:33.971590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72892f-f506-4c36-b310-f00aa08d80da None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:33.971902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72892f-f506-4c36-b310-f00aa08d80da None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:33.972179 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d72892f-f506-4c36-b310-f00aa08d80da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:33.989986 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5d72892f-f506-4c36-b310-f00aa08d80da None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:33.991180 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5d72892f-f506-4c36-b310-f00aa08d80da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:34.064525 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 438/878] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:34.088383 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29575828-07a7-47a3-a42f-830676db034a None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.143534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:34.197012 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29575828-07a7-47a3-a42f-830676db034a None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:34.233898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb62ebe-83c5-413b-8675-dff46c5303f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:34.235122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb62ebe-83c5-413b-8675-dff46c5303f3 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.235621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb62ebe-83c5-413b-8675-dff46c5303f3 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.236205 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb62ebe-83c5-413b-8675-dff46c5303f3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.248662 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb62ebe-83c5-413b-8675-dff46c5303f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-ecb62ebe-83c5-413b-8675-dff46c5303f3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:34.257194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:34.258124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:34.259478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:34.259478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:34.259478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:34.259478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:34.259478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:34.259478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:34.259478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:34.259478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:34.259478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:34.259478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:34.259478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:50:34.259478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:34.262311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 441/879] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Jun 23 10:50:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:34.267846 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72892f-f506-4c36-b310-f00aa08d80da None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.335117 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:34.380791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d72892f-f506-4c36-b310-f00aa08d80da None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:34.418149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b204083-9730-45bb-89a8-d6f31a42360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:34.419258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b204083-9730-45bb-89a8-d6f31a42360f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.420891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01348e56-4bc5-4a78-960e-3d0e9fa7e265 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.421171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01348e56-4bc5-4a78-960e-3d0e9fa7e265 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.421447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01348e56-4bc5-4a78-960e-3d0e9fa7e265 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.421791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b204083-9730-45bb-89a8-d6f31a42360f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.422296 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b204083-9730-45bb-89a8-d6f31a42360f None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.423067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 442/880] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:34.423471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b204083-9730-45bb-89a8-d6f31a42360f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:34.423792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b204083-9730-45bb-89a8-d6f31a42360f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:34.425230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b204083-9730-45bb-89a8-d6f31a42360f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:34.433174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92d1b9-4d76-49a5-b348-b7ff184f80f8 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.433361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92d1b9-4d76-49a5-b348-b7ff184f80f8 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.433549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c92d1b9-4d76-49a5-b348-b7ff184f80f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.437093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 439/881] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Jun 23 10:50:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:34.442713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b204083-9730-45bb-89a8-d6f31a42360f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.452153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0c92d1b9-4d76-49a5-b348-b7ff184f80f8 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:34.453368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0c92d1b9-4d76-49a5-b348-b7ff184f80f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:34.524302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 443/882] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:34.548194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b204083-9730-45bb-89a8-d6f31a42360f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:34.548576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92d1b9-4d76-49a5-b348-b7ff184f80f8 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.568446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:34.590462 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddd0df-baca-4b87-9158-35c1a517bb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:34.591623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddd0df-baca-4b87-9158-35c1a517bb62 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.592201 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddd0df-baca-4b87-9158-35c1a517bb62 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.592614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ddd0df-baca-4b87-9158-35c1a517bb62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.604625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddd0df-baca-4b87-9158-35c1a517bb62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:34.605460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:34.606657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ddd0df-baca-4b87-9158-35c1a517bb62 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-c9ddd0df-baca-4b87-9158-35c1a517bb62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:34.624537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:34.625851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:34.626755 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:34.626755 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:34.626755 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:34.626755 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:34.637915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 440/883] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:34.637915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddd0df-baca-4b87-9158-35c1a517bb62 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.685620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c92d1b9-4d76-49a5-b348-b7ff184f80f8 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:34.737096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcce4a-d883-4d77-80d7-0d163a11142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:34.737896 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcce4a-d883-4d77-80d7-0d163a11142a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.738182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcce4a-d883-4d77-80d7-0d163a11142a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.738461 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcce4a-d883-4d77-80d7-0d163a11142a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.739224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcce4a-d883-4d77-80d7-0d163a11142a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:34.740734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcce4a-d883-4d77-80d7-0d163a11142a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:34.746734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ddd0df-baca-4b87-9158-35c1a517bb62 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-14bcce4a-d883-4d77-80d7-0d163a11142a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:34.753773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:34.754936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:50:34.755927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:34.760179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 444/884] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:50:34 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:34.761536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcce4a-d883-4d77-80d7-0d163a11142a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.785876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de238e-e6d7-4dcc-af9f-6231aa224b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:34.786820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de238e-e6d7-4dcc-af9f-6231aa224b14 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.787243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de238e-e6d7-4dcc-af9f-6231aa224b14 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.787726 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45de238e-e6d7-4dcc-af9f-6231aa224b14 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.788594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de238e-e6d7-4dcc-af9f-6231aa224b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:34.789061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de238e-e6d7-4dcc-af9f-6231aa224b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:34.791643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45de238e-e6d7-4dcc-af9f-6231aa224b14 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:34.808023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 441/885] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:34.810657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de238e-e6d7-4dcc-af9f-6231aa224b14 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.841853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:34.870478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcce4a-d883-4d77-80d7-0d163a11142a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:34.872188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:34.909534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3428422-6f43-4283-96c3-fdc2f909b8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:34.910225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3428422-6f43-4283-96c3-fdc2f909b8ca None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.910443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3428422-6f43-4283-96c3-fdc2f909b8ca None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.910764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3428422-6f43-4283-96c3-fdc2f909b8ca None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.911435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3428422-6f43-4283-96c3-fdc2f909b8ca None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:34.911748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3428422-6f43-4283-96c3-fdc2f909b8ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:34.913337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3428422-6f43-4283-96c3-fdc2f909b8ca None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:34.916758 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45de238e-e6d7-4dcc-af9f-6231aa224b14 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:34.923763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 445/886] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:50:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:34.925108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3428422-6f43-4283-96c3-fdc2f909b8ca None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:34.953072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd4b7a-edda-43fa-9e97-8d0b6cdbb0f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:34.954178 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd4b7a-edda-43fa-9e97-8d0b6cdbb0f2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:34.954658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd4b7a-edda-43fa-9e97-8d0b6cdbb0f2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:34.955084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd4b7a-edda-43fa-9e97-8d0b6cdbb0f2 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:34.962960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd4b7a-edda-43fa-9e97-8d0b6cdbb0f2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:34.964685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd4b7a-edda-43fa-9e97-8d0b6cdbb0f2 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-a5bd4b7a-edda-43fa-9e97-8d0b6cdbb0f2 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:34.981081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:34.982090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:34.983004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:34.983004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:34.983004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:34.983004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:34.983004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:34.983004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:34.983004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:34.983004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:34.983004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:50:34.983004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:34.990011 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 442/887] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Jun 23 10:50:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:34.991168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd4b7a-edda-43fa-9e97-8d0b6cdbb0f2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.037726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3428422-6f43-4283-96c3-fdc2f909b8ca None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.075128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a37dd8-c378-4694-967e-20027afbe341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.075828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a37dd8-c378-4694-967e-20027afbe341 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.076122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a37dd8-c378-4694-967e-20027afbe341 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.076412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a37dd8-c378-4694-967e-20027afbe341 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.077196 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a37dd8-c378-4694-967e-20027afbe341 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:35.077510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a37dd8-c378-4694-967e-20027afbe341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.079331 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a37dd8-c378-4694-967e-20027afbe341 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.089608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 446/888] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:50:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:35.090478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:35.091914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a37dd8-c378-4694-967e-20027afbe341 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.099161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd4b7a-edda-43fa-9e97-8d0b6cdbb0f2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.135677 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b305444-0e56-4c82-9bef-828680a1bc59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.136777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b305444-0e56-4c82-9bef-828680a1bc59 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.137281 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b305444-0e56-4c82-9bef-828680a1bc59 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.137762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b305444-0e56-4c82-9bef-828680a1bc59 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.138784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b305444-0e56-4c82-9bef-828680a1bc59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:35.139290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b305444-0e56-4c82-9bef-828680a1bc59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.140286 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:35.141183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b305444-0e56-4c82-9bef-828680a1bc59 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.164475 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 443/889] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Jun 23 10:50:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:35.166250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b305444-0e56-4c82-9bef-828680a1bc59 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.210715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a37dd8-c378-4694-967e-20027afbe341 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.249586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db7079-3b78-4f77-8816-86d4687526e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.250254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db7079-3b78-4f77-8816-86d4687526e1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.250542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db7079-3b78-4f77-8816-86d4687526e1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.250826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09db7079-3b78-4f77-8816-86d4687526e1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.251785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db7079-3b78-4f77-8816-86d4687526e1 None admin] RBAC: Adding query filter params (interface=public, service_id=257dc6d361774c7e9ffc4cb70e8eee2b, region_id=RegionOne) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:35.252088 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db7079-3b78-4f77-8816-86d4687526e1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.253468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09db7079-3b78-4f77-8816-86d4687526e1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.263974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 447/890] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/endpoints?service_id=257dc6d361774c7e9ffc4cb70e8eee2b&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:35.265284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db7079-3b78-4f77-8816-86d4687526e1 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.270937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b305444-0e56-4c82-9bef-828680a1bc59 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.307306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13807c1-c8f8-40f5-aa93-6f1fa316ab3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.308389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13807c1-c8f8-40f5-aa93-6f1fa316ab3a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.309031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13807c1-c8f8-40f5-aa93-6f1fa316ab3a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.309502 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13807c1-c8f8-40f5-aa93-6f1fa316ab3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.328769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:35.377329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09db7079-3b78-4f77-8816-86d4687526e1 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.380227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:35.382472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13807c1-c8f8-40f5-aa93-6f1fa316ab3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.384200 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13807c1-c8f8-40f5-aa93-6f1fa316ab3a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.414573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1afe72-5c0d-4b9b-baf2-981ec7f29e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.415256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1afe72-5c0d-4b9b-baf2-981ec7f29e2b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.415546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1afe72-5c0d-4b9b-baf2-981ec7f29e2b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.415842 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1afe72-5c0d-4b9b-baf2-981ec7f29e2b None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.416663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1afe72-5c0d-4b9b-baf2-981ec7f29e2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.418239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1afe72-5c0d-4b9b-baf2-981ec7f29e2b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.432062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 448/891] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:50:35.498484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 444/892] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:50:35.504652 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1afe72-5c0d-4b9b-baf2-981ec7f29e2b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.621902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1afe72-5c0d-4b9b-baf2-981ec7f29e2b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.658800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ae412-6685-4f1e-acbe-9e6b35afafbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.660005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ae412-6685-4f1e-acbe-9e6b35afafbf None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.660518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ae412-6685-4f1e-acbe-9e6b35afafbf None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.661055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99ae412-6685-4f1e-acbe-9e6b35afafbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.673431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ae412-6685-4f1e-acbe-9e6b35afafbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.675152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99ae412-6685-4f1e-acbe-9e6b35afafbf None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-f99ae412-6685-4f1e-acbe-9e6b35afafbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:35.693057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:35.694420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:35.695294 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:35.695294 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:35.695294 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:35.695294 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:35.695513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04fe0-347d-4d7b-a0c5-86de2581b435 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.695513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04fe0-347d-4d7b-a0c5-86de2581b435 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.695513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd04fe0-347d-4d7b-a0c5-86de2581b435 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.695691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 445/893] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:35.698357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 449/894] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:35.702865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4f827-cd22-4005-9f8f-30ebd0e1cae5 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.702865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4f827-cd22-4005-9f8f-30ebd0e1cae5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.702865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d4f827-cd22-4005-9f8f-30ebd0e1cae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.704187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ae412-6685-4f1e-acbe-9e6b35afafbf None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.719412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b6d4f827-cd22-4005-9f8f-30ebd0e1cae5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:35.720459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:35.720644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b6d4f827-cd22-4005-9f8f-30ebd0e1cae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:35.772195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:35.802988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 446/895] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:35.822802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4f827-cd22-4005-9f8f-30ebd0e1cae5 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.838362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99ae412-6685-4f1e-acbe-9e6b35afafbf None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.883947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c354635-a429-4bcd-ab0d-82b59d9e9349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.885498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c354635-a429-4bcd-ab0d-82b59d9e9349 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.885976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c354635-a429-4bcd-ab0d-82b59d9e9349 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.886442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c354635-a429-4bcd-ab0d-82b59d9e9349 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.887834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c354635-a429-4bcd-ab0d-82b59d9e9349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:35.888606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c354635-a429-4bcd-ab0d-82b59d9e9349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.890185 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c354635-a429-4bcd-ab0d-82b59d9e9349 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.911059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 450/896] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:35.913432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c354635-a429-4bcd-ab0d-82b59d9e9349 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:35.932510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d4f827-cd22-4005-9f8f-30ebd0e1cae5 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:35.973055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb1ebf1-b824-4ed6-ab3a-7569b0976c1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:35.974374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1ebf1-b824-4ed6-ab3a-7569b0976c1d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.974937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1ebf1-b824-4ed6-ab3a-7569b0976c1d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.975381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb1ebf1-b824-4ed6-ab3a-7569b0976c1d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.976293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1ebf1-b824-4ed6-ab3a-7569b0976c1d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:35.977848 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb1ebf1-b824-4ed6-ab3a-7569b0976c1d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-ecb1ebf1-b824-4ed6-ab3a-7569b0976c1d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:35.992925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:35.994141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:35.995167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 447/897] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:35.996399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6c8c6-bc3f-4da0-8cc8-dfb2cdf10f82 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:35.996399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6c8c6-bc3f-4da0-8cc8-dfb2cdf10f82 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:35.996399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee6c8c6-bc3f-4da0-8cc8-dfb2cdf10f82 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:35.997535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 448/898] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:36.002227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6c8c6-bc3f-4da0-8cc8-dfb2cdf10f82 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.004158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:36.030561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c354635-a429-4bcd-ab0d-82b59d9e9349 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.051072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:36.067578 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240907d-c14e-4ff4-959c-2bcc90130bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.068469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240907d-c14e-4ff4-959c-2bcc90130bb3 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.068719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240907d-c14e-4ff4-959c-2bcc90130bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.068971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240907d-c14e-4ff4-959c-2bcc90130bb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.076392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240907d-c14e-4ff4-959c-2bcc90130bb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.077848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240907d-c14e-4ff4-959c-2bcc90130bb3 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-1240907d-c14e-4ff4-959c-2bcc90130bb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:36.092524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:36.093605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:36.095071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:36.095071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:36.095071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:36.095071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:36.095071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:36.095071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:36.095071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:36.095071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:36.095071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 451/899] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:36.099872 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52764e2-4924-4c4d-8820-b994da3374c7 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.100168 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52764e2-4924-4c4d-8820-b994da3374c7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.100453 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52764e2-4924-4c4d-8820-b994da3374c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.116380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee6c8c6-bc3f-4da0-8cc8-dfb2cdf10f82 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.118529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-d52764e2-4924-4c4d-8820-b994da3374c7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:36.119731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d52764e2-4924-4c4d-8820-b994da3374c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:36.157416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893758d-e949-41ad-8a3a-0903ef88a5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.158213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893758d-e949-41ad-8a3a-0903ef88a5e3 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.158506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893758d-e949-41ad-8a3a-0903ef88a5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.158792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d893758d-e949-41ad-8a3a-0903ef88a5e3 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.159496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893758d-e949-41ad-8a3a-0903ef88a5e3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:36.159821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893758d-e949-41ad-8a3a-0903ef88a5e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.161241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d893758d-e949-41ad-8a3a-0903ef88a5e3 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.171148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 449/900] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Jun 23 10:50:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:36.171148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893758d-e949-41ad-8a3a-0903ef88a5e3 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.198186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 452/901] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:36.198957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52764e2-4924-4c4d-8820-b994da3374c7 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.266886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:36.294252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d893758d-e949-41ad-8a3a-0903ef88a5e3 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.303380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:36.309794 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52764e2-4924-4c4d-8820-b994da3374c7 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.334828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4ba81-c9ee-4475-bd5e-2fd31ddb5865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.335491 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ba81-c9ee-4475-bd5e-2fd31ddb5865 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.335825 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ba81-c9ee-4475-bd5e-2fd31ddb5865 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.336080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e4ba81-c9ee-4475-bd5e-2fd31ddb5865 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.336873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4ba81-c9ee-4475-bd5e-2fd31ddb5865 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:36.337180 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4ba81-c9ee-4475-bd5e-2fd31ddb5865 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.338602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e4ba81-c9ee-4475-bd5e-2fd31ddb5865 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.346176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0fd74-6b07-44d8-a5fc-56cfb67402f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.346980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0fd74-6b07-44d8-a5fc-56cfb67402f4 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.347115 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0fd74-6b07-44d8-a5fc-56cfb67402f4 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.347370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0fd74-6b07-44d8-a5fc-56cfb67402f4 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.348351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0fd74-6b07-44d8-a5fc-56cfb67402f4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:36.348663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0fd74-6b07-44d8-a5fc-56cfb67402f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.350023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0fd74-6b07-44d8-a5fc-56cfb67402f4 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.354256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 450/902] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:36.355250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4ba81-c9ee-4475-bd5e-2fd31ddb5865 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.355383 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 453/903] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Jun 23 10:50:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:36.359885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0fd74-6b07-44d8-a5fc-56cfb67402f4 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.471567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e4ba81-c9ee-4475-bd5e-2fd31ddb5865 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.475915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0fd74-6b07-44d8-a5fc-56cfb67402f4 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.500685 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:36.510698 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36d4b0-07c1-4301-b32c-ddafde25166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.511575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36d4b0-07c1-4301-b32c-ddafde25166e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.511883 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36d4b0-07c1-4301-b32c-ddafde25166e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.512161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d36d4b0-07c1-4301-b32c-ddafde25166e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.527971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fe1ea-5005-4574-a9d2-09dc68e6d275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.527971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fe1ea-5005-4574-a9d2-09dc68e6d275 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.528206 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36d4b0-07c1-4301-b32c-ddafde25166e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.528292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fe1ea-5005-4574-a9d2-09dc68e6d275 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.528292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797fe1ea-5005-4574-a9d2-09dc68e6d275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.528292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797fe1ea-5005-4574-a9d2-09dc68e6d275 None admin] RBAC: Adding query filter params (role.id=8503ee09d8864888a0153b6be38559dc, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=d2bf9ab55d984c3ea3b99126d063e47a) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:36.528537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d36d4b0-07c1-4301-b32c-ddafde25166e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.528624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797fe1ea-5005-4574-a9d2-09dc68e6d275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.528624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797fe1ea-5005-4574-a9d2-09dc68e6d275 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.528624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 454/904] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:36 2022] GET /identity/v3/role_assignments?user.id=d2bf9ab55d984c3ea3b99126d063e47a&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=8503ee09d8864888a0153b6be38559dc => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:36.528624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fe1ea-5005-4574-a9d2-09dc68e6d275 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-9d36d4b0-07c1-4301-b32c-ddafde25166e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:36.528914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:36.529937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:36.530799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 451/905] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Jun 23 10:50:36 2022] GET /identity/v3/services/object-store => generated 93 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:36.535716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36d4b0-07c1-4301-b32c-ddafde25166e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.589639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:36.678197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d36d4b0-07c1-4301-b32c-ddafde25166e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.691182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797fe1ea-5005-4574-a9d2-09dc68e6d275 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.720381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4314-fb0f-4ac3-b63c-56c2410968c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.721051 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4314-fb0f-4ac3-b63c-56c2410968c5 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.721441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4314-fb0f-4ac3-b63c-56c2410968c5 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.721777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb4314-fb0f-4ac3-b63c-56c2410968c5 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.722427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb4314-fb0f-4ac3-b63c-56c2410968c5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:36.722735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb4314-fb0f-4ac3-b63c-56c2410968c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.724507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb4314-fb0f-4ac3-b63c-56c2410968c5 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.730687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 452/906] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Jun 23 10:50:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:36.736732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4314-fb0f-4ac3-b63c-56c2410968c5 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.743503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb108ed-99ab-4faf-91c2-f55ad7e18cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.744203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb108ed-99ab-4faf-91c2-f55ad7e18cc5 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.744494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb108ed-99ab-4faf-91c2-f55ad7e18cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.744777 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb108ed-99ab-4faf-91c2-f55ad7e18cc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.745579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb108ed-99ab-4faf-91c2-f55ad7e18cc5 None admin] RBAC: Adding query filter params (interface=public, service_id=0b2b902ac6b741b4b44db9cd770c60eb, region_id=RegionOne) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:36.745895 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb108ed-99ab-4faf-91c2-f55ad7e18cc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.747281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb108ed-99ab-4faf-91c2-f55ad7e18cc5 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.755846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 455/907] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Jun 23 10:50:36 2022] GET /identity/v3/endpoints?service_id=0b2b902ac6b741b4b44db9cd770c60eb&interface=public®ion_id=RegionOne => generated 194 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:36.761969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb108ed-99ab-4faf-91c2-f55ad7e18cc5 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:36.828920 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:36.871168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:36.880256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb4314-fb0f-4ac3-b63c-56c2410968c5 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.900996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb108ed-99ab-4faf-91c2-f55ad7e18cc5 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:36.913757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d60c97-aa50-4cf0-b83e-ee96c8475859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.914428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d60c97-aa50-4cf0-b83e-ee96c8475859 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.914715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d60c97-aa50-4cf0-b83e-ee96c8475859 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.915564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d60c97-aa50-4cf0-b83e-ee96c8475859 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.916376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d60c97-aa50-4cf0-b83e-ee96c8475859 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:36.916687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d60c97-aa50-4cf0-b83e-ee96c8475859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.918059 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d60c97-aa50-4cf0-b83e-ee96c8475859 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.923215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 453/908] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Jun 23 10:50:36 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:36.948376 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75104587-c89f-4fb9-8681-f3557c1a608e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:36.949063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104587-c89f-4fb9-8681-f3557c1a608e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:36.949343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104587-c89f-4fb9-8681-f3557c1a608e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:36.949663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75104587-c89f-4fb9-8681-f3557c1a608e None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:36.950363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75104587-c89f-4fb9-8681-f3557c1a608e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:36.951765 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75104587-c89f-4fb9-8681-f3557c1a608e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:36.958780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 456/909] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Jun 23 10:50:36 2022] GET /identity/v3/services => generated 1268 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:37.566650 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b6811-2f8a-4782-b00a-b95126f61e52 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:37.567065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b6811-2f8a-4782-b00a-b95126f61e52 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:37.567223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b6811-2f8a-4782-b00a-b95126f61e52 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:37.568975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 454/910] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:37.574978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50440a2-1f7b-4378-b8d1-3474b2401356 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:37.575277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50440a2-1f7b-4378-b8d1-3474b2401356 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:37.575561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50440a2-1f7b-4378-b8d1-3474b2401356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:37.593424 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a50440a2-1f7b-4378-b8d1-3474b2401356 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:37.594903 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a50440a2-1f7b-4378-b8d1-3474b2401356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:37.664762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 457/911] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:37.688036 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b6811-2f8a-4782-b00a-b95126f61e52 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:37.799750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b6811-2f8a-4782-b00a-b95126f61e52 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:37.835939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45f898-0aea-4e77-a7d9-80f6a9102069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:37.837167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45f898-0aea-4e77-a7d9-80f6a9102069 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:37.837474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45f898-0aea-4e77-a7d9-80f6a9102069 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:37.837749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab45f898-0aea-4e77-a7d9-80f6a9102069 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:37.838394 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45f898-0aea-4e77-a7d9-80f6a9102069 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:37.839751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab45f898-0aea-4e77-a7d9-80f6a9102069 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-ab45f898-0aea-4e77-a7d9-80f6a9102069 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:37.851778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:37.853317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:37.854155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 455/912] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:50:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:37.861326 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50440a2-1f7b-4378-b8d1-3474b2401356 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:37.908620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:37.962953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50440a2-1f7b-4378-b8d1-3474b2401356 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:37.997817 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc613d35-147a-4fbe-99f3-f3e103261ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:37.998477 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613d35-147a-4fbe-99f3-f3e103261ca1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:37.998758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613d35-147a-4fbe-99f3-f3e103261ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:37.999034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc613d35-147a-4fbe-99f3-f3e103261ca1 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:37.999733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc613d35-147a-4fbe-99f3-f3e103261ca1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:38.000068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc613d35-147a-4fbe-99f3-f3e103261ca1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:38.001427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc613d35-147a-4fbe-99f3-f3e103261ca1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:38.006503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 458/913] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:50:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:38.012916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45f898-0aea-4e77-a7d9-80f6a9102069 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:38.039637 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:38.125008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab45f898-0aea-4e77-a7d9-80f6a9102069 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:38.159957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7863e50b-a0f3-4d5f-8df8-8c8393c48f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:38.160618 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863e50b-a0f3-4d5f-8df8-8c8393c48f08 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.160898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863e50b-a0f3-4d5f-8df8-8c8393c48f08 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.161168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7863e50b-a0f3-4d5f-8df8-8c8393c48f08 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.161862 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863e50b-a0f3-4d5f-8df8-8c8393c48f08 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:38.162162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863e50b-a0f3-4d5f-8df8-8c8393c48f08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:38.163527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7863e50b-a0f3-4d5f-8df8-8c8393c48f08 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:38.169578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 456/914] 10.222.0.52 () {56 vars in 1114 bytes} [Thu Jun 23 10:50:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:38.176927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc613d35-147a-4fbe-99f3-f3e103261ca1 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:38.288859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc613d35-147a-4fbe-99f3-f3e103261ca1 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:38.299913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:38.324723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21481ffc-d8a6-47e4-b5c4-90282477cada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:38.325391 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21481ffc-d8a6-47e4-b5c4-90282477cada None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.325700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21481ffc-d8a6-47e4-b5c4-90282477cada None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.325947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21481ffc-d8a6-47e4-b5c4-90282477cada None admin] PATH_INFO: `/v3/endpoints` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.327318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21481ffc-d8a6-47e4-b5c4-90282477cada None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:38.328967 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21481ffc-d8a6-47e4-b5c4-90282477cada None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:38.394406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 459/915] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Jun 23 10:50:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:38.678397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e4a1-4949-46b1-9f8a-4c6bd0bb0927 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.678913 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e4a1-4949-46b1-9f8a-4c6bd0bb0927 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.679359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e0e4a1-4949-46b1-9f8a-4c6bd0bb0927 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.681166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 457/916] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:38.686848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6b02b-4464-4ecd-a041-1e7d48893403 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.687393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6b02b-4464-4ecd-a041-1e7d48893403 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.687915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6b02b-4464-4ecd-a041-1e7d48893403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.708604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-77d6b02b-4464-4ecd-a041-1e7d48893403 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:38.710164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-77d6b02b-4464-4ecd-a041-1e7d48893403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:38.789293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 460/917] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:38.812696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0e4a1-4949-46b1-9f8a-4c6bd0bb0927 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:38.916196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:38.924507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e0e4a1-4949-46b1-9f8a-4c6bd0bb0927 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:38.960197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed6f842-8062-4450-b672-02442f1dae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:38.961009 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6f842-8062-4450-b672-02442f1dae64 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:38.961288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6f842-8062-4450-b672-02442f1dae64 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:38.961563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed6f842-8062-4450-b672-02442f1dae64 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:38.972752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed6f842-8062-4450-b672-02442f1dae64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-5ed6f842-8062-4450-b672-02442f1dae64 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:38.981734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:38.982897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:38.983770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 458/918] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Jun 23 10:50:38 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:38.989368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6b02b-4464-4ecd-a041-1e7d48893403 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:39.028654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f7158-3fb1-4ce0-b4bc-70fcbc20424a None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.029204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f7158-3fb1-4ce0-b4bc-70fcbc20424a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.029204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f7158-3fb1-4ce0-b4bc-70fcbc20424a None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.030561 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 459/919] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:39.035969 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c64e4-9527-4e8e-84a2-d360543342f5 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.036257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c64e4-9527-4e8e-84a2-d360543342f5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.036535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c64e4-9527-4e8e-84a2-d360543342f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.054449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-555c64e4-9527-4e8e-84a2-d360543342f5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:39.056212 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-555c64e4-9527-4e8e-84a2-d360543342f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:39.096771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:39.106330 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6b02b-4464-4ecd-a041-1e7d48893403 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:39.143344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e2ab1-8366-451f-a1f4-aa137f53bb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:39.144319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e2ab1-8366-451f-a1f4-aa137f53bb9a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.144747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e2ab1-8366-451f-a1f4-aa137f53bb9a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.145092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e2ab1-8366-451f-a1f4-aa137f53bb9a None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.146132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 460/920] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:39.151964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e2ab1-8366-451f-a1f4-aa137f53bb9a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:39.152365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e2ab1-8366-451f-a1f4-aa137f53bb9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:39.157312 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e2ab1-8366-451f-a1f4-aa137f53bb9a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:39.168190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 461/921] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Jun 23 10:50:38 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:39.173412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c64e4-9527-4e8e-84a2-d360543342f5 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:39.174957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e2ab1-8366-451f-a1f4-aa137f53bb9a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:39.264679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:39.286048 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e2ab1-8366-451f-a1f4-aa137f53bb9a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:39.289588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c64e4-9527-4e8e-84a2-d360543342f5 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:39.328070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1594a-6aca-4010-b716-d675aa4ba353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:39.328859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1594a-6aca-4010-b716-d675aa4ba353 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.329201 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1594a-6aca-4010-b716-d675aa4ba353 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.329430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1594a-6aca-4010-b716-d675aa4ba353 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.334199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d774a69-988e-40fa-8e5e-af9f827467b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:39.335324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d774a69-988e-40fa-8e5e-af9f827467b7 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.335860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d774a69-988e-40fa-8e5e-af9f827467b7 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.336356 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d774a69-988e-40fa-8e5e-af9f827467b7 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.338268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d774a69-988e-40fa-8e5e-af9f827467b7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:39.340935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d774a69-988e-40fa-8e5e-af9f827467b7 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:39.341054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1594a-6aca-4010-b716-d675aa4ba353 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:39.342457 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1594a-6aca-4010-b716-d675aa4ba353 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-eff1594a-6aca-4010-b716-d675aa4ba353 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:39.362411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:39.363632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:39.364563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:39.364563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:39.364563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:39.364563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:39.364563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 461/922] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:39.365307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946051d-889c-4b41-b5a0-5270069c56d0 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.365588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946051d-889c-4b41-b5a0-5270069c56d0 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.365863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6946051d-889c-4b41-b5a0-5270069c56d0 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.367347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 462/923] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:39.369290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946051d-889c-4b41-b5a0-5270069c56d0 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:39.421476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 462/924] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:50:39 2022] POST /identity/v3/services => generated 241 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:39.423090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ed0d6-27bd-4fde-a854-3ed9d60ad843 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.423480 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ed0d6-27bd-4fde-a854-3ed9d60ad843 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.423779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ed0d6-27bd-4fde-a854-3ed9d60ad843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.442620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-9f5ed0d6-27bd-4fde-a854-3ed9d60ad843 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:39.444062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9f5ed0d6-27bd-4fde-a854-3ed9d60ad843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:39.474548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:39.520190 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6946051d-889c-4b41-b5a0-5270069c56d0 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:39.530797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 463/925] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:39.553882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ed0d6-27bd-4fde-a854-3ed9d60ad843 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:39.554112 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:39.568335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e580078-3c93-4398-8f1e-5321afcceb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:39.569822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e580078-3c93-4398-8f1e-5321afcceb93 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.570717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e580078-3c93-4398-8f1e-5321afcceb93 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.571715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e580078-3c93-4398-8f1e-5321afcceb93 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.572992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e580078-3c93-4398-8f1e-5321afcceb93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:39.573595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e580078-3c93-4398-8f1e-5321afcceb93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:39.576623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e580078-3c93-4398-8f1e-5321afcceb93 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:39.596034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 463/926] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:39.603096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e580078-3c93-4398-8f1e-5321afcceb93 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:39.701075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ed0d6-27bd-4fde-a854-3ed9d60ad843 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:39.728695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e580078-3c93-4398-8f1e-5321afcceb93 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:39.753731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5dd81-1620-4ae3-af84-c2258d163c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:39.754773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5dd81-1620-4ae3-af84-c2258d163c73 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.755054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5dd81-1620-4ae3-af84-c2258d163c73 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.755331 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d5dd81-1620-4ae3-af84-c2258d163c73 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.756281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5dd81-1620-4ae3-af84-c2258d163c73 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:39.758390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d5dd81-1620-4ae3-af84-c2258d163c73 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:39.765835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ba00-b562-4884-bf91-4e5b4628d03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:39.766921 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ba00-b562-4884-bf91-4e5b4628d03e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.767381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ba00-b562-4884-bf91-4e5b4628d03e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.767859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d31ba00-b562-4884-bf91-4e5b4628d03e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-96d5dd81-1620-4ae3-af84-c2258d163c73 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:39.774214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:39.775666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:39.781626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 464/927] 10.222.0.52 () {56 vars in 1132 bytes} [Thu Jun 23 10:50:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:39.782724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31ba00-b562-4884-bf91-4e5b4628d03e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:39.784173 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5dd81-1620-4ae3-af84-c2258d163c73 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:39.785143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d31ba00-b562-4884-bf91-4e5b4628d03e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:39.797083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-0d31ba00-b562-4884-bf91-4e5b4628d03e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:39.801558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:39.802505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:39.803431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:39.803431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:39.803431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:39.803431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:39.803431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:39.803431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:39.803431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:39.803431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:39.803431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:50:39.803431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:39.809356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 464/928] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Jun 23 10:50:39 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:39.812261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ba00-b562-4884-bf91-4e5b4628d03e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:39.862637 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:39.895706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d5dd81-1620-4ae3-af84-c2258d163c73 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:39.924108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d31ba00-b562-4884-bf91-4e5b4628d03e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:39.932731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc0336-8413-4841-a0ca-9da1e1545817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:39.933682 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc0336-8413-4841-a0ca-9da1e1545817 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.934148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc0336-8413-4841-a0ca-9da1e1545817 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.934622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edc0336-8413-4841-a0ca-9da1e1545817 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.935539 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc0336-8413-4841-a0ca-9da1e1545817 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:39.936057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc0336-8413-4841-a0ca-9da1e1545817 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:39.937636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edc0336-8413-4841-a0ca-9da1e1545817 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:39.947700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 465/929] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Jun 23 10:50:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:39.949280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc0336-8413-4841-a0ca-9da1e1545817 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:39.960159 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78434fd-b3f7-4cda-b3a6-55311356cbca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:39.961161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78434fd-b3f7-4cda-b3a6-55311356cbca None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:39.962188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78434fd-b3f7-4cda-b3a6-55311356cbca None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:39.962659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78434fd-b3f7-4cda-b3a6-55311356cbca None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:39.963783 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78434fd-b3f7-4cda-b3a6-55311356cbca None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:39.964320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78434fd-b3f7-4cda-b3a6-55311356cbca None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:39.965980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78434fd-b3f7-4cda-b3a6-55311356cbca None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:39.990132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 465/930] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Jun 23 10:50:39 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:39.991377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78434fd-b3f7-4cda-b3a6-55311356cbca None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.023392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:40.056155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edc0336-8413-4841-a0ca-9da1e1545817 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.094184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac1703-0eaa-4eb5-9306-371d7c269a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.095028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac1703-0eaa-4eb5-9306-371d7c269a72 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.095314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac1703-0eaa-4eb5-9306-371d7c269a72 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.095592 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ac1703-0eaa-4eb5-9306-371d7c269a72 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.096337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac1703-0eaa-4eb5-9306-371d7c269a72 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:40.096649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac1703-0eaa-4eb5-9306-371d7c269a72 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.098909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ac1703-0eaa-4eb5-9306-371d7c269a72 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.107893 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 466/931] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Jun 23 10:50:39 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:40.111591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac1703-0eaa-4eb5-9306-371d7c269a72 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.120659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78434fd-b3f7-4cda-b3a6-55311356cbca None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.123581 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:40.168703 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcac11f-4544-41fd-96d4-1d6d11fa19bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.169887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcac11f-4544-41fd-96d4-1d6d11fa19bd None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.170613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcac11f-4544-41fd-96d4-1d6d11fa19bd None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.171551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcac11f-4544-41fd-96d4-1d6d11fa19bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.185076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcac11f-4544-41fd-96d4-1d6d11fa19bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.187783 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcac11f-4544-41fd-96d4-1d6d11fa19bd None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-0dcac11f-4544-41fd-96d4-1d6d11fa19bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:40.211342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:40.212379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:40.213291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:40.213291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:40.213291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:40.213291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:40.217376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 466/932] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:40.218663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcac11f-4544-41fd-96d4-1d6d11fa19bd None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.247426 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ac1703-0eaa-4eb5-9306-371d7c269a72 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.286981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb438ae-864b-4a7f-8200-08ba1ca9f1f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.288024 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb438ae-864b-4a7f-8200-08ba1ca9f1f2 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.288321 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb438ae-864b-4a7f-8200-08ba1ca9f1f2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.288604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb438ae-864b-4a7f-8200-08ba1ca9f1f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.289431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb438ae-864b-4a7f-8200-08ba1ca9f1f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.291390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb438ae-864b-4a7f-8200-08ba1ca9f1f2 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.298280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:40.330708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcac11f-4544-41fd-96d4-1d6d11fa19bd None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.368833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a5a5b-8b8e-4f8a-91e6-1840c18c0d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.369898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a5a5b-8b8e-4f8a-91e6-1840c18c0d1a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.370375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a5a5b-8b8e-4f8a-91e6-1840c18c0d1a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.370894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a5a5b-8b8e-4f8a-91e6-1840c18c0d1a None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.371855 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a5a5b-8b8e-4f8a-91e6-1840c18c0d1a None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:40.372404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a5a5b-8b8e-4f8a-91e6-1840c18c0d1a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.374092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a5a5b-8b8e-4f8a-91e6-1840c18c0d1a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.391058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 467/933] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:40.392184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a5a5b-8b8e-4f8a-91e6-1840c18c0d1a None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.413500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:40.424436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 467/934] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Jun 23 10:50:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:50:40.519521 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a5a5b-8b8e-4f8a-91e6-1840c18c0d1a None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.558406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c5ac8-c6ea-4349-ae66-59a6229d40fe None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.558965 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c5ac8-c6ea-4349-ae66-59a6229d40fe None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.559274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c5ac8-c6ea-4349-ae66-59a6229d40fe None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.561038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 468/935] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:40.566669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ed403-2b46-4127-98b5-13a9f38b1e62 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.566965 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ed403-2b46-4127-98b5-13a9f38b1e62 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.567249 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02ed403-2b46-4127-98b5-13a9f38b1e62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.569407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8e4af-aa5f-4117-98f1-f1b90bd797c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.570304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8e4af-aa5f-4117-98f1-f1b90bd797c4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.570592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8e4af-aa5f-4117-98f1-f1b90bd797c4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.570867 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d8e4af-aa5f-4117-98f1-f1b90bd797c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.580900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8e4af-aa5f-4117-98f1-f1b90bd797c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.582303 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d8e4af-aa5f-4117-98f1-f1b90bd797c4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.592796 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-d02ed403-2b46-4127-98b5-13a9f38b1e62 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:40.593411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d02ed403-2b46-4127-98b5-13a9f38b1e62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-47d8e4af-aa5f-4117-98f1-f1b90bd797c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:40.603834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:40.604782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:40.605678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:40.605678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:40.605678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:40.605678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:40.605678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:40.605678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:40.605678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:40.605678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:40.605678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 468/936] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:40.606162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8e4af-aa5f-4117-98f1-f1b90bd797c4 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.691790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 469/937] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:40.704639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:40.715582 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ed403-2b46-4127-98b5-13a9f38b1e62 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.745212 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d8e4af-aa5f-4117-98f1-f1b90bd797c4 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.791478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196494b2-dadc-44d0-89fa-ff07f580865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.792201 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196494b2-dadc-44d0-89fa-ff07f580865f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.792488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196494b2-dadc-44d0-89fa-ff07f580865f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.793236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196494b2-dadc-44d0-89fa-ff07f580865f None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.794037 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196494b2-dadc-44d0-89fa-ff07f580865f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:40.794348 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196494b2-dadc-44d0-89fa-ff07f580865f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.796540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196494b2-dadc-44d0-89fa-ff07f580865f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.813932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 469/938] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:40.819576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196494b2-dadc-44d0-89fa-ff07f580865f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.826301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02ed403-2b46-4127-98b5-13a9f38b1e62 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.852754 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:40.866892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747c7dc-b5cc-4cdc-bf8b-de8340c50583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:40.867558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747c7dc-b5cc-4cdc-bf8b-de8340c50583 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:40.868393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747c7dc-b5cc-4cdc-bf8b-de8340c50583 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:40.868677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d747c7dc-b5cc-4cdc-bf8b-de8340c50583 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:40.869396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747c7dc-b5cc-4cdc-bf8b-de8340c50583 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:40.870839 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d747c7dc-b5cc-4cdc-bf8b-de8340c50583 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:40.872244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: WARNING keystone.server.flask.common [None req-d747c7dc-b5cc-4cdc-bf8b-de8340c50583 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 23 10:50:40.939396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.sql.core [None req-d747c7dc-b5cc-4cdc-bf8b-de8340c50583 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 10:50:40.939396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 10:50:40.939396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [parameters: {'id': 'b38433ac1e0a465bb68e50c817cf9b25', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 10:50:40.939396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=75629) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-d747c7dc-b5cc-4cdc-bf8b-de8340c50583 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b38433ac1e0a465bb68e50c817cf9b25.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b38433ac1e0a465bb68e50c817cf9b25. Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:50:40.949338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result.read() Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 23 10:50:40.953437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application yield resource Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise self.value Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application session.commit() Jun 23 10:50:40.955597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.session.flush() Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application compat.raise_( Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 10:50:40.957454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 10:50:40.959015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result.read() Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:50:40.965830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [parameters: {'id': 'b38433ac1e0a465bb68e50c817cf9b25', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:40.967385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:40.968389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:40.972384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:40.972384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 23 10:50:40.972384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 23 10:50:40.972384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:40.972384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:40.972384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 23 10:50:40.972384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 23 10:50:40.972384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id b38433ac1e0a465bb68e50c817cf9b25. Jun 23 10:50:40.972384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:40.973132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196494b2-dadc-44d0-89fa-ff07f580865f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:40.973226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 470/939] 10.222.0.52 () {60 vars in 1140 bytes} [Thu Jun 23 10:50:40 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:40.973226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747c7dc-b5cc-4cdc-bf8b-de8340c50583 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:40.989695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:40.999123 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddecdf-cbb7-485d-a81a-89df25f0180e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:41.000059 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddecdf-cbb7-485d-a81a-89df25f0180e None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:41.000395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddecdf-cbb7-485d-a81a-89df25f0180e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:41.003646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddecdf-cbb7-485d-a81a-89df25f0180e None admin] PATH_INFO: `/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/d2bf9ab55d984c3ea3b99126d063e47a/roles/8503ee09d8864888a0153b6be38559dc` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:41.004470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddecdf-cbb7-485d-a81a-89df25f0180e None admin] RBAC: Authorizing `identity:create_grant(project_id=d27530ca8f8e4156a519c726bd98c2a0, user_id=d2bf9ab55d984c3ea3b99126d063e47a, role_id=8503ee09d8864888a0153b6be38559dc)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:41.006005 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddecdf-cbb7-485d-a81a-89df25f0180e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:41.073496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d747c7dc-b5cc-4cdc-bf8b-de8340c50583 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:41.086191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 470/940] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:50:40 2022] PUT /identity/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/d2bf9ab55d984c3ea3b99126d063e47a/roles/8503ee09d8864888a0153b6be38559dc => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:50:41.121917 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e6eb32-02e1-4538-b8b0-4e3a5950d73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:41.123139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6eb32-02e1-4538-b8b0-4e3a5950d73a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:41.123630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6eb32-02e1-4538-b8b0-4e3a5950d73a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:41.124186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e6eb32-02e1-4538-b8b0-4e3a5950d73a None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:41.132744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6eb32-02e1-4538-b8b0-4e3a5950d73a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:41.134962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e6eb32-02e1-4538-b8b0-4e3a5950d73a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-b6e6eb32-02e1-4538-b8b0-4e3a5950d73a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:41.151529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:41.152528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:41.153409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:41.153409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:41.153409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:41.153409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:41.153409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:41.153409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:41.153409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:41.153409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:41.159982 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 471/941] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:41.162684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddecdf-cbb7-485d-a81a-89df25f0180e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:41.285680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddecdf-cbb7-485d-a81a-89df25f0180e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:41.321355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb2b71e-d463-4d0d-8f26-bc08cd7bc2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:41.322344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2b71e-d463-4d0d-8f26-bc08cd7bc2ae None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:41.322805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2b71e-d463-4d0d-8f26-bc08cd7bc2ae None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:41.323259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb2b71e-d463-4d0d-8f26-bc08cd7bc2ae None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:41.324234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2b71e-d463-4d0d-8f26-bc08cd7bc2ae None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:41.324721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2b71e-d463-4d0d-8f26-bc08cd7bc2ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:41.326478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb2b71e-d463-4d0d-8f26-bc08cd7bc2ae None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:41.351981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 471/942] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:41.635461 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d32e4-bc52-4735-bd22-80fc9a568340 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:41.635951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d32e4-bc52-4735-bd22-80fc9a568340 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:41.636330 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d32e4-bc52-4735-bd22-80fc9a568340 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:41.640863 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 472/943] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:41.646625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9728f-d938-4777-a8d6-70c37d82c32c None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:41.647045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9728f-d938-4777-a8d6-70c37d82c32c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:41.647423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b9728f-d938-4777-a8d6-70c37d82c32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:41.666295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-40b9728f-d938-4777-a8d6-70c37d82c32c None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:41.667501 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-40b9728f-d938-4777-a8d6-70c37d82c32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:41.716349 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:41.743920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 472/944] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:41 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:41.762120 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d32e4-bc52-4735-bd22-80fc9a568340 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:41.807625 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:41.874102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d32e4-bc52-4735-bd22-80fc9a568340 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:41.910324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4724-eb62-4dac-987c-9d2a694a06e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:41.911381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4724-eb62-4dac-987c-9d2a694a06e7 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:41.911838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4724-eb62-4dac-987c-9d2a694a06e7 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:41.912267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4d4724-eb62-4dac-987c-9d2a694a06e7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:41.913096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d4724-eb62-4dac-987c-9d2a694a06e7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:41.915146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4d4724-eb62-4dac-987c-9d2a694a06e7 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-fd4d4724-eb62-4dac-987c-9d2a694a06e7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:41.927905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:41.929147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:41.930266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:41.932839 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 473/945] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Jun 23 10:50:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:41.938668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9728f-d938-4777-a8d6-70c37d82c32c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:42.044321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b9728f-d938-4777-a8d6-70c37d82c32c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:42.080821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6622d-6721-4ec6-8afe-a18688720ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:42.081491 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6622d-6721-4ec6-8afe-a18688720ef2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:42.081773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6622d-6721-4ec6-8afe-a18688720ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:42.082047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf6622d-6721-4ec6-8afe-a18688720ef2 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:42.082761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6622d-6721-4ec6-8afe-a18688720ef2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:42.083065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6622d-6721-4ec6-8afe-a18688720ef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:42.084459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf6622d-6721-4ec6-8afe-a18688720ef2 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:42.094766 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 473/946] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Jun 23 10:50:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:42.097039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4724-eb62-4dac-987c-9d2a694a06e7 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:42.202054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4d4724-eb62-4dac-987c-9d2a694a06e7 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:42.203606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:42.237228 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008652cf-93ab-4256-9420-3f9dde9412b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:42.237891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008652cf-93ab-4256-9420-3f9dde9412b6 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:42.238172 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008652cf-93ab-4256-9420-3f9dde9412b6 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:42.238445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008652cf-93ab-4256-9420-3f9dde9412b6 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:42.239158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008652cf-93ab-4256-9420-3f9dde9412b6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:42.239465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008652cf-93ab-4256-9420-3f9dde9412b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:42.241062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008652cf-93ab-4256-9420-3f9dde9412b6 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:42.251409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 474/947] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Jun 23 10:50:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:42.252891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6622d-6721-4ec6-8afe-a18688720ef2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:42.303792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:42.362450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf6622d-6721-4ec6-8afe-a18688720ef2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:42.407836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13279d7-275b-432c-ac2d-bb7a938f6232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:42.407836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13279d7-275b-432c-ac2d-bb7a938f6232 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:42.407836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13279d7-275b-432c-ac2d-bb7a938f6232 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:42.407836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13279d7-275b-432c-ac2d-bb7a938f6232 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:42.408268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13279d7-275b-432c-ac2d-bb7a938f6232 None admin] RBAC: Adding query filter params (interface=public, service_id=de17183ee8374362aa42377dc4902fc0, region_id=RegionOne) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:42.408268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13279d7-275b-432c-ac2d-bb7a938f6232 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:42.408268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13279d7-275b-432c-ac2d-bb7a938f6232 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:42.419960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 474/948] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Jun 23 10:50:42 2022] GET /identity/v3/endpoints?service_id=de17183ee8374362aa42377dc4902fc0&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:42.421615 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008652cf-93ab-4256-9420-3f9dde9412b6 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:42.573543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5e91e-83b3-491e-8fbe-a32454d0f150 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:42.573876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5e91e-83b3-491e-8fbe-a32454d0f150 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:42.574109 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5e91e-83b3-491e-8fbe-a32454d0f150 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:42.575514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 475/949] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:42.582003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008652cf-93ab-4256-9420-3f9dde9412b6 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:42.586230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ddb61-b473-409a-9f8c-dd32d2dda074 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:42.586586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ddb61-b473-409a-9f8c-dd32d2dda074 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:42.587362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4ddb61-b473-409a-9f8c-dd32d2dda074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:42.608393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-0f4ddb61-b473-409a-9f8c-dd32d2dda074 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:42.609971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0f4ddb61-b473-409a-9f8c-dd32d2dda074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:42.665098 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080e68d-db81-4e54-8740-fe90b573bcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:42.666389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e68d-db81-4e54-8740-fe90b573bcfe None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:42.668075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e68d-db81-4e54-8740-fe90b573bcfe None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:42.668374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080e68d-db81-4e54-8740-fe90b573bcfe None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:42.669604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080e68d-db81-4e54-8740-fe90b573bcfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:42.672878 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080e68d-db81-4e54-8740-fe90b573bcfe None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:42.693530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 475/950] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Jun 23 10:50:42 2022] GET /identity/v3/services => generated 1497 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:42.714490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 476/951] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:42.745953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080e68d-db81-4e54-8740-fe90b573bcfe None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:42.806676 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:42.932243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080e68d-db81-4e54-8740-fe90b573bcfe None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:42.969826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e7018-5fb5-48b5-af0a-288b14af673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:42.970636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e7018-5fb5-48b5-af0a-288b14af673f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:42.970916 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e7018-5fb5-48b5-af0a-288b14af673f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:42.971194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9e7018-5fb5-48b5-af0a-288b14af673f None admin] PATH_INFO: `/v3/services/compute` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:42.973557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e7018-5fb5-48b5-af0a-288b14af673f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:42.973557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9e7018-5fb5-48b5-af0a-288b14af673f None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-2b9e7018-5fb5-48b5-af0a-288b14af673f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:42.986111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:42.987262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:42.988210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 476/952] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:42.994708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ddb61-b473-409a-9f8c-dd32d2dda074 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:43.037121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:43.102862 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4ddb61-b473-409a-9f8c-dd32d2dda074 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:43.139074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9607ae8-ec6f-44d2-a38c-9f048b3fbeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:43.140026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9607ae8-ec6f-44d2-a38c-9f048b3fbeec None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.140464 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9607ae8-ec6f-44d2-a38c-9f048b3fbeec None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.140999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9607ae8-ec6f-44d2-a38c-9f048b3fbeec None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.141860 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9607ae8-ec6f-44d2-a38c-9f048b3fbeec None admin] RBAC: Adding query filter params (name=compute) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:43.142318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9607ae8-ec6f-44d2-a38c-9f048b3fbeec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:43.143867 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9607ae8-ec6f-44d2-a38c-9f048b3fbeec None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:43.150171 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 477/953] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:43.155537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e7018-5fb5-48b5-af0a-288b14af673f None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:43.262980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:43.274240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9e7018-5fb5-48b5-af0a-288b14af673f None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:43.313466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a876272-315a-4a85-9de2-3b96b62d78db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:43.314130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a876272-315a-4a85-9de2-3b96b62d78db None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.314412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a876272-315a-4a85-9de2-3b96b62d78db None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.314684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a876272-315a-4a85-9de2-3b96b62d78db None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.315392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a876272-315a-4a85-9de2-3b96b62d78db None admin] RBAC: Adding query filter params (type=compute) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:43.315694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a876272-315a-4a85-9de2-3b96b62d78db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:43.317089 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a876272-315a-4a85-9de2-3b96b62d78db None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:43.322184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 477/954] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:43.400691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c016e7f-b853-4c57-83da-9c84c01aa1a6 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.401362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c016e7f-b853-4c57-83da-9c84c01aa1a6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.401362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c016e7f-b853-4c57-83da-9c84c01aa1a6 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.403040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 478/955] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:43.409064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b5b4f-d9ae-457a-bd74-f0d689dc4a76 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.409397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b5b4f-d9ae-457a-bd74-f0d689dc4a76 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.409635 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1b5b4f-d9ae-457a-bd74-f0d689dc4a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.429213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-2b1b5b4f-d9ae-457a-bd74-f0d689dc4a76 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:43.431439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2b1b5b4f-d9ae-457a-bd74-f0d689dc4a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:43.515370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 478/956] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:43.541130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c016e7f-b853-4c57-83da-9c84c01aa1a6 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:43.565345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a06926-9627-4f41-ac88-d35806c27848 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.565628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a06926-9627-4f41-ac88-d35806c27848 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.565906 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a06926-9627-4f41-ac88-d35806c27848 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.567628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 479/957] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:43.573434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eabce7-f688-4b7e-9f48-be02c7723867 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.573737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eabce7-f688-4b7e-9f48-be02c7723867 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.574018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79eabce7-f688-4b7e-9f48-be02c7723867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.596931 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-79eabce7-f688-4b7e-9f48-be02c7723867 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:43.598496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-79eabce7-f688-4b7e-9f48-be02c7723867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:43.658870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c016e7f-b853-4c57-83da-9c84c01aa1a6 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:43.671663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 480/958] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:43.673219 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:43.696483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eabce7-f688-4b7e-9f48-be02c7723867 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:43.699517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569816ab-ffce-4a33-a8a4-3dedcd1d6dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:43.700632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569816ab-ffce-4a33-a8a4-3dedcd1d6dc2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.701084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569816ab-ffce-4a33-a8a4-3dedcd1d6dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.701553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569816ab-ffce-4a33-a8a4-3dedcd1d6dc2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.713888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569816ab-ffce-4a33-a8a4-3dedcd1d6dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-569816ab-ffce-4a33-a8a4-3dedcd1d6dc2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:43.723375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:43.724556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:43.725587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:43.725587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:43.725587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:43.725587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:43.725587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:43.725587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:43.725587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:43.725587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:43.725587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:43.725587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:43.725587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:50:43.725587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:43.729176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 479/959] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Jun 23 10:50:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:43.732170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:43.735029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569816ab-ffce-4a33-a8a4-3dedcd1d6dc2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:43.817213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79eabce7-f688-4b7e-9f48-be02c7723867 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:43.861803 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac23e8-fda9-4793-8799-968412e315ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:43.862041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569816ab-ffce-4a33-a8a4-3dedcd1d6dc2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:43.862487 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac23e8-fda9-4793-8799-968412e315ae None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.862776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac23e8-fda9-4793-8799-968412e315ae None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.863054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac23e8-fda9-4793-8799-968412e315ae None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.863763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac23e8-fda9-4793-8799-968412e315ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:43.865240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac23e8-fda9-4793-8799-968412e315ae None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:43.900284 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85080049-fdf5-4aa3-bd72-9a35c0274ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:43.901143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85080049-fdf5-4aa3-bd72-9a35c0274ef2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:43.901481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85080049-fdf5-4aa3-bd72-9a35c0274ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:43.901827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85080049-fdf5-4aa3-bd72-9a35c0274ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:43.902635 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85080049-fdf5-4aa3-bd72-9a35c0274ef2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:43.903006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85080049-fdf5-4aa3-bd72-9a35c0274ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:43.904642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85080049-fdf5-4aa3-bd72-9a35c0274ef2 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:43.906883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.sql.core [None req-63ac23e8-fda9-4793-8799-968412e315ae None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 10:50:43.906883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 10:50:43.906883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [parameters: {'user_id': 'ca8f9b6c2af344f4a88018dee2891910', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 10:50:43.906883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=75629) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 23 10:50:43.914335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 480/960] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Jun 23 10:50:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-63ac23e8-fda9-4793-8799-968412e315ae None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result.read() Jun 23 10:50:43.917304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:50:43.918162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application yield resource Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application next(self.gen) Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.session.rollback() Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.force_reraise() Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise self.value Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application session.commit() Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 23 10:50:43.919086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._prepare_impl() Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.session.flush() Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._flush(objects) Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application compat.raise_( Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application flush_context.execute() Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rec.execute(self) Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 23 10:50:43.920001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 23 10:50:43.920922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result = self._query(query) Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application conn.query(q) Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application result.read() Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 23 10:50:43.921766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ca8f9b6c2af344f4a88018dee2891910', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:43.922598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 23 10:50:43.923374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 23 10:50:43.924310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 23 10:50:43.924310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 23 10:50:43.924310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 23 10:50:43.924310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 23 10:50:43.924310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 23 10:50:43.924310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:43.925303 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85080049-fdf5-4aa3-bd72-9a35c0274ef2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:43.926766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 481/961] 10.222.0.52 () {60 vars in 1131 bytes} [Thu Jun 23 10:50:43 2022] POST /identity/v3/users => generated 160 bytes in 231 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:43.934822 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac23e8-fda9-4793-8799-968412e315ae None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:43.961884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:44.048277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:44.069959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85080049-fdf5-4aa3-bd72-9a35c0274ef2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:44.072501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac23e8-fda9-4793-8799-968412e315ae None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:44.113745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d75e83-a9ad-4673-8a19-35ef82f492cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:44.114975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d75e83-a9ad-4673-8a19-35ef82f492cd None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:44.115468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd185f-76df-4c8e-94b9-7f5524a3eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:44.115682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d75e83-a9ad-4673-8a19-35ef82f492cd None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:44.116152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d75e83-a9ad-4673-8a19-35ef82f492cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:44.116499 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd185f-76df-4c8e-94b9-7f5524a3eb90 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:44.116854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd185f-76df-4c8e-94b9-7f5524a3eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:44.117205 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd185f-76df-4c8e-94b9-7f5524a3eb90 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:44.129490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d75e83-a9ad-4673-8a19-35ef82f492cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:44.129663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd185f-76df-4c8e-94b9-7f5524a3eb90 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:44.131295 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd185f-76df-4c8e-94b9-7f5524a3eb90 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:44.131477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d75e83-a9ad-4673-8a19-35ef82f492cd None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-3cbd185f-76df-4c8e-94b9-7f5524a3eb90 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:44.148830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:44.149943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:44.150887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:44.150887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:44.150887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:44.150887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:44.150887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:44.150887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:44.150887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:44.150887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:44.150887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 23 10:50:44.150887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-32d75e83-a9ad-4673-8a19-35ef82f492cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:44.153720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:44.154579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:44.155516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:44.155516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:44.155516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:44.155516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:44.155744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 482/962] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:50:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:44.157274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd185f-76df-4c8e-94b9-7f5524a3eb90 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:44.158129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 481/963] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:44.163714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d75e83-a9ad-4673-8a19-35ef82f492cd None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:44.264657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd185f-76df-4c8e-94b9-7f5524a3eb90 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:44.266238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d75e83-a9ad-4673-8a19-35ef82f492cd None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:44.276042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:44.301207 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d17d8c-2412-48a5-80a2-2340bf4db87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:44.301979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d17d8c-2412-48a5-80a2-2340bf4db87c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:44.302224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bab93b-0a79-49c0-8ee1-a5aa699351b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:44.302395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d17d8c-2412-48a5-80a2-2340bf4db87c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:44.302744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d17d8c-2412-48a5-80a2-2340bf4db87c None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:44.303397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bab93b-0a79-49c0-8ee1-a5aa699351b4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:44.303783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d17d8c-2412-48a5-80a2-2340bf4db87c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:44.304019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bab93b-0a79-49c0-8ee1-a5aa699351b4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:44.308522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d17d8c-2412-48a5-80a2-2340bf4db87c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:44.308658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bab93b-0a79-49c0-8ee1-a5aa699351b4 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:44.308658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bab93b-0a79-49c0-8ee1-a5aa699351b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:44.308658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bab93b-0a79-49c0-8ee1-a5aa699351b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:44.308909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d17d8c-2412-48a5-80a2-2340bf4db87c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:44.309006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bab93b-0a79-49c0-8ee1-a5aa699351b4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:44.326205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 482/964] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:44.327321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bab93b-0a79-49c0-8ee1-a5aa699351b4 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:44.332519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:44.359956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 483/965] 10.222.0.52 () {56 vars in 1101 bytes} [Thu Jun 23 10:50:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:44.450223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bab93b-0a79-49c0-8ee1-a5aa699351b4 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:44.491846 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5f9c8-e188-4e5f-873d-1a2473c3ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:44.493212 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5f9c8-e188-4e5f-873d-1a2473c3ad59 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:44.493500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5f9c8-e188-4e5f-873d-1a2473c3ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:44.493781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5f9c8-e188-4e5f-873d-1a2473c3ad59 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:44.497156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:44.502870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5f9c8-e188-4e5f-873d-1a2473c3ad59 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:44.504390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5f9c8-e188-4e5f-873d-1a2473c3ad59 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-3db5f9c8-e188-4e5f-873d-1a2473c3ad59 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:44.520833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:44.521865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:44.522839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:44.522839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:44.522839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:44.522839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:44.522839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:44.522839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:44.522839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:44.522839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:44.522839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 23 10:50:44.522839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:44.522839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 483/966] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Jun 23 10:50:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:44.529016 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d17d8c-2412-48a5-80a2-2340bf4db87c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:44.660725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d17d8c-2412-48a5-80a2-2340bf4db87c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:44.704132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c33d7-604d-4fa2-8318-e976962d67a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:44.704812 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c33d7-604d-4fa2-8318-e976962d67a0 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:44.705097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c33d7-604d-4fa2-8318-e976962d67a0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:44.705375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c33d7-604d-4fa2-8318-e976962d67a0 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:44.706222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c33d7-604d-4fa2-8318-e976962d67a0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:44.706536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c33d7-604d-4fa2-8318-e976962d67a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:44.708003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c33d7-604d-4fa2-8318-e976962d67a0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:44.726879 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 484/967] 10.222.0.52 () {56 vars in 1149 bytes} [Thu Jun 23 10:50:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:44.732735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5f9c8-e188-4e5f-873d-1a2473c3ad59 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:44.834657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5f9c8-e188-4e5f-873d-1a2473c3ad59 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:44.870132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af4773-471c-4d5c-976d-d6d59c52e635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:44.870779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af4773-471c-4d5c-976d-d6d59c52e635 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:44.871057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af4773-471c-4d5c-976d-d6d59c52e635 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:44.871326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0af4773-471c-4d5c-976d-d6d59c52e635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:44.902725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcabac-0347-4736-9aa1-bf4d0075936a None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:44.903056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcabac-0347-4736-9aa1-bf4d0075936a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:44.903350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffcabac-0347-4736-9aa1-bf4d0075936a None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:44.904929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 485/968] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:44.911077 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b350e-2bac-48dd-9dd3-e28159946911 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:44.911368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b350e-2bac-48dd-9dd3-e28159946911 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:44.911650 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6b350e-2bac-48dd-9dd3-e28159946911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:44.929440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-8c6b350e-2bac-48dd-9dd3-e28159946911 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:44.930984 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8c6b350e-2bac-48dd-9dd3-e28159946911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:44.936694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:44.944052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af4773-471c-4d5c-976d-d6d59c52e635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:44.946204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0af4773-471c-4d5c-976d-d6d59c52e635 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:44.992281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:45.012065 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 486/969] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:45.033371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b350e-2bac-48dd-9dd3-e28159946911 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:45.065495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 484/970] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:44 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:50:45.066339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af4773-471c-4d5c-976d-d6d59c52e635 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:45.140460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6b350e-2bac-48dd-9dd3-e28159946911 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:45.169957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:45.175887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0af4773-471c-4d5c-976d-d6d59c52e635 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:45.176304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf2ed1-bc42-4d5a-b3eb-91694d0569e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:45.177108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf2ed1-bc42-4d5a-b3eb-91694d0569e9 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.177388 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf2ed1-bc42-4d5a-b3eb-91694d0569e9 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.177743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cf2ed1-bc42-4d5a-b3eb-91694d0569e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.178403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf2ed1-bc42-4d5a-b3eb-91694d0569e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:45.179789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cf2ed1-bc42-4d5a-b3eb-91694d0569e9 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-a3cf2ed1-bc42-4d5a-b3eb-91694d0569e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:45.192303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:45.193322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:45.196774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 487/971] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Jun 23 10:50:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:45.199364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf2ed1-bc42-4d5a-b3eb-91694d0569e9 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:45.214689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f7db3-48d8-422a-8677-aa0852853e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:45.215527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f7db3-48d8-422a-8677-aa0852853e00 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.215841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f7db3-48d8-422a-8677-aa0852853e00 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.216119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4f7db3-48d8-422a-8677-aa0852853e00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.227801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f7db3-48d8-422a-8677-aa0852853e00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:45.229340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4f7db3-48d8-422a-8677-aa0852853e00 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-bf4f7db3-48d8-422a-8677-aa0852853e00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:45.246953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:45.247956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:45.248907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:45.248907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:45.248907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:45.248907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:45.248907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 485/972] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:45.253752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f7db3-48d8-422a-8677-aa0852853e00 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:45.254656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:45.316001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cf2ed1-bc42-4d5a-b3eb-91694d0569e9 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:45.357187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe5c9c-0fa3-49f6-840c-3fc1b2fce2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:45.357869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe5c9c-0fa3-49f6-840c-3fc1b2fce2e4 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.358158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe5c9c-0fa3-49f6-840c-3fc1b2fce2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.358439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe5c9c-0fa3-49f6-840c-3fc1b2fce2e4 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.359166 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe5c9c-0fa3-49f6-840c-3fc1b2fce2e4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:45.359475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe5c9c-0fa3-49f6-840c-3fc1b2fce2e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:45.363490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe5c9c-0fa3-49f6-840c-3fc1b2fce2e4 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:45.369242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 488/973] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Jun 23 10:50:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:45.373101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4f7db3-48d8-422a-8677-aa0852853e00 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:45.374699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe5c9c-0fa3-49f6-840c-3fc1b2fce2e4 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:45.409491 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8d04d-6a9a-41a0-9bc6-b03691d4401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:45.410080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8d04d-6a9a-41a0-9bc6-b03691d4401f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.410366 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8d04d-6a9a-41a0-9bc6-b03691d4401f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.410751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8d04d-6a9a-41a0-9bc6-b03691d4401f None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.411371 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8d04d-6a9a-41a0-9bc6-b03691d4401f None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:45.411678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8d04d-6a9a-41a0-9bc6-b03691d4401f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:45.413084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f8d04d-6a9a-41a0-9bc6-b03691d4401f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:45.427882 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 486/974] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:45.433488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8d04d-6a9a-41a0-9bc6-b03691d4401f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:45.445363 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:45.485746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe5c9c-0fa3-49f6-840c-3fc1b2fce2e4 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:45.500259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:45.522292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bb0f04-1449-4a38-8463-52822393c551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:45.523099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb0f04-1449-4a38-8463-52822393c551 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.523393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb0f04-1449-4a38-8463-52822393c551 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.523673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bb0f04-1449-4a38-8463-52822393c551 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.524983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb0f04-1449-4a38-8463-52822393c551 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:45.525296 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb0f04-1449-4a38-8463-52822393c551 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:45.526683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bb0f04-1449-4a38-8463-52822393c551 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:45.532104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 489/975] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Jun 23 10:50:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:45.534618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e6de9-7e5b-4ffa-9e6d-4c2578fceeb3 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.534892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e6de9-7e5b-4ffa-9e6d-4c2578fceeb3 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.535179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1e6de9-7e5b-4ffa-9e6d-4c2578fceeb3 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.536510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 490/976] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:45.538086 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8d04d-6a9a-41a0-9bc6-b03691d4401f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:45.540254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e6de9-7e5b-4ffa-9e6d-4c2578fceeb3 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:45.579322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a38ecd-165f-4b66-a9c6-3c9924737476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:45.580125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a38ecd-165f-4b66-a9c6-3c9924737476 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.580735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a38ecd-165f-4b66-a9c6-3c9924737476 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.580735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a38ecd-165f-4b66-a9c6-3c9924737476 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.589663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a38ecd-165f-4b66-a9c6-3c9924737476 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:45.591944 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a38ecd-165f-4b66-a9c6-3c9924737476 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-47a38ecd-165f-4b66-a9c6-3c9924737476 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:45.607750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:45.609044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:45.609942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:45.609942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:45.609942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:45.609942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:45.609942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:45.609942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:45.609942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:45.609942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:45.609942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 487/977] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:45.610419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad834-025e-4798-a596-7ed8fe9e859c None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.610419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad834-025e-4798-a596-7ed8fe9e859c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.610772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85ad834-025e-4798-a596-7ed8fe9e859c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.635938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-c85ad834-025e-4798-a596-7ed8fe9e859c None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:45.636396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c85ad834-025e-4798-a596-7ed8fe9e859c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:45.672374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1e6de9-7e5b-4ffa-9e6d-4c2578fceeb3 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:45.708692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:45.714392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cfd41-c130-4289-99bc-87ea824ee0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:45.715087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cfd41-c130-4289-99bc-87ea824ee0fe None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.717803 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 488/978] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:45.717910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cfd41-c130-4289-99bc-87ea824ee0fe None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.717910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84cfd41-c130-4289-99bc-87ea824ee0fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.718042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ad834-025e-4798-a596-7ed8fe9e859c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:45.718110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cfd41-c130-4289-99bc-87ea824ee0fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:45.718110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84cfd41-c130-4289-99bc-87ea824ee0fe None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:45.782332 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 491/979] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Jun 23 10:50:45 2022] POST /identity/v3/endpoints => generated 349 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:50:45.783486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cfd41-c130-4289-99bc-87ea824ee0fe None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:45.843098 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:45.850052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85ad834-025e-4798-a596-7ed8fe9e859c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:45.897824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cc1a2-a732-476e-bdc8-e65e21b9e86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:45.898547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cc1a2-a732-476e-bdc8-e65e21b9e86a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.898854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cc1a2-a732-476e-bdc8-e65e21b9e86a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.899127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cc1a2-a732-476e-bdc8-e65e21b9e86a None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.900029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cc1a2-a732-476e-bdc8-e65e21b9e86a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:45.900339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cc1a2-a732-476e-bdc8-e65e21b9e86a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:45.901820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cc1a2-a732-476e-bdc8-e65e21b9e86a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:45.919970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 489/980] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:45.921853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cc1a2-a732-476e-bdc8-e65e21b9e86a None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:45.932971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84cfd41-c130-4289-99bc-87ea824ee0fe None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:45.976680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba26b9-bbd0-42f5-9947-daa07c2b3031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:45.977689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba26b9-bbd0-42f5-9947-daa07c2b3031 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:45.978139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba26b9-bbd0-42f5-9947-daa07c2b3031 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:45.978425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba26b9-bbd0-42f5-9947-daa07c2b3031 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:45.979137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba26b9-bbd0-42f5-9947-daa07c2b3031 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:45.980702 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba26b9-bbd0-42f5-9947-daa07c2b3031 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:45.986514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:46.036553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cc1a2-a732-476e-bdc8-e65e21b9e86a None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:46.067612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 492/981] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:50:45 2022] POST /identity/v3/services => generated 242 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:46.082041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3886d-9b51-4056-bd61-e4a1b7becc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:46.083117 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3886d-9b51-4056-bd61-e4a1b7becc34 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:46.083441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3886d-9b51-4056-bd61-e4a1b7becc34 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:46.083933 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3886d-9b51-4056-bd61-e4a1b7becc34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:46.084834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3886d-9b51-4056-bd61-e4a1b7becc34 None admin] RBAC: Adding query filter params (role.id=8503ee09d8864888a0153b6be38559dc, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=d2bf9ab55d984c3ea3b99126d063e47a) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:46.085201 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3886d-9b51-4056-bd61-e4a1b7becc34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:46.087452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de3886d-9b51-4056-bd61-e4a1b7becc34 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:46.094903 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 490/982] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:45 2022] GET /identity/v3/role_assignments?user.id=d2bf9ab55d984c3ea3b99126d063e47a&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=8503ee09d8864888a0153b6be38559dc => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:47.882775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb3eb7-9de7-4cf2-bce9-01397ced9152 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:47.883945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb3eb7-9de7-4cf2-bce9-01397ced9152 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:47.883945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb3eb7-9de7-4cf2-bce9-01397ced9152 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:47.885221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 493/983] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:47.890927 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02303db-65fd-4358-933a-f8c358f8852d None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:47.891341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02303db-65fd-4358-933a-f8c358f8852d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:47.891505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02303db-65fd-4358-933a-f8c358f8852d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:47.908512 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-e02303db-65fd-4358-933a-f8c358f8852d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:47.909725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e02303db-65fd-4358-933a-f8c358f8852d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:47.978715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 491/984] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:48.002508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb3eb7-9de7-4cf2-bce9-01397ced9152 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:48.101126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:48.109780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb3eb7-9de7-4cf2-bce9-01397ced9152 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:48.141680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62940ee2-1e6c-43cc-8e0d-d6bb36f5726c None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.141889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62940ee2-1e6c-43cc-8e0d-d6bb36f5726c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.142165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62940ee2-1e6c-43cc-8e0d-d6bb36f5726c None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.143672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 492/985] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:48.148343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b235d2-644a-48b4-9e25-eb3158e2e961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:48.148637 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91893ae7-a0a2-47a3-943a-eb2f8bbd9e9e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.149539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91893ae7-a0a2-47a3-943a-eb2f8bbd9e9e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.149709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b235d2-644a-48b4-9e25-eb3158e2e961 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.149811 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91893ae7-a0a2-47a3-943a-eb2f8bbd9e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.149955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b235d2-644a-48b4-9e25-eb3158e2e961 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.150230 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b235d2-644a-48b4-9e25-eb3158e2e961 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.150886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b235d2-644a-48b4-9e25-eb3158e2e961 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:48.152308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b235d2-644a-48b4-9e25-eb3158e2e961 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-d2b235d2-644a-48b4-9e25-eb3158e2e961 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:48.165756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:48.166790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:48.167683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 494/986] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:48.170242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-91893ae7-a0a2-47a3-943a-eb2f8bbd9e9e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:48.170541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b88ec-0c8c-4de3-a86c-b817ddb85502 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.170829 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b88ec-0c8c-4de3-a86c-b817ddb85502 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.171106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b88ec-0c8c-4de3-a86c-b817ddb85502 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.171440 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-91893ae7-a0a2-47a3-943a-eb2f8bbd9e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:48.172463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 495/987] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:48.173327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b88ec-0c8c-4de3-a86c-b817ddb85502 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:48.212199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:48.239088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 493/988] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:48.240681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935930c-a2f1-482b-a5be-e7e2c3d61c2c None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.241122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935930c-a2f1-482b-a5be-e7e2c3d61c2c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.241550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1935930c-a2f1-482b-a5be-e7e2c3d61c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.261130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-1935930c-a2f1-482b-a5be-e7e2c3d61c2c None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:48.262340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1935930c-a2f1-482b-a5be-e7e2c3d61c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:48.280247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b88ec-0c8c-4de3-a86c-b817ddb85502 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:48.316942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3e1d5-4b47-410d-a6ac-e1bcc193f149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:48.318069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3e1d5-4b47-410d-a6ac-e1bcc193f149 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.318352 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3e1d5-4b47-410d-a6ac-e1bcc193f149 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.318628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3e1d5-4b47-410d-a6ac-e1bcc193f149 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.319339 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3e1d5-4b47-410d-a6ac-e1bcc193f149 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:48.319648 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3e1d5-4b47-410d-a6ac-e1bcc193f149 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:48.321077 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3e1d5-4b47-410d-a6ac-e1bcc193f149 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:48.326153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 496/989] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:48.326935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3e1d5-4b47-410d-a6ac-e1bcc193f149 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:48.342588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 494/990] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:48 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:48.343429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935930c-a2f1-482b-a5be-e7e2c3d61c2c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:48.355530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:48.436074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3e1d5-4b47-410d-a6ac-e1bcc193f149 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:48.447287 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1935930c-a2f1-482b-a5be-e7e2c3d61c2c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:48.449632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:48.471786 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc0798-b563-4abf-9ff7-ad0820b172f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:48.472839 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc0798-b563-4abf-9ff7-ad0820b172f2 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.473127 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc0798-b563-4abf-9ff7-ad0820b172f2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.473400 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc0798-b563-4abf-9ff7-ad0820b172f2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.474043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc0798-b563-4abf-9ff7-ad0820b172f2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:48.475413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc0798-b563-4abf-9ff7-ad0820b172f2 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:48.481756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f60bd-0371-4f0a-81fd-987b82edd873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:48.482526 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f60bd-0371-4f0a-81fd-987b82edd873 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.483011 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f60bd-0371-4f0a-81fd-987b82edd873 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.483455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92f60bd-0371-4f0a-81fd-987b82edd873 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.484492 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f60bd-0371-4f0a-81fd-987b82edd873 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:48.484803 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f60bd-0371-4f0a-81fd-987b82edd873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:48.486188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92f60bd-0371-4f0a-81fd-987b82edd873 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-a4bc0798-b563-4abf-9ff7-ad0820b172f2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:48.487780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:48.488783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:48.490443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 497/991] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:48.491256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc0798-b563-4abf-9ff7-ad0820b172f2 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:48.492734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 495/992] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:48.494923 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f60bd-0371-4f0a-81fd-987b82edd873 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:48.583986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:48.598225 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92f60bd-0371-4f0a-81fd-987b82edd873 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:48.599112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc0798-b563-4abf-9ff7-ad0820b172f2 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:48.633650 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c827bf-eae6-4779-a39b-80f4d6ab40cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:48.634442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c827bf-eae6-4779-a39b-80f4d6ab40cf None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.634722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c827bf-eae6-4779-a39b-80f4d6ab40cf None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.634995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c827bf-eae6-4779-a39b-80f4d6ab40cf None admin] PATH_INFO: `/v3/services/image` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.635641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c827bf-eae6-4779-a39b-80f4d6ab40cf None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:48.637081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c827bf-eae6-4779-a39b-80f4d6ab40cf None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:48.641847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2385547-59c3-4ba1-8da8-cb6ed0772d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:48.642745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2385547-59c3-4ba1-8da8-cb6ed0772d0c None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.643031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2385547-59c3-4ba1-8da8-cb6ed0772d0c None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.643308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2385547-59c3-4ba1-8da8-cb6ed0772d0c None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.644040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2385547-59c3-4ba1-8da8-cb6ed0772d0c None admin] RBAC: Adding query filter params (name=compute) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:48.644347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2385547-59c3-4ba1-8da8-cb6ed0772d0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:48.645711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2385547-59c3-4ba1-8da8-cb6ed0772d0c None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-d6c827bf-eae6-4779-a39b-80f4d6ab40cf None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:48.650272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:48.654314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:50:48.655188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:48.655961 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 496/993] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:48.656045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 498/994] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:48.656115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2385547-59c3-4ba1-8da8-cb6ed0772d0c None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:48.657048 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c827bf-eae6-4779-a39b-80f4d6ab40cf None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:48.688385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:48.759741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2385547-59c3-4ba1-8da8-cb6ed0772d0c None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:48.764671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c827bf-eae6-4779-a39b-80f4d6ab40cf None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:48.797336 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e70ee-c468-4177-98d6-710d68eea379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:48.797999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e70ee-c468-4177-98d6-710d68eea379 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.798375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e70ee-c468-4177-98d6-710d68eea379 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.798655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451e70ee-c468-4177-98d6-710d68eea379 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.799457 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e70ee-c468-4177-98d6-710d68eea379 None admin] RBAC: Adding query filter params (interface=admin, service_id=de17183ee8374362aa42377dc4902fc0, region_id=RegionOne) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:48.799774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e70ee-c468-4177-98d6-710d68eea379 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:48.801182 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451e70ee-c468-4177-98d6-710d68eea379 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:48.804103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8d269-4f71-437b-8979-ea77be9b3261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:48.804760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8d269-4f71-437b-8979-ea77be9b3261 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.805528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8d269-4f71-437b-8979-ea77be9b3261 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.805802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8d269-4f71-437b-8979-ea77be9b3261 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.806506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8d269-4f71-437b-8979-ea77be9b3261 None admin] RBAC: Adding query filter params (type=compute) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:48.806811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8d269-4f71-437b-8979-ea77be9b3261 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:48.807034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 497/995] 10.222.0.52 () {56 vars in 1249 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/endpoints?service_id=de17183ee8374362aa42377dc4902fc0&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:48.807893 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e70ee-c468-4177-98d6-710d68eea379 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:48.808252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8d269-4f71-437b-8979-ea77be9b3261 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:48.816734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 499/996] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:48.817769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8d269-4f71-437b-8979-ea77be9b3261 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:48.834978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:48.905910 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:48.911650 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451e70ee-c468-4177-98d6-710d68eea379 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:48.920459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8d269-4f71-437b-8979-ea77be9b3261 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:48.947051 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3749fc8-1a47-4523-b6f7-dc80d34cdcf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:48.947635 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3749fc8-1a47-4523-b6f7-dc80d34cdcf3 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.947947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3749fc8-1a47-4523-b6f7-dc80d34cdcf3 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.948227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3749fc8-1a47-4523-b6f7-dc80d34cdcf3 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.948956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3749fc8-1a47-4523-b6f7-dc80d34cdcf3 None admin] RBAC: Adding query filter params (name=image) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:48.949264 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3749fc8-1a47-4523-b6f7-dc80d34cdcf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:48.950633 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3749fc8-1a47-4523-b6f7-dc80d34cdcf3 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:48.953715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee629f5-d9d2-4152-b483-55480b659301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:48.954370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee629f5-d9d2-4152-b483-55480b659301 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:48.954650 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee629f5-d9d2-4152-b483-55480b659301 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:48.954924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee629f5-d9d2-4152-b483-55480b659301 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:48.955344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 498/997] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:48.955601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee629f5-d9d2-4152-b483-55480b659301 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:48.956149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3749fc8-1a47-4523-b6f7-dc80d34cdcf3 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:48.957068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee629f5-d9d2-4152-b483-55480b659301 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:48.973108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 500/998] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:48.973108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee629f5-d9d2-4152-b483-55480b659301 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:49.064308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:49.078898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3749fc8-1a47-4523-b6f7-dc80d34cdcf3 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:49.090380 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee629f5-d9d2-4152-b483-55480b659301 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:49.127271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca1e0c-e3e7-4217-9c3b-fbad02ab0086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:49.127982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca1e0c-e3e7-4217-9c3b-fbad02ab0086 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:49.128264 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca1e0c-e3e7-4217-9c3b-fbad02ab0086 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:49.128539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ca1e0c-e3e7-4217-9c3b-fbad02ab0086 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:49.129325 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca1e0c-e3e7-4217-9c3b-fbad02ab0086 None admin] RBAC: Adding query filter params (interface=public, service_id=d7380ad2f773445683a1878d199429ee, region_id=RegionOne) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:49.129637 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca1e0c-e3e7-4217-9c3b-fbad02ab0086 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:49.130785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023413bb-23ff-4060-a14c-9b654f7a50d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:49.131006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ca1e0c-e3e7-4217-9c3b-fbad02ab0086 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:49.131454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023413bb-23ff-4060-a14c-9b654f7a50d1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:49.131760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023413bb-23ff-4060-a14c-9b654f7a50d1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:49.132770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023413bb-23ff-4060-a14c-9b654f7a50d1 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:49.132950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023413bb-23ff-4060-a14c-9b654f7a50d1 None admin] RBAC: Adding query filter params (type=image) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:49.134320 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023413bb-23ff-4060-a14c-9b654f7a50d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:49.136018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023413bb-23ff-4060-a14c-9b654f7a50d1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:49.137756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 499/999] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/endpoints?service_id=d7380ad2f773445683a1878d199429ee&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:49.141055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 501/1000] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:48 2022] GET /identity/v3/services?type=image => generated 122 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:49.144141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca1e0c-e3e7-4217-9c3b-fbad02ab0086 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:49.174582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:49.259418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ca1e0c-e3e7-4217-9c3b-fbad02ab0086 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:49.297707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfcaee7-56da-43db-8e12-4ce07dc84a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:49.298426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcaee7-56da-43db-8e12-4ce07dc84a41 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:49.298674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcaee7-56da-43db-8e12-4ce07dc84a41 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:49.298947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfcaee7-56da-43db-8e12-4ce07dc84a41 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:49.299621 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcaee7-56da-43db-8e12-4ce07dc84a41 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:49.301029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfcaee7-56da-43db-8e12-4ce07dc84a41 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:49.309586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 500/1001] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Jun 23 10:50:49 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:50:51.007119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f713e9-044d-4cb3-bfc7-1d2874b544ff None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.007648 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f713e9-044d-4cb3-bfc7-1d2874b544ff None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.007648 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f713e9-044d-4cb3-bfc7-1d2874b544ff None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.009245 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 502/1002] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:51.014295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef8815-bb74-4bfc-a6fe-f78a095ec610 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.014718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef8815-bb74-4bfc-a6fe-f78a095ec610 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.014929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef8815-bb74-4bfc-a6fe-f78a095ec610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.032495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-99ef8815-bb74-4bfc-a6fe-f78a095ec610 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:51.033681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-99ef8815-bb74-4bfc-a6fe-f78a095ec610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:51.102725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 501/1003] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:51.131296 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f713e9-044d-4cb3-bfc7-1d2874b544ff None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.184874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e9bce-053d-452a-8537-4aa2c4987962 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.185189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e9bce-053d-452a-8537-4aa2c4987962 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.185536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e9bce-053d-452a-8537-4aa2c4987962 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.186949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 502/1004] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:51.192239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8a2cf-9ec9-4b67-b7b5-a775287b68d9 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.192535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8a2cf-9ec9-4b67-b7b5-a775287b68d9 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.192821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff8a2cf-9ec9-4b67-b7b5-a775287b68d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.209399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-dff8a2cf-9ec9-4b67-b7b5-a775287b68d9 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:51.210583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-dff8a2cf-9ec9-4b67-b7b5-a775287b68d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:51.225401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:51.244315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f713e9-044d-4cb3-bfc7-1d2874b544ff None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.280505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d10a1b-c45a-4f38-81bb-9e5fd8d1dde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.281240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d10a1b-c45a-4f38-81bb-9e5fd8d1dde1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.281519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d10a1b-c45a-4f38-81bb-9e5fd8d1dde1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.281792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d10a1b-c45a-4f38-81bb-9e5fd8d1dde1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.282443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d10a1b-c45a-4f38-81bb-9e5fd8d1dde1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.283836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d10a1b-c45a-4f38-81bb-9e5fd8d1dde1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.284588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 503/1005] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-96d10a1b-c45a-4f38-81bb-9e5fd8d1dde1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:51.300152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:51.301174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:51.307751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 503/1006] 10.222.0.52 () {56 vars in 1126 bytes} [Thu Jun 23 10:50:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:51.308595 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d10a1b-c45a-4f38-81bb-9e5fd8d1dde1 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.308678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8a2cf-9ec9-4b67-b7b5-a775287b68d9 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.318568 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:51.415181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff8a2cf-9ec9-4b67-b7b5-a775287b68d9 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.427410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d10a1b-c45a-4f38-81bb-9e5fd8d1dde1 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.450643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a7b35e-a356-4b6e-8b0c-605a9d24d38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.451312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7b35e-a356-4b6e-8b0c-605a9d24d38f None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.451596 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7b35e-a356-4b6e-8b0c-605a9d24d38f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.451914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7b35e-a356-4b6e-8b0c-605a9d24d38f None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.452632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7b35e-a356-4b6e-8b0c-605a9d24d38f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.454025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a7b35e-a356-4b6e-8b0c-605a9d24d38f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.462118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc96671-4cd4-4caf-a406-0e304bbc8f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.462772 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc96671-4cd4-4caf-a406-0e304bbc8f98 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.463059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc96671-4cd4-4caf-a406-0e304bbc8f98 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.463329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc96671-4cd4-4caf-a406-0e304bbc8f98 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.464278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc96671-4cd4-4caf-a406-0e304bbc8f98 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:51.464375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc96671-4cd4-4caf-a406-0e304bbc8f98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.465737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc96671-4cd4-4caf-a406-0e304bbc8f98 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.470519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 504/1007] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Jun 23 10:50:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:51.471705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a53ab-af38-4d72-bf9c-cf49d9d18b92 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.472023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a53ab-af38-4d72-bf9c-cf49d9d18b92 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.472304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a53ab-af38-4d72-bf9c-cf49d9d18b92 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.473791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 505/1008] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:51.476406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a53ab-af38-4d72-bf9c-cf49d9d18b92 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.548865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:51.553314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 504/1009] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:50:51 2022] POST /identity/v3/services => generated 242 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:51.554407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7515de-91f5-49f5-80fa-3fb5070533a5 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.557545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7515de-91f5-49f5-80fa-3fb5070533a5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.557545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7515de-91f5-49f5-80fa-3fb5070533a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.576322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-8c7515de-91f5-49f5-80fa-3fb5070533a5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:51.577748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8c7515de-91f5-49f5-80fa-3fb5070533a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:51.581051 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:51.605263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a53ab-af38-4d72-bf9c-cf49d9d18b92 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.646836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a27b81-2d77-4785-85cc-962e668d439c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.647940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a27b81-2d77-4785-85cc-962e668d439c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.648428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a27b81-2d77-4785-85cc-962e668d439c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.649504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a27b81-2d77-4785-85cc-962e668d439c None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.650420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a27b81-2d77-4785-85cc-962e668d439c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:51.650915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a27b81-2d77-4785-85cc-962e668d439c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.652527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a27b81-2d77-4785-85cc-962e668d439c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.656652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 505/1010] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:51 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:51.663317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 506/1011] 10.222.0.52 () {56 vars in 1122 bytes} [Thu Jun 23 10:50:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:51.664939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7515de-91f5-49f5-80fa-3fb5070533a5 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.680915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a27b81-2d77-4785-85cc-962e668d439c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.780374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7515de-91f5-49f5-80fa-3fb5070533a5 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.802883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a27b81-2d77-4785-85cc-962e668d439c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:51.817603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d0783-97ff-40df-a167-d18db47b56a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.818274 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d0783-97ff-40df-a167-d18db47b56a0 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.818541 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d0783-97ff-40df-a167-d18db47b56a0 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.818850 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7d0783-97ff-40df-a167-d18db47b56a0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.819579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d0783-97ff-40df-a167-d18db47b56a0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.821626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7d0783-97ff-40df-a167-d18db47b56a0 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.836601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:51.842998 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca132f-8f76-4685-90ac-9f537ff40e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:51.843790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca132f-8f76-4685-90ac-9f537ff40e3d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:51.844134 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca132f-8f76-4685-90ac-9f537ff40e3d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:51.844416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ca132f-8f76-4685-90ac-9f537ff40e3d None admin] PATH_INFO: `/v3/services/compute` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:51.845069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca132f-8f76-4685-90ac-9f537ff40e3d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:51.846448 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ca132f-8f76-4685-90ac-9f537ff40e3d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-06ca132f-8f76-4685-90ac-9f537ff40e3d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:51.858691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:51.865523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:51.866351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 507/1012] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:51.867136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca132f-8f76-4685-90ac-9f537ff40e3d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:51.889721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:51.896548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 506/1013] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Jun 23 10:50:51 2022] POST /identity/v3/endpoints => generated 325 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:51.988721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ca132f-8f76-4685-90ac-9f537ff40e3d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:52.034524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e130c-24a2-444c-ade8-88ad69d26371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:52.035207 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e130c-24a2-444c-ade8-88ad69d26371 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.035462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e130c-24a2-444c-ade8-88ad69d26371 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.035734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e130c-24a2-444c-ade8-88ad69d26371 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.036485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e130c-24a2-444c-ade8-88ad69d26371 None admin] RBAC: Adding query filter params (name=compute) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:52.036792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e130c-24a2-444c-ade8-88ad69d26371 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:52.038194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e130c-24a2-444c-ade8-88ad69d26371 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:52.044647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 508/1014] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:52.049923 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d0783-97ff-40df-a167-d18db47b56a0 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:52.157070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7d0783-97ff-40df-a167-d18db47b56a0 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:52.193044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83ec581-5d84-4c29-92f1-dde8887f7777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:52.193712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ec581-5d84-4c29-92f1-dde8887f7777 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.193995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ec581-5d84-4c29-92f1-dde8887f7777 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.194271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83ec581-5d84-4c29-92f1-dde8887f7777 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.194967 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ec581-5d84-4c29-92f1-dde8887f7777 None admin] RBAC: Adding query filter params (type=compute) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:52.195270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ec581-5d84-4c29-92f1-dde8887f7777 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:52.196704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83ec581-5d84-4c29-92f1-dde8887f7777 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:52.207313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 507/1015] 10.222.0.52 () {56 vars in 1112 bytes} [Thu Jun 23 10:50:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:52.209060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e130c-24a2-444c-ade8-88ad69d26371 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:52.271472 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:52.319635 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e130c-24a2-444c-ade8-88ad69d26371 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:52.355061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627e057b-ef11-4501-85af-b818df3d7ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:52.355727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e057b-ef11-4501-85af-b818df3d7ae4 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:52.356169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e057b-ef11-4501-85af-b818df3d7ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:52.356460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627e057b-ef11-4501-85af-b818df3d7ae4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:52.357209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e057b-ef11-4501-85af-b818df3d7ae4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:52.358585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627e057b-ef11-4501-85af-b818df3d7ae4 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:52.479476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 509/1016] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Jun 23 10:50:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:50:53.627068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272445d-d695-4bcf-81db-4d9607ada4da None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:53.627582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272445d-d695-4bcf-81db-4d9607ada4da None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:53.627661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272445d-d695-4bcf-81db-4d9607ada4da None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:53.629227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 508/1017] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:53.634248 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcf8de-84a2-41f9-b46f-3f892ebe0884 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:53.634644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcf8de-84a2-41f9-b46f-3f892ebe0884 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:53.634817 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbcf8de-84a2-41f9-b46f-3f892ebe0884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:53.652607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-7cbcf8de-84a2-41f9-b46f-3f892ebe0884 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:53.653802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7cbcf8de-84a2-41f9-b46f-3f892ebe0884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:53.732367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 510/1018] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:53.754648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272445d-d695-4bcf-81db-4d9607ada4da None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:53.818659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:53.860047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272445d-d695-4bcf-81db-4d9607ada4da None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:53.894189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e85c2-3509-4070-9c7b-41422e3599d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:53.894965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e85c2-3509-4070-9c7b-41422e3599d1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:53.895242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e85c2-3509-4070-9c7b-41422e3599d1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:53.895513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e85c2-3509-4070-9c7b-41422e3599d1 None admin] PATH_INFO: `/v3/services/image` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:53.896182 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e85c2-3509-4070-9c7b-41422e3599d1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:53.897547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e85c2-3509-4070-9c7b-41422e3599d1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-ef0e85c2-3509-4070-9c7b-41422e3599d1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:53.909595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:53.910600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:50:53.911485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:53.915714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 509/1019] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Jun 23 10:50:53 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:53.917202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcf8de-84a2-41f9-b46f-3f892ebe0884 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:53.953151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:53.970267 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2f6dc-8989-49ee-9fb2-075a3bf49bbc None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:53.970600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2f6dc-8989-49ee-9fb2-075a3bf49bbc None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:53.970898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2f6dc-8989-49ee-9fb2-075a3bf49bbc None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:53.972820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 510/1020] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:50:53.977564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a4530-8e8d-4ecb-8ad2-6e9a5bc96683 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:53.977952 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a4530-8e8d-4ecb-8ad2-6e9a5bc96683 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:53.978128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a4530-8e8d-4ecb-8ad2-6e9a5bc96683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:53.995229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-d70a4530-8e8d-4ecb-8ad2-6e9a5bc96683 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:53.996495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d70a4530-8e8d-4ecb-8ad2-6e9a5bc96683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:54.032019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbcf8de-84a2-41f9-b46f-3f892ebe0884 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:54.069030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 511/1021] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:53 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:54.074791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a303b-d6ca-4d60-ba3f-967a536ed071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:54.075467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a303b-d6ca-4d60-ba3f-967a536ed071 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:54.075742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a303b-d6ca-4d60-ba3f-967a536ed071 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:54.076055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4a303b-d6ca-4d60-ba3f-967a536ed071 None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:54.076765 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a303b-d6ca-4d60-ba3f-967a536ed071 None admin] RBAC: Adding query filter params (name=image) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:54.077069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a303b-d6ca-4d60-ba3f-967a536ed071 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:54.078542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4a303b-d6ca-4d60-ba3f-967a536ed071 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:54.084270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 511/1022] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:53 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:54.089960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a4530-8e8d-4ecb-8ad2-6e9a5bc96683 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:54.094364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a303b-d6ca-4d60-ba3f-967a536ed071 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:54.153073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:54.202198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:54.204667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a4530-8e8d-4ecb-8ad2-6e9a5bc96683 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:54.205095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4a303b-d6ca-4d60-ba3f-967a536ed071 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:54.241118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59700cd3-2575-44b6-83a9-a4da9d35c122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:54.241912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59700cd3-2575-44b6-83a9-a4da9d35c122 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:54.242768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3f202-7621-4e42-9eea-936df046d8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:54.242896 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59700cd3-2575-44b6-83a9-a4da9d35c122 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:54.243078 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59700cd3-2575-44b6-83a9-a4da9d35c122 None admin] PATH_INFO: `/v3/domains/default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:54.243364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3f202-7621-4e42-9eea-936df046d8ca None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:54.243623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3f202-7621-4e42-9eea-936df046d8ca None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:54.243921 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f3f202-7621-4e42-9eea-936df046d8ca None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:54.244275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59700cd3-2575-44b6-83a9-a4da9d35c122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:54.244618 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3f202-7621-4e42-9eea-936df046d8ca None admin] RBAC: Adding query filter params (type=image) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:54.244920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3f202-7621-4e42-9eea-936df046d8ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:54.245722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59700cd3-2575-44b6-83a9-a4da9d35c122 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:54.246278 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f3f202-7621-4e42-9eea-936df046d8ca None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:54.247519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 512/1023] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:54.252957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59700cd3-2575-44b6-83a9-a4da9d35c122 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:54.256693 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 512/1024] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:54 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:54.258537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3f202-7621-4e42-9eea-936df046d8ca None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:54.362229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59700cd3-2575-44b6-83a9-a4da9d35c122 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:54.364144 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f3f202-7621-4e42-9eea-936df046d8ca None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:54.393966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:54.398902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb468b1-f94b-4906-a958-e999f495dfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:54.401523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb468b1-f94b-4906-a958-e999f495dfba None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:54.401523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb468b1-f94b-4906-a958-e999f495dfba None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:54.401523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb468b1-f94b-4906-a958-e999f495dfba None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:54.401523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb468b1-f94b-4906-a958-e999f495dfba None admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:54.402256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb468b1-f94b-4906-a958-e999f495dfba None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:54.416831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236000fe-77f2-4107-b0e3-5735d99060ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:54.417311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236000fe-77f2-4107-b0e3-5735d99060ac None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:54.417609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236000fe-77f2-4107-b0e3-5735d99060ac None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:54.417890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236000fe-77f2-4107-b0e3-5735d99060ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:54.418741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236000fe-77f2-4107-b0e3-5735d99060ac None admin] RBAC: Adding query filter params (interface=public, service_id=f64ef9432c5f485f9781bb1a0cae1426, region_id=RegionOne) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:54.419052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236000fe-77f2-4107-b0e3-5735d99060ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:54.420472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236000fe-77f2-4107-b0e3-5735d99060ac None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:54.425809 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 513/1025] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Jun 23 10:50:54 2022] GET /identity/v3/endpoints?service_id=f64ef9432c5f485f9781bb1a0cae1426&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:54.431901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236000fe-77f2-4107-b0e3-5735d99060ac None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:54.491345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 513/1026] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:50:54 2022] POST /identity/v3/projects => generated 311 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 10:50:54.550459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236000fe-77f2-4107-b0e3-5735d99060ac None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:54.592306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc564f3-a8df-464a-8467-8b1b15af3309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:54.592987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc564f3-a8df-464a-8467-8b1b15af3309 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:54.593374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc564f3-a8df-464a-8467-8b1b15af3309 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:54.593545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc564f3-a8df-464a-8467-8b1b15af3309 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:54.594239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc564f3-a8df-464a-8467-8b1b15af3309 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:54.595655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc564f3-a8df-464a-8467-8b1b15af3309 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:54.607589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 514/1027] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Jun 23 10:50:54 2022] GET /identity/v3/services => generated 1957 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 10:50:54.637758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20df7f-fd34-4013-b332-abdeb27625b9 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:54.638302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20df7f-fd34-4013-b332-abdeb27625b9 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:54.638302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf20df7f-fd34-4013-b332-abdeb27625b9 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:54.640081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 514/1028] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:54.645850 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7c94d-0b0a-4321-be1a-eb5ce2ae90e0 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:54.646450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7c94d-0b0a-4321-be1a-eb5ce2ae90e0 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:54.646526 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb7c94d-0b0a-4321-be1a-eb5ce2ae90e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:54.665293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-7fb7c94d-0b0a-4321-be1a-eb5ce2ae90e0 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:54.666542 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-7fb7c94d-0b0a-4321-be1a-eb5ce2ae90e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:54.724056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:54.745836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 515/1029] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:54 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:54.769867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20df7f-fd34-4013-b332-abdeb27625b9 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:54.797467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:54.883402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf20df7f-fd34-4013-b332-abdeb27625b9 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:54.921767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f73e88-ff1a-4744-b0d5-a50248412ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:54.922920 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f73e88-ff1a-4744-b0d5-a50248412ae9 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:54.923397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f73e88-ff1a-4744-b0d5-a50248412ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:54.923845 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f73e88-ff1a-4744-b0d5-a50248412ae9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:54.935987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f73e88-ff1a-4744-b0d5-a50248412ae9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-b2f73e88-ff1a-4744-b0d5-a50248412ae9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:54.944610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:54.946292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:54.947419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:54.947419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:54.947419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:54.947419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:54.947419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:54.947419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:54.947419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:54.947419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:54.947419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:54.947419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:54.947419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:50:54.947419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:54.949859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 515/1030] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Jun 23 10:50:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:54.955473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7c94d-0b0a-4321-be1a-eb5ce2ae90e0 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:55.059162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb7c94d-0b0a-4321-be1a-eb5ce2ae90e0 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:55.095253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b7558-af85-49cc-a9cf-8edb716d0efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:55.095820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b7558-af85-49cc-a9cf-8edb716d0efd None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:55.096108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b7558-af85-49cc-a9cf-8edb716d0efd None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:55.096385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b7558-af85-49cc-a9cf-8edb716d0efd None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:55.097130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b7558-af85-49cc-a9cf-8edb716d0efd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:55.097707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b7558-af85-49cc-a9cf-8edb716d0efd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:55.099079 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b7558-af85-49cc-a9cf-8edb716d0efd None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:55.107608 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 516/1031] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Jun 23 10:50:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:55.113064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f73e88-ff1a-4744-b0d5-a50248412ae9 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:55.197543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:55.217549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f73e88-ff1a-4744-b0d5-a50248412ae9 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:55.254993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dd3a5-c318-4e06-852f-24d76ccb8f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:55.256069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dd3a5-c318-4e06-852f-24d76ccb8f4d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:55.256544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dd3a5-c318-4e06-852f-24d76ccb8f4d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:55.256973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6dd3a5-c318-4e06-852f-24d76ccb8f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:55.268774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dd3a5-c318-4e06-852f-24d76ccb8f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:55.270457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6dd3a5-c318-4e06-852f-24d76ccb8f4d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-3e6dd3a5-c318-4e06-852f-24d76ccb8f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:55.288304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:55.289857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:55.290748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:55.290748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:55.290748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:55.290748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:55.291998 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 516/1032] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:55.296328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b7558-af85-49cc-a9cf-8edb716d0efd None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:55.341377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:55.402983 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b7558-af85-49cc-a9cf-8edb716d0efd None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:55.450157 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0273def-28df-480c-a4cf-6acf68fe13e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:55.450815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0273def-28df-480c-a4cf-6acf68fe13e1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:55.451097 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0273def-28df-480c-a4cf-6acf68fe13e1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:55.451395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0273def-28df-480c-a4cf-6acf68fe13e1 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:55.452116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0273def-28df-480c-a4cf-6acf68fe13e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:55.452423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0273def-28df-480c-a4cf-6acf68fe13e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:55.453790 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0273def-28df-480c-a4cf-6acf68fe13e1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:55.466025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 517/1033] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:55.471384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dd3a5-c318-4e06-852f-24d76ccb8f4d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:55.583612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6dd3a5-c318-4e06-852f-24d76ccb8f4d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:55.615732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:55.620801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a742936-60fa-41fc-bfcb-47217935566b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:55.621592 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a742936-60fa-41fc-bfcb-47217935566b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:55.621876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a742936-60fa-41fc-bfcb-47217935566b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:55.622154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a742936-60fa-41fc-bfcb-47217935566b None admin] PATH_INFO: `/v3/users/nova` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:55.629928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a742936-60fa-41fc-bfcb-47217935566b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:55.631476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a742936-60fa-41fc-bfcb-47217935566b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-8a742936-60fa-41fc-bfcb-47217935566b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:50:55.645482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:55.646908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:55.648802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:55.648802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:55.648802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:50:55.648802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:50:55.648802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:50:55.648802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:50:55.648802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:50:55.648802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:50:55.648802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:50:55.648802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:55.650640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 517/1034] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Jun 23 10:50:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:55.652905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0273def-28df-480c-a4cf-6acf68fe13e1 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:55.759444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:55.763021 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0273def-28df-480c-a4cf-6acf68fe13e1 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:55.797853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f148206-22fb-40d9-859c-f3c0c2774733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:55.798525 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f148206-22fb-40d9-859c-f3c0c2774733 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:55.798811 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f148206-22fb-40d9-859c-f3c0c2774733 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:55.799125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f148206-22fb-40d9-859c-f3c0c2774733 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:55.800031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f148206-22fb-40d9-859c-f3c0c2774733 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:55.800342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f148206-22fb-40d9-859c-f3c0c2774733 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:55.801992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f148206-22fb-40d9-859c-f3c0c2774733 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:55.822371 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 518/1035] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Jun 23 10:50:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:55.827849 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a742936-60fa-41fc-bfcb-47217935566b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:55.931478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a742936-60fa-41fc-bfcb-47217935566b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:55.967708 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78071e51-5a46-4655-b06d-07c78bc9501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:55.968378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071e51-5a46-4655-b06d-07c78bc9501f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:55.968662 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071e51-5a46-4655-b06d-07c78bc9501f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:55.968940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78071e51-5a46-4655-b06d-07c78bc9501f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:56.028204 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:56.038309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78071e51-5a46-4655-b06d-07c78bc9501f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:56.040335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78071e51-5a46-4655-b06d-07c78bc9501f None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:56.145768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 518/1036] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:50:55 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:50:56.146946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f148206-22fb-40d9-859c-f3c0c2774733 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:56.249504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f148206-22fb-40d9-859c-f3c0c2774733 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:56.283748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5619e86-67ea-4ad6-b00b-eb05843cef42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:56.284634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5619e86-67ea-4ad6-b00b-eb05843cef42 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:56.284914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5619e86-67ea-4ad6-b00b-eb05843cef42 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:56.285184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5619e86-67ea-4ad6-b00b-eb05843cef42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:56.296221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5619e86-67ea-4ad6-b00b-eb05843cef42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:56.297689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5619e86-67ea-4ad6-b00b-eb05843cef42 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-c5619e86-67ea-4ad6-b00b-eb05843cef42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:56.315375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:56.321153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:56.322084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:56.322084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:56.322084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:56.322084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:56.322084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 519/1037] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:56.322368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78071e51-5a46-4655-b06d-07c78bc9501f None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:56.416783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:56.426163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78071e51-5a46-4655-b06d-07c78bc9501f None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:56.459852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fbf446-0724-4a80-82b8-d5ca8d0fed60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:56.460665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbf446-0724-4a80-82b8-d5ca8d0fed60 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:56.461480 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbf446-0724-4a80-82b8-d5ca8d0fed60 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:56.462105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fbf446-0724-4a80-82b8-d5ca8d0fed60 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:56.462848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbf446-0724-4a80-82b8-d5ca8d0fed60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:56.463154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbf446-0724-4a80-82b8-d5ca8d0fed60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:56.464566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fbf446-0724-4a80-82b8-d5ca8d0fed60 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:56.481594 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 519/1038] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:56.483044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5619e86-67ea-4ad6-b00b-eb05843cef42 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:56.495524 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:56.593260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5619e86-67ea-4ad6-b00b-eb05843cef42 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:56.628956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b879a-9a74-46cf-8ca1-59cd32ad83e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:56.629735 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c925017-b9dd-40a7-8476-12a8a85c8078 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:56.630039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c925017-b9dd-40a7-8476-12a8a85c8078 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:56.630328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c925017-b9dd-40a7-8476-12a8a85c8078 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:56.630777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b879a-9a74-46cf-8ca1-59cd32ad83e6 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:56.631280 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b879a-9a74-46cf-8ca1-59cd32ad83e6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:56.631706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 520/1039] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:56.631951 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b879a-9a74-46cf-8ca1-59cd32ad83e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:56.637369 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2eacc-725b-46cd-9e3b-be035f0589e6 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:56.637660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2eacc-725b-46cd-9e3b-be035f0589e6 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:56.637944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2eacc-725b-46cd-9e3b-be035f0589e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:56.641715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b879a-9a74-46cf-8ca1-59cd32ad83e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:56.643187 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b879a-9a74-46cf-8ca1-59cd32ad83e6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:56.655333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-20a2eacc-725b-46cd-9e3b-be035f0589e6 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:56.656779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-20a2eacc-725b-46cd-9e3b-be035f0589e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-3d5b879a-9a74-46cf-8ca1-59cd32ad83e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:50:56.658560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:56.659839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:56.661362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:50:56.661362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:50:56.661362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:50:56.661362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:50:56.661362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:50:56.661362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:50:56.661362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:50:56.661362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:56.661362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 520/1040] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:56.661362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfa183-626b-4744-b777-b72bd95a8a98 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:56.661362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfa183-626b-4744-b777-b72bd95a8a98 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:56.662098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cfa183-626b-4744-b777-b72bd95a8a98 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:56.662828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 521/1041] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:56.667962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfa183-626b-4744-b777-b72bd95a8a98 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:56.729892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 521/1042] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:56.731193 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c9d2f-83b0-493d-890c-2fdf6dfa9e04 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:56.731481 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c9d2f-83b0-493d-890c-2fdf6dfa9e04 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:56.731762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1c9d2f-83b0-493d-890c-2fdf6dfa9e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:56.740446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:56.749084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-2e1c9d2f-83b0-493d-890c-2fdf6dfa9e04 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:56.750284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2e1c9d2f-83b0-493d-890c-2fdf6dfa9e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:56.771934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cfa183-626b-4744-b777-b72bd95a8a98 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:56.806346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf59694-98e5-44cb-8be8-2c974d4c497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:56.806999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf59694-98e5-44cb-8be8-2c974d4c497a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:56.807285 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf59694-98e5-44cb-8be8-2c974d4c497a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:56.807566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf59694-98e5-44cb-8be8-2c974d4c497a None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:56.808382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf59694-98e5-44cb-8be8-2c974d4c497a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:56.808691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf59694-98e5-44cb-8be8-2c974d4c497a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:56.810151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf59694-98e5-44cb-8be8-2c974d4c497a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:56.816213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 522/1043] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:56 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:56.817061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c9d2f-83b0-493d-890c-2fdf6dfa9e04 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:56.822381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 522/1044] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:56.828256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf59694-98e5-44cb-8be8-2c974d4c497a None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:56.836245 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:56.925156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1c9d2f-83b0-493d-890c-2fdf6dfa9e04 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:56.931850 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf59694-98e5-44cb-8be8-2c974d4c497a None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:56.958624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7cffa-8fe4-442e-8983-62fd741b8d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:56.959399 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7cffa-8fe4-442e-8983-62fd741b8d33 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:56.959677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7cffa-8fe4-442e-8983-62fd741b8d33 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:56.959993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe7cffa-8fe4-442e-8983-62fd741b8d33 None admin] PATH_INFO: `/v3/domains/default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:56.960202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:56.961165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7cffa-8fe4-442e-8983-62fd741b8d33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:56.962594 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe7cffa-8fe4-442e-8983-62fd741b8d33 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:56.964253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 523/1045] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:56.965001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7cffa-8fe4-442e-8983-62fd741b8d33 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:56.970762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac263908-e152-40de-acae-a9c48c373f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:56.971415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac263908-e152-40de-acae-a9c48c373f62 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:56.971692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac263908-e152-40de-acae-a9c48c373f62 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:56.971993 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac263908-e152-40de-acae-a9c48c373f62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:56.973073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac263908-e152-40de-acae-a9c48c373f62 None admin] RBAC: Adding query filter params (role.id=8503ee09d8864888a0153b6be38559dc, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=a020e7fe06574a108b46f9f48bddc4e4) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:56.973385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac263908-e152-40de-acae-a9c48c373f62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:56.974808 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac263908-e152-40de-acae-a9c48c373f62 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:56.995958 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 523/1046] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:50:56 2022] GET /identity/v3/role_assignments?user.id=a020e7fe06574a108b46f9f48bddc4e4&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=8503ee09d8864888a0153b6be38559dc => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:56.995958 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac263908-e152-40de-acae-a9c48c373f62 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:57.056678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:57.077406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe7cffa-8fe4-442e-8983-62fd741b8d33 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:57.119848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe46046-6fbd-4714-9c6a-ec6da8146fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:57.120639 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe46046-6fbd-4714-9c6a-ec6da8146fd1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:57.120916 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe46046-6fbd-4714-9c6a-ec6da8146fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:57.121188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe46046-6fbd-4714-9c6a-ec6da8146fd1 None admin] PATH_INFO: `/v3/services/image` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:57.121861 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe46046-6fbd-4714-9c6a-ec6da8146fd1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:57.123236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac263908-e152-40de-acae-a9c48c373f62 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:57.123355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe46046-6fbd-4714-9c6a-ec6da8146fd1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-2fe46046-6fbd-4714-9c6a-ec6da8146fd1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:57.135960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:57.137153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:57.138240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 524/1047] 10.222.0.52 () {56 vars in 1105 bytes} [Thu Jun 23 10:50:56 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:57.143595 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe46046-6fbd-4714-9c6a-ec6da8146fd1 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:57.169634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83143269-0957-4915-914d-44a762f8540d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:57.170309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83143269-0957-4915-914d-44a762f8540d None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:57.170595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83143269-0957-4915-914d-44a762f8540d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:57.170873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83143269-0957-4915-914d-44a762f8540d None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:57.171588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83143269-0957-4915-914d-44a762f8540d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:57.173067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83143269-0957-4915-914d-44a762f8540d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:57.250545 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe46046-6fbd-4714-9c6a-ec6da8146fd1 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:57.263847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 524/1048] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:50:56 2022] POST /identity/v3/users => generated 285 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:57.298196 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b895fa8-6e3f-4972-9eed-dde7e220582e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:57.298882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b895fa8-6e3f-4972-9eed-dde7e220582e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:57.299168 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b895fa8-6e3f-4972-9eed-dde7e220582e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:57.299446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b895fa8-6e3f-4972-9eed-dde7e220582e None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:57.300206 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b895fa8-6e3f-4972-9eed-dde7e220582e None admin] RBAC: Adding query filter params (name=image) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:57.300522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b895fa8-6e3f-4972-9eed-dde7e220582e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:57.301922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b895fa8-6e3f-4972-9eed-dde7e220582e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:57.308176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 525/1049] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:57.313884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83143269-0957-4915-914d-44a762f8540d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:57.371956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:57.432252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83143269-0957-4915-914d-44a762f8540d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:57.474508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966ae96-9a80-46b7-8591-befffc519be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:57.475168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966ae96-9a80-46b7-8591-befffc519be9 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:57.475451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966ae96-9a80-46b7-8591-befffc519be9 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:57.475723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966ae96-9a80-46b7-8591-befffc519be9 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:57.476526 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966ae96-9a80-46b7-8591-befffc519be9 None admin] RBAC: Adding query filter params (type=image) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:57.476836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966ae96-9a80-46b7-8591-befffc519be9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:57.478212 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c966ae96-9a80-46b7-8591-befffc519be9 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:57.484336 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 525/1050] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:57 2022] GET /identity/v3/services?type=image => generated 350 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:57.489653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b895fa8-6e3f-4972-9eed-dde7e220582e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:57.501913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:57.604973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b895fa8-6e3f-4972-9eed-dde7e220582e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:57.640814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b03c2b-368a-4eaf-b91c-d18d5a16e2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:57.641749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03c2b-368a-4eaf-b91c-d18d5a16e2e2 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:57.641749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03c2b-368a-4eaf-b91c-d18d5a16e2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:57.641941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b03c2b-368a-4eaf-b91c-d18d5a16e2e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:57.642688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b03c2b-368a-4eaf-b91c-d18d5a16e2e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:57.644091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b03c2b-368a-4eaf-b91c-d18d5a16e2e2 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:57.707040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 526/1051] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Jun 23 10:50:57 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:50:59.035590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b40a-2573-4eba-853e-3b1f1c3e0f73 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:59.036340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b40a-2573-4eba-853e-3b1f1c3e0f73 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:59.036747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8b40a-2573-4eba-853e-3b1f1c3e0f73 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:59.039830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 526/1052] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:59.046137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499584f-97c3-4bcd-becb-e4d2338f0df8 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:59.046686 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499584f-97c3-4bcd-becb-e4d2338f0df8 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:59.046686 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0499584f-97c3-4bcd-becb-e4d2338f0df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:59.064952 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0499584f-97c3-4bcd-becb-e4d2338f0df8 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:59.066159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0499584f-97c3-4bcd-becb-e4d2338f0df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:59.131538 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:59.146796 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 527/1053] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:59.169671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8b40a-2573-4eba-853e-3b1f1c3e0f73 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:59.273076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8b40a-2573-4eba-853e-3b1f1c3e0f73 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:59.287711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:59.308341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70085f4a-93f3-467f-bb73-964509bc1fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:59.309146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70085f4a-93f3-467f-bb73-964509bc1fca None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:59.309424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70085f4a-93f3-467f-bb73-964509bc1fca None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:59.309696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70085f4a-93f3-467f-bb73-964509bc1fca None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:59.320323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70085f4a-93f3-467f-bb73-964509bc1fca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-70085f4a-93f3-467f-bb73-964509bc1fca None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:59.329055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:59.330126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:59.331061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:59.331061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:59.331061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:59.331061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:59.331061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:59.331061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:59.331061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:59.331061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:59.331061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:59.331061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:59.331061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:50:59.331061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:59.335444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 527/1054] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Jun 23 10:50:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:59.336864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499584f-97c3-4bcd-becb-e4d2338f0df8 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:59.373031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585daa0b-a442-4d7d-a741-9b70a09012c0 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:59.373260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585daa0b-a442-4d7d-a741-9b70a09012c0 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:59.373502 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585daa0b-a442-4d7d-a741-9b70a09012c0 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:59.375403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 528/1055] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:59.381402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa15bd2-aace-41db-b256-f2e6a4499adf None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:59.381694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa15bd2-aace-41db-b256-f2e6a4499adf None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:59.381980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa15bd2-aace-41db-b256-f2e6a4499adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:59.400252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-8fa15bd2-aace-41db-b256-f2e6a4499adf None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:59.401473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8fa15bd2-aace-41db-b256-f2e6a4499adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:59.463651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0499584f-97c3-4bcd-becb-e4d2338f0df8 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:59.495773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 529/1056] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:50:59.515414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12a2b1-0d7c-4178-a743-9308b35fe32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:59.516128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12a2b1-0d7c-4178-a743-9308b35fe32c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:59.516415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12a2b1-0d7c-4178-a743-9308b35fe32c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:59.516695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec12a2b1-0d7c-4178-a743-9308b35fe32c None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:59.517452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12a2b1-0d7c-4178-a743-9308b35fe32c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:59.517757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12a2b1-0d7c-4178-a743-9308b35fe32c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:59.519001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa15bd2-aace-41db-b256-f2e6a4499adf None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:59.519148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec12a2b1-0d7c-4178-a743-9308b35fe32c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:59.529174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 528/1057] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Jun 23 10:50:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:59.535986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12a2b1-0d7c-4178-a743-9308b35fe32c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:59.621240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:59.634277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa15bd2-aace-41db-b256-f2e6a4499adf None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:59.638415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:59.671157 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f9d7d-7bb9-4231-aabe-6ad4188eeccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:59.672093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f9d7d-7bb9-4231-aabe-6ad4188eeccd None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:59.672441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f9d7d-7bb9-4231-aabe-6ad4188eeccd None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:59.672721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f9d7d-7bb9-4231-aabe-6ad4188eeccd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:59.673742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec12a2b1-0d7c-4178-a743-9308b35fe32c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:59.683240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f9d7d-7bb9-4231-aabe-6ad4188eeccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-8c4f9d7d-7bb9-4231-aabe-6ad4188eeccd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:50:59.690998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:59.692429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:50:59.693340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 530/1058] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:50:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:50:59.698536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f9d7d-7bb9-4231-aabe-6ad4188eeccd None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:59.717023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38918921-cd5b-483b-ae6f-c60bc129ca53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:59.718261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38918921-cd5b-483b-ae6f-c60bc129ca53 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:59.718562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38918921-cd5b-483b-ae6f-c60bc129ca53 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:59.718842 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38918921-cd5b-483b-ae6f-c60bc129ca53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:59.733137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38918921-cd5b-483b-ae6f-c60bc129ca53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:59.735393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38918921-cd5b-483b-ae6f-c60bc129ca53 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-38918921-cd5b-483b-ae6f-c60bc129ca53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:50:59.756278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:50:59.758759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:50:59.760855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:50:59.760855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:50:59.760855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:50:59.760855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:50:59.760855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 529/1059] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:50:59.760855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dade6e-99fd-490e-9286-e79a2333628a None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:59.760855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dade6e-99fd-490e-9286-e79a2333628a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:59.760855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dade6e-99fd-490e-9286-e79a2333628a None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:59.762302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 530/1060] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:50:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:50:59.763445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dade6e-99fd-490e-9286-e79a2333628a None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:59.805472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f9d7d-7bb9-4231-aabe-6ad4188eeccd None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:59.845955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eb4048-7bfd-4474-b2e7-075b06ad5ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:59.846660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb4048-7bfd-4474-b2e7-075b06ad5ffa None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:59.847023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb4048-7bfd-4474-b2e7-075b06ad5ffa None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:59.847394 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eb4048-7bfd-4474-b2e7-075b06ad5ffa None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:59.848271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb4048-7bfd-4474-b2e7-075b06ad5ffa None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:59.848378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb4048-7bfd-4474-b2e7-075b06ad5ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:59.849787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eb4048-7bfd-4474-b2e7-075b06ad5ffa None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:59.858124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 531/1061] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:50:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:50:59.859422 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bbe63-b636-428f-b142-1cf478545d65 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:59.859713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bbe63-b636-428f-b142-1cf478545d65 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:59.860026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2bbe63-b636-428f-b142-1cf478545d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:59.876964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dade6e-99fd-490e-9286-e79a2333628a None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:50:59.877208 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3a2bbe63-b636-428f-b142-1cf478545d65 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:50:59.878400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3a2bbe63-b636-428f-b142-1cf478545d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:50:59.879490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:59.899559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:50:59.913125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5448482-5773-460e-bc10-e870eb8c42f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:50:59.913837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5448482-5773-460e-bc10-e870eb8c42f2 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:50:59.914132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5448482-5773-460e-bc10-e870eb8c42f2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:50:59.914394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5448482-5773-460e-bc10-e870eb8c42f2 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:50:59.915131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5448482-5773-460e-bc10-e870eb8c42f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:50:59.915429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5448482-5773-460e-bc10-e870eb8c42f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:50:59.916845 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5448482-5773-460e-bc10-e870eb8c42f2 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:50:59.928282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 531/1062] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:50:59.932876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5448482-5773-460e-bc10-e870eb8c42f2 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:50:59.952114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 532/1063] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:50:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:50:59.953143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bbe63-b636-428f-b142-1cf478545d65 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:00.035967 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5448482-5773-460e-bc10-e870eb8c42f2 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:00.051605 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2bbe63-b636-428f-b142-1cf478545d65 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:00.072439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea44670-30a2-4cb4-903e-566de4393b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:00.073307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea44670-30a2-4cb4-903e-566de4393b1c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:00.073588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea44670-30a2-4cb4-903e-566de4393b1c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:00.073862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea44670-30a2-4cb4-903e-566de4393b1c None admin] PATH_INFO: `/v3/users/007925a53f0b43739d3cff9a77bd71ca` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:00.087291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10606277-675b-4494-b6e4-940fc4816fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:00.087492 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea44670-30a2-4cb4-903e-566de4393b1c None admin] RBAC: Authorizing `identity:get_user(user_id=007925a53f0b43739d3cff9a77bd71ca)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:00.088111 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10606277-675b-4494-b6e4-940fc4816fb5 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:00.088390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10606277-675b-4494-b6e4-940fc4816fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:00.088663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10606277-675b-4494-b6e4-940fc4816fb5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:00.088905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea44670-30a2-4cb4-903e-566de4393b1c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:00.090571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 532/1064] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:50:59 2022] GET /identity/v3/users/007925a53f0b43739d3cff9a77bd71ca => generated 285 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:00.091328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea44670-30a2-4cb4-903e-566de4393b1c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:00.100507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10606277-675b-4494-b6e4-940fc4816fb5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:00.101929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10606277-675b-4494-b6e4-940fc4816fb5 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:00.116284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-10606277-675b-4494-b6e4-940fc4816fb5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:51:00.116451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:00.118069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:00.119127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:00.119127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:00.119127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:51:00.119127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:51:00.119127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:51:00.119127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:51:00.119127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:51:00.119127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:51:00.119127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:51:00.119127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:00.119127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 533/1065] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Jun 23 10:50:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:00.119127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10606277-675b-4494-b6e4-940fc4816fb5 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:00.144083 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:00.201705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea44670-30a2-4cb4-903e-566de4393b1c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:00.225943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10606277-675b-4494-b6e4-940fc4816fb5 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:00.238292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22de11-d1c9-40d6-b7db-61848414c782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:00.238937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22de11-d1c9-40d6-b7db-61848414c782 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:00.239219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22de11-d1c9-40d6-b7db-61848414c782 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:00.239504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f22de11-d1c9-40d6-b7db-61848414c782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:00.261805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0be70-955e-498d-b0bf-75d01249c93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:00.262446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0be70-955e-498d-b0bf-75d01249c93d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:00.262722 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0be70-955e-498d-b0bf-75d01249c93d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:00.262998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e0be70-955e-498d-b0bf-75d01249c93d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:00.306333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22de11-d1c9-40d6-b7db-61848414c782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:00.307796 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f22de11-d1c9-40d6-b7db-61848414c782 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:00.329950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0be70-955e-498d-b0bf-75d01249c93d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:00.331145 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:00.331405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e0be70-955e-498d-b0bf-75d01249c93d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:00.348738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:00.410106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 533/1066] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:51:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:51:00.410855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22de11-d1c9-40d6-b7db-61848414c782 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:00.439510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 534/1067] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:51:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:51:00.440140 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0be70-955e-498d-b0bf-75d01249c93d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:00.526388 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f22de11-d1c9-40d6-b7db-61848414c782 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:00.547706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e0be70-955e-498d-b0bf-75d01249c93d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:00.550284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:00.561175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4d561-f1fc-4ab4-9e28-45ed20489f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:00.561838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4d561-f1fc-4ab4-9e28-45ed20489f02 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:00.562119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4d561-f1fc-4ab4-9e28-45ed20489f02 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:00.562394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4d561-f1fc-4ab4-9e28-45ed20489f02 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:00.563306 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4d561-f1fc-4ab4-9e28-45ed20489f02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:00.563621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4d561-f1fc-4ab4-9e28-45ed20489f02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:00.565103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4d561-f1fc-4ab4-9e28-45ed20489f02 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:00.615878 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 534/1068] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Jun 23 10:51:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:00.617084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4d561-f1fc-4ab4-9e28-45ed20489f02 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:00.624050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:00.642551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56eb2-ef0b-48c4-95cb-8c81ff6118ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:00.643341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56eb2-ef0b-48c4-95cb-8c81ff6118ed None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:00.643630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56eb2-ef0b-48c4-95cb-8c81ff6118ed None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:00.643929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee56eb2-ef0b-48c4-95cb-8c81ff6118ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:00.655358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56eb2-ef0b-48c4-95cb-8c81ff6118ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:00.656854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee56eb2-ef0b-48c4-95cb-8c81ff6118ed None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-9ee56eb2-ef0b-48c4-95cb-8c81ff6118ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:51:00.675355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:00.676481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:00.682647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:51:00.682647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:51:00.682647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:51:00.682647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:00.682647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 535/1069] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:00.682647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56eb2-ef0b-48c4-95cb-8c81ff6118ed None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:00.718327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4d561-f1fc-4ab4-9e28-45ed20489f02 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:00.753126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3ebf3-f3a9-4309-8d09-3437b11d6bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:00.753973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3ebf3-f3a9-4309-8d09-3437b11d6bff None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:00.754249 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3ebf3-f3a9-4309-8d09-3437b11d6bff None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:00.754517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3ebf3-f3a9-4309-8d09-3437b11d6bff None admin] PATH_INFO: `/v3/projects/b27bb6c229454c02b452ff114a7fa105` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:00.756111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3ebf3-f3a9-4309-8d09-3437b11d6bff None admin] RBAC: Authorizing `identity:get_project(project_id=b27bb6c229454c02b452ff114a7fa105)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:00.758429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3ebf3-f3a9-4309-8d09-3437b11d6bff None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:00.760481 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 535/1070] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:51:00 2022] GET /identity/v3/projects/b27bb6c229454c02b452ff114a7fa105 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:00.761243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3ebf3-f3a9-4309-8d09-3437b11d6bff None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:00.789548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee56eb2-ef0b-48c4-95cb-8c81ff6118ed None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:00.821259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:00.825710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49460f1d-15f2-444b-9617-a08e41b9e6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:00.826506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460f1d-15f2-444b-9617-a08e41b9e6be None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:00.834340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460f1d-15f2-444b-9617-a08e41b9e6be None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:00.834340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49460f1d-15f2-444b-9617-a08e41b9e6be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:00.837757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49460f1d-15f2-444b-9617-a08e41b9e6be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:00.839220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49460f1d-15f2-444b-9617-a08e41b9e6be None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-49460f1d-15f2-444b-9617-a08e41b9e6be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:51:00.856675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:00.857719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:00.858710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:51:00.858710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:51:00.858710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:51:00.858710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:00.858710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 536/1071] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:00.858710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49460f1d-15f2-444b-9617-a08e41b9e6be None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:00.884243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3ebf3-f3a9-4309-8d09-3437b11d6bff None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:00.884497 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:00.919945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3c97e-a236-40ea-a80a-d3685b6ff114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:00.920602 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3c97e-a236-40ea-a80a-d3685b6ff114 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:00.920886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3c97e-a236-40ea-a80a-d3685b6ff114 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:00.921162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3c97e-a236-40ea-a80a-d3685b6ff114 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:00.921909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3c97e-a236-40ea-a80a-d3685b6ff114 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:00.922248 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3c97e-a236-40ea-a80a-d3685b6ff114 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:00.923600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3c97e-a236-40ea-a80a-d3685b6ff114 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:00.936262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 536/1072] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:00.937004 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3c97e-a236-40ea-a80a-d3685b6ff114 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:00.974405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49460f1d-15f2-444b-9617-a08e41b9e6be None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:01.013500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410cd71-c961-4a54-b67f-d3ddfc544817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:01.014170 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410cd71-c961-4a54-b67f-d3ddfc544817 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:01.014455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410cd71-c961-4a54-b67f-d3ddfc544817 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:01.014732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e410cd71-c961-4a54-b67f-d3ddfc544817 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:01.015671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410cd71-c961-4a54-b67f-d3ddfc544817 None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=b27bb6c229454c02b452ff114a7fa105, user.id=007925a53f0b43739d3cff9a77bd71ca) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:01.016021 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410cd71-c961-4a54-b67f-d3ddfc544817 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:01.017516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e410cd71-c961-4a54-b67f-d3ddfc544817 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:01.035841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 537/1073] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:51:00 2022] GET /identity/v3/role_assignments?user.id=007925a53f0b43739d3cff9a77bd71ca&scope.project.id=b27bb6c229454c02b452ff114a7fa105&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:01.061773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3c97e-a236-40ea-a80a-d3685b6ff114 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:01.072709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:01.104259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38aa2-5ed7-4f33-a815-0834f9e619ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:01.104946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38aa2-5ed7-4f33-a815-0834f9e619ed None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:01.106005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38aa2-5ed7-4f33-a815-0834f9e619ed None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:01.106005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e38aa2-5ed7-4f33-a815-0834f9e619ed None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:01.106298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e38aa2-5ed7-4f33-a815-0834f9e619ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:01.106530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e38aa2-5ed7-4f33-a815-0834f9e619ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:01.107976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e38aa2-5ed7-4f33-a815-0834f9e619ed None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:01.122261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 537/1074] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:01.128365 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410cd71-c961-4a54-b67f-d3ddfc544817 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:01.237847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:01.254057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e410cd71-c961-4a54-b67f-d3ddfc544817 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:01.289742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcce44-9602-498e-a39e-b98db9784658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:01.290536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcce44-9602-498e-a39e-b98db9784658 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:01.290815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcce44-9602-498e-a39e-b98db9784658 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:01.291095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dcce44-9602-498e-a39e-b98db9784658 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:01.297890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcce44-9602-498e-a39e-b98db9784658 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:01.299324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dcce44-9602-498e-a39e-b98db9784658 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-d3dcce44-9602-498e-a39e-b98db9784658 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:51:01.312874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:01.313960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:01.314879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:51:01.314879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:51:01.314879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:51:01.314879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:51:01.314879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:51:01.314879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:51:01.314879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:51:01.314879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:01.314879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 538/1075] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:51:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:01.320440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38aa2-5ed7-4f33-a815-0834f9e619ed None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:01.420175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e38aa2-5ed7-4f33-a815-0834f9e619ed None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:01.454190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea419b19-2f65-44dc-93f2-29583676b51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:01.454850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea419b19-2f65-44dc-93f2-29583676b51d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:01.455134 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea419b19-2f65-44dc-93f2-29583676b51d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:01.455412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea419b19-2f65-44dc-93f2-29583676b51d None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:01.456229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea419b19-2f65-44dc-93f2-29583676b51d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:01.456541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea419b19-2f65-44dc-93f2-29583676b51d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:01.457977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea419b19-2f65-44dc-93f2-29583676b51d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:01.473736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 538/1076] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:01.480354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcce44-9602-498e-a39e-b98db9784658 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:01.589396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dcce44-9602-498e-a39e-b98db9784658 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:01.623106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc32841-4946-4693-a1bf-f3d3936fc06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:01.624012 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc32841-4946-4693-a1bf-f3d3936fc06b None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:01.624294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc32841-4946-4693-a1bf-f3d3936fc06b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:01.624570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc32841-4946-4693-a1bf-f3d3936fc06b None admin] PATH_INFO: `/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/a020e7fe06574a108b46f9f48bddc4e4/roles/8503ee09d8864888a0153b6be38559dc` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:01.626740 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc32841-4946-4693-a1bf-f3d3936fc06b None admin] RBAC: Authorizing `identity:create_grant(project_id=d27530ca8f8e4156a519c726bd98c2a0, user_id=a020e7fe06574a108b46f9f48bddc4e4, role_id=8503ee09d8864888a0153b6be38559dc)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:01.628208 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc32841-4946-4693-a1bf-f3d3936fc06b None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:01.729772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 539/1077] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:51:01 2022] PUT /identity/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/a020e7fe06574a108b46f9f48bddc4e4/roles/8503ee09d8864888a0153b6be38559dc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:03.074809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8098c-7630-4e5b-bdaf-5b31256a4b9c None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:03.075373 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8098c-7630-4e5b-bdaf-5b31256a4b9c None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:03.075373 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c8098c-7630-4e5b-bdaf-5b31256a4b9c None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:03.076982 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 539/1078] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:03.082127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b9586-cca4-4d5c-b885-c108714e8e51 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:03.082524 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b9586-cca4-4d5c-b885-c108714e8e51 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:03.082811 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9b9586-cca4-4d5c-b885-c108714e8e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:03.089449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:03.100341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-8d9b9586-cca4-4d5c-b885-c108714e8e51 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:03.105020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8d9b9586-cca4-4d5c-b885-c108714e8e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:03.168443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 540/1079] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:03.191506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8098c-7630-4e5b-bdaf-5b31256a4b9c None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:03.221767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:03.297070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c8098c-7630-4e5b-bdaf-5b31256a4b9c None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:03.330057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d408990-72fa-461c-8d7b-b1e39f3414e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:03.330779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d408990-72fa-461c-8d7b-b1e39f3414e5 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:03.331064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d408990-72fa-461c-8d7b-b1e39f3414e5 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:03.331344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d408990-72fa-461c-8d7b-b1e39f3414e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:03.342163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d408990-72fa-461c-8d7b-b1e39f3414e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-3d408990-72fa-461c-8d7b-b1e39f3414e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:51:03.350092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:03.351126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:51:03.352666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 540/1080] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:51:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:03.358081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b9586-cca4-4d5c-b885-c108714e8e51 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:03.459556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9b9586-cca4-4d5c-b885-c108714e8e51 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:03.497255 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740160d-9326-4a37-b99d-3f0cf0f56aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:03.499138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740160d-9326-4a37-b99d-3f0cf0f56aaa None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:03.499423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740160d-9326-4a37-b99d-3f0cf0f56aaa None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:03.499707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740160d-9326-4a37-b99d-3f0cf0f56aaa None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:03.500588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740160d-9326-4a37-b99d-3f0cf0f56aaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:03.500904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740160d-9326-4a37-b99d-3f0cf0f56aaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:03.502302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740160d-9326-4a37-b99d-3f0cf0f56aaa None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:03.503908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:03.515582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 541/1081] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:51:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:03.521677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d408990-72fa-461c-8d7b-b1e39f3414e5 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:03.625320 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:03.637365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d408990-72fa-461c-8d7b-b1e39f3414e5 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:03.671981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69d657-982c-47f8-95c8-d4ed84b79e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:03.672845 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69d657-982c-47f8-95c8-d4ed84b79e1c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:03.673126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69d657-982c-47f8-95c8-d4ed84b79e1c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:03.673402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69d657-982c-47f8-95c8-d4ed84b79e1c None admin] PATH_INFO: `/v3/users/007925a53f0b43739d3cff9a77bd71ca` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:03.674591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69d657-982c-47f8-95c8-d4ed84b79e1c None admin] RBAC: Authorizing `identity:get_user(user_id=007925a53f0b43739d3cff9a77bd71ca)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:03.676062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b69d657-982c-47f8-95c8-d4ed84b79e1c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:03.677701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 541/1082] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:03 2022] GET /identity/v3/users/007925a53f0b43739d3cff9a77bd71ca => generated 285 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:03.683389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740160d-9326-4a37-b99d-3f0cf0f56aaa None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:03.753020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75964359-723e-467e-ba67-432fe92e91ad None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:03.753300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75964359-723e-467e-ba67-432fe92e91ad None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:03.753588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75964359-723e-467e-ba67-432fe92e91ad None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:03.754960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 542/1083] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:51:03.760339 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f7f1d-ef20-4807-8f97-028bd0cc080d None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:03.760629 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f7f1d-ef20-4807-8f97-028bd0cc080d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:03.760909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705f7f1d-ef20-4807-8f97-028bd0cc080d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:03.777906 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-705f7f1d-ef20-4807-8f97-028bd0cc080d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:03.779109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-705f7f1d-ef20-4807-8f97-028bd0cc080d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:03.785931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740160d-9326-4a37-b99d-3f0cf0f56aaa None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:03.818930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2425dd-3cc1-4ed6-9735-f012b88c778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:03.819798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2425dd-3cc1-4ed6-9735-f012b88c778e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:03.820634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2425dd-3cc1-4ed6-9735-f012b88c778e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:03.820909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2425dd-3cc1-4ed6-9735-f012b88c778e None admin] PATH_INFO: `/v3/projects/b27bb6c229454c02b452ff114a7fa105` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:03.822095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2425dd-3cc1-4ed6-9735-f012b88c778e None admin] RBAC: Authorizing `identity:get_project(project_id=b27bb6c229454c02b452ff114a7fa105)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:03.823529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2425dd-3cc1-4ed6-9735-f012b88c778e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:03.825248 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 542/1084] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:51:03 2022] GET /identity/v3/projects/b27bb6c229454c02b452ff114a7fa105 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:51:03.831063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2425dd-3cc1-4ed6-9735-f012b88c778e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:03.847993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 543/1085] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:51:03.872170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f7f1d-ef20-4807-8f97-028bd0cc080d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:03.893372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:03.930809 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2425dd-3cc1-4ed6-9735-f012b88c778e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:03.957557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:03.964269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893a985-2047-4cab-be1a-7d5cac81634d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:03.965160 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893a985-2047-4cab-be1a-7d5cac81634d None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:03.965436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893a985-2047-4cab-be1a-7d5cac81634d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:03.965711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9893a985-2047-4cab-be1a-7d5cac81634d None admin] PATH_INFO: `/v3/projects/b27bb6c229454c02b452ff114a7fa105/users/007925a53f0b43739d3cff9a77bd71ca/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:03.967800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893a985-2047-4cab-be1a-7d5cac81634d None admin] RBAC: Authorizing `identity:create_grant(project_id=b27bb6c229454c02b452ff114a7fa105, user_id=007925a53f0b43739d3cff9a77bd71ca, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:03.969257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9893a985-2047-4cab-be1a-7d5cac81634d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:03.972518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705f7f1d-ef20-4807-8f97-028bd0cc080d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:04.006741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd74608-1ec1-4894-8e97-7e096b9a3539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:04.008282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd74608-1ec1-4894-8e97-7e096b9a3539 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:04.008418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd74608-1ec1-4894-8e97-7e096b9a3539 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:04.008702 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd74608-1ec1-4894-8e97-7e096b9a3539 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:04.018817 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd74608-1ec1-4894-8e97-7e096b9a3539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-bbd74608-1ec1-4894-8e97-7e096b9a3539 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:51:04.027093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:04.028158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:51:04.029256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 544/1086] 10.222.0.52 () {56 vars in 1120 bytes} [Thu Jun 23 10:51:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:51:04.034147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd74608-1ec1-4894-8e97-7e096b9a3539 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:04.071041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 543/1087] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:51:03 2022] PUT /identity/v3/projects/b27bb6c229454c02b452ff114a7fa105/users/007925a53f0b43739d3cff9a77bd71ca/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 10:51:04.148620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd74608-1ec1-4894-8e97-7e096b9a3539 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:04.186490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33add1b-30f9-47d3-81d1-e476debc125b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:04.187174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33add1b-30f9-47d3-81d1-e476debc125b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:04.187455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33add1b-30f9-47d3-81d1-e476debc125b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:04.187731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33add1b-30f9-47d3-81d1-e476debc125b None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:04.188535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33add1b-30f9-47d3-81d1-e476debc125b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:04.188846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33add1b-30f9-47d3-81d1-e476debc125b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:04.190392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33add1b-30f9-47d3-81d1-e476debc125b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:04.199750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 545/1088] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Jun 23 10:51:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:51:04.205652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893a985-2047-4cab-be1a-7d5cac81634d None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:04.316348 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9893a985-2047-4cab-be1a-7d5cac81634d None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:04.338911 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:04.349947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5a698-5a60-4f92-85b7-cf8f318455c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:04.352837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5a698-5a60-4f92-85b7-cf8f318455c3 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:04.352837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5a698-5a60-4f92-85b7-cf8f318455c3 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:04.352837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe5a698-5a60-4f92-85b7-cf8f318455c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:04.362280 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5a698-5a60-4f92-85b7-cf8f318455c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:04.363725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe5a698-5a60-4f92-85b7-cf8f318455c3 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-afe5a698-5a60-4f92-85b7-cf8f318455c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:51:04.381507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:04.382496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:04.383474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:51:04.383474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:51:04.383474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:51:04.383474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:04.383474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 544/1089] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:51:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:04.388549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33add1b-30f9-47d3-81d1-e476debc125b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:04.400487 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:04.489945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33add1b-30f9-47d3-81d1-e476debc125b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:04.524936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d2102-c31e-4610-90d1-85958be1962d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:04.525599 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d2102-c31e-4610-90d1-85958be1962d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:04.525882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d2102-c31e-4610-90d1-85958be1962d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:04.526252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815d2102-c31e-4610-90d1-85958be1962d None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:04.526881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d2102-c31e-4610-90d1-85958be1962d None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:04.527183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d2102-c31e-4610-90d1-85958be1962d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:04.528615 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815d2102-c31e-4610-90d1-85958be1962d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:04.544093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 546/1090] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:51:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:04.549644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5a698-5a60-4f92-85b7-cf8f318455c3 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:04.653777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe5a698-5a60-4f92-85b7-cf8f318455c3 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:04.686794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff22a00-fb6d-46c4-80e1-382fb36d5568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:04.687581 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22a00-fb6d-46c4-80e1-382fb36d5568 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:04.687877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22a00-fb6d-46c4-80e1-382fb36d5568 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:04.688152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff22a00-fb6d-46c4-80e1-382fb36d5568 None admin] PATH_INFO: `/v3/users/nova` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:04.696172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff22a00-fb6d-46c4-80e1-382fb36d5568 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:04.697625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff22a00-fb6d-46c4-80e1-382fb36d5568 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-dff22a00-fb6d-46c4-80e1-382fb36d5568 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:51:04.711964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:04.713068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:04.714034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:04.714034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:04.714034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:51:04.714034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:51:04.714034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:51:04.714034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:51:04.714034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:51:04.714034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:51:04.714034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 23 10:51:04.714034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:04.714034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 545/1091] 10.222.0.52 () {56 vars in 1093 bytes} [Thu Jun 23 10:51:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:04.718961 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d2102-c31e-4610-90d1-85958be1962d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:04.786984 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:04.819559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815d2102-c31e-4610-90d1-85958be1962d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:04.854244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecda16-1271-4819-ba8f-17aa143b5120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:04.854909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecda16-1271-4819-ba8f-17aa143b5120 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:04.855188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecda16-1271-4819-ba8f-17aa143b5120 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:04.855466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ecda16-1271-4819-ba8f-17aa143b5120 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:04.856330 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecda16-1271-4819-ba8f-17aa143b5120 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:04.856638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecda16-1271-4819-ba8f-17aa143b5120 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:04.858066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ecda16-1271-4819-ba8f-17aa143b5120 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:04.875040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 547/1092] 10.222.0.52 () {56 vars in 1133 bytes} [Thu Jun 23 10:51:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:04.880519 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff22a00-fb6d-46c4-80e1-382fb36d5568 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:04.917792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:04.983311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff22a00-fb6d-46c4-80e1-382fb36d5568 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:05.019158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417afdc-b16b-4710-9697-35d5f0535a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:05.019858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417afdc-b16b-4710-9697-35d5f0535a34 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:05.020140 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417afdc-b16b-4710-9697-35d5f0535a34 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:05.020416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417afdc-b16b-4710-9697-35d5f0535a34 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:05.089615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417afdc-b16b-4710-9697-35d5f0535a34 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:05.091077 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417afdc-b16b-4710-9697-35d5f0535a34 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:05.123540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:05.190002 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 546/1093] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:51:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:51:05.195722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecda16-1271-4819-ba8f-17aa143b5120 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:05.295301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ecda16-1271-4819-ba8f-17aa143b5120 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:05.320153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:05.328155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f6932-fe13-478b-afbd-9271b98c6ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:05.328998 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f6932-fe13-478b-afbd-9271b98c6ff3 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:05.329279 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f6932-fe13-478b-afbd-9271b98c6ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:05.329573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95f6932-fe13-478b-afbd-9271b98c6ff3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:05.340198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f6932-fe13-478b-afbd-9271b98c6ff3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:05.341637 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95f6932-fe13-478b-afbd-9271b98c6ff3 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-f95f6932-fe13-478b-afbd-9271b98c6ff3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:51:05.360081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:05.360995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:05.366516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:51:05.366516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:51:05.366516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:51:05.366516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:51:05.366516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 548/1094] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:05.367099 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417afdc-b16b-4710-9697-35d5f0535a34 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:05.463384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417afdc-b16b-4710-9697-35d5f0535a34 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:05.496529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9a7db-11d2-4c34-ac4d-4d79f3d302e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:05.497169 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9a7db-11d2-4c34-ac4d-4d79f3d302e7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:05.497451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9a7db-11d2-4c34-ac4d-4d79f3d302e7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:05.497726 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9a7db-11d2-4c34-ac4d-4d79f3d302e7 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:05.498430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9a7db-11d2-4c34-ac4d-4d79f3d302e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:05.498733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9a7db-11d2-4c34-ac4d-4d79f3d302e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:05.500276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9a7db-11d2-4c34-ac4d-4d79f3d302e7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:05.502548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:05.515783 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 547/1095] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:05.521385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f6932-fe13-478b-afbd-9271b98c6ff3 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:05.631663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95f6932-fe13-478b-afbd-9271b98c6ff3 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:05.666556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7e1b6-d124-40b0-9c67-144f918a9e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:05.667338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7e1b6-d124-40b0-9c67-144f918a9e2e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:05.667625 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7e1b6-d124-40b0-9c67-144f918a9e2e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:05.667926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c7e1b6-d124-40b0-9c67-144f918a9e2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:05.674710 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7e1b6-d124-40b0-9c67-144f918a9e2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:05.676186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c7e1b6-d124-40b0-9c67-144f918a9e2e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-52c7e1b6-d124-40b0-9c67-144f918a9e2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:51:05.689975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:05.690873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:05.691781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:51:05.691781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:51:05.691781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:51:05.691781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:51:05.691781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:51:05.691781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:51:05.691781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:51:05.691781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:51:05.691781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 549/1096] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:51:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:05.697393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9a7db-11d2-4c34-ac4d-4d79f3d302e7 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:05.797659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9a7db-11d2-4c34-ac4d-4d79f3d302e7 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:05.830392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f351b27-5d1a-42f4-b6e6-1d403e3abc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:05.831046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f351b27-5d1a-42f4-b6e6-1d403e3abc8f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:05.831325 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f351b27-5d1a-42f4-b6e6-1d403e3abc8f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:05.831617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f351b27-5d1a-42f4-b6e6-1d403e3abc8f None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:05.832407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f351b27-5d1a-42f4-b6e6-1d403e3abc8f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:05.832717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f351b27-5d1a-42f4-b6e6-1d403e3abc8f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:05.834146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f351b27-5d1a-42f4-b6e6-1d403e3abc8f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:05.846707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 548/1097] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:51:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:05.853226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7e1b6-d124-40b0-9c67-144f918a9e2e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:05.893375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:05.954172 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c7e1b6-d124-40b0-9c67-144f918a9e2e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:05.989044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91fb379-1e40-480c-a952-afa0f32c0579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:05.989695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fb379-1e40-480c-a952-afa0f32c0579 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:05.989975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fb379-1e40-480c-a952-afa0f32c0579 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:05.990250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91fb379-1e40-480c-a952-afa0f32c0579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:05.991074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fb379-1e40-480c-a952-afa0f32c0579 None admin] RBAC: Adding query filter params (role.id=8503ee09d8864888a0153b6be38559dc, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=a020e7fe06574a108b46f9f48bddc4e4) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:05.991386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fb379-1e40-480c-a952-afa0f32c0579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:05.992886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91fb379-1e40-480c-a952-afa0f32c0579 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:05.998786 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 550/1098] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:51:05 2022] GET /identity/v3/role_assignments?user.id=a020e7fe06574a108b46f9f48bddc4e4&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=8503ee09d8864888a0153b6be38559dc => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:06.122142 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfbaa6-1f1e-4488-a975-403d92ac09c2 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.122329 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfbaa6-1f1e-4488-a975-403d92ac09c2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.122599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfbaa6-1f1e-4488-a975-403d92ac09c2 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.124322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 549/1099] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:06.129585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2087a-f78d-4d3c-a49d-383ef2990f54 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.129870 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2087a-f78d-4d3c-a49d-383ef2990f54 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.130150 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c2087a-f78d-4d3c-a49d-383ef2990f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.147768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-d8c2087a-f78d-4d3c-a49d-383ef2990f54 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:06.149010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d8c2087a-f78d-4d3c-a49d-383ef2990f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:06.215967 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 551/1100] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:06.239569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfbaa6-1f1e-4488-a975-403d92ac09c2 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:06.301255 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:06.347272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfbaa6-1f1e-4488-a975-403d92ac09c2 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:06.382310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf476c64-e24a-442f-8665-2ca920db1938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:06.383055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf476c64-e24a-442f-8665-2ca920db1938 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.383336 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf476c64-e24a-442f-8665-2ca920db1938 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.383604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf476c64-e24a-442f-8665-2ca920db1938 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.394032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf476c64-e24a-442f-8665-2ca920db1938 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-cf476c64-e24a-442f-8665-2ca920db1938 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:51:06.402493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:06.403474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:06.404711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 550/1101] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:51:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:06.409465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2087a-f78d-4d3c-a49d-383ef2990f54 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:06.446588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:06.518805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c2087a-f78d-4d3c-a49d-383ef2990f54 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:06.554699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab78a16-d2d0-4b43-90e6-620b141e278e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:06.555379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab78a16-d2d0-4b43-90e6-620b141e278e None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.555670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab78a16-d2d0-4b43-90e6-620b141e278e None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.556007 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab78a16-d2d0-4b43-90e6-620b141e278e None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.556752 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab78a16-d2d0-4b43-90e6-620b141e278e None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:06.557063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab78a16-d2d0-4b43-90e6-620b141e278e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:06.558443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab78a16-d2d0-4b43-90e6-620b141e278e None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:06.567136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 552/1102] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:51:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:06.574029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf476c64-e24a-442f-8665-2ca920db1938 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:06.682343 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf476c64-e24a-442f-8665-2ca920db1938 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:06.699936 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:06.717776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc1e95-7baf-4f60-b93f-2bc54a3bfe7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:06.718816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc1e95-7baf-4f60-b93f-2bc54a3bfe7e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.719100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc1e95-7baf-4f60-b93f-2bc54a3bfe7e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.719375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecc1e95-7baf-4f60-b93f-2bc54a3bfe7e None admin] PATH_INFO: `/v3/users/007925a53f0b43739d3cff9a77bd71ca` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.720611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc1e95-7baf-4f60-b93f-2bc54a3bfe7e None admin] RBAC: Authorizing `identity:get_user(user_id=007925a53f0b43739d3cff9a77bd71ca)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:06.722778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cecc1e95-7baf-4f60-b93f-2bc54a3bfe7e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:06.725635 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 551/1103] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:06 2022] GET /identity/v3/users/007925a53f0b43739d3cff9a77bd71ca => generated 285 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:06.730671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab78a16-d2d0-4b43-90e6-620b141e278e None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:06.828620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:06.836031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab78a16-d2d0-4b43-90e6-620b141e278e None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:06.872534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bece751-7030-4e6e-b013-c37e33e43e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:06.873193 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bece751-7030-4e6e-b013-c37e33e43e0b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:06.873478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bece751-7030-4e6e-b013-c37e33e43e0b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:06.873758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bece751-7030-4e6e-b013-c37e33e43e0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:06.940100 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bece751-7030-4e6e-b013-c37e33e43e0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:06.941484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bece751-7030-4e6e-b013-c37e33e43e0b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:07.031584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:07.038661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 553/1104] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:51:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:51:07.044575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc1e95-7baf-4f60-b93f-2bc54a3bfe7e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:07.144178 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecc1e95-7baf-4f60-b93f-2bc54a3bfe7e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:07.177001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba33b212-214e-4d39-b903-88e26bf8dd57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:07.177848 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33b212-214e-4d39-b903-88e26bf8dd57 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:07.178131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33b212-214e-4d39-b903-88e26bf8dd57 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:07.178409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba33b212-214e-4d39-b903-88e26bf8dd57 None admin] PATH_INFO: `/v3/projects/b27bb6c229454c02b452ff114a7fa105` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:07.180142 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33b212-214e-4d39-b903-88e26bf8dd57 None admin] RBAC: Authorizing `identity:get_project(project_id=b27bb6c229454c02b452ff114a7fa105)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:07.181696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba33b212-214e-4d39-b903-88e26bf8dd57 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:07.183294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 552/1105] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:51:07 2022] GET /identity/v3/projects/b27bb6c229454c02b452ff114a7fa105 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:51:07.189511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bece751-7030-4e6e-b013-c37e33e43e0b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:07.289865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bece751-7030-4e6e-b013-c37e33e43e0b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:07.322877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401f2791-cf24-4c8d-8061-6ed606c3be10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:07.323523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f2791-cf24-4c8d-8061-6ed606c3be10 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:07.323840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f2791-cf24-4c8d-8061-6ed606c3be10 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:07.324115 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401f2791-cf24-4c8d-8061-6ed606c3be10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:07.324937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f2791-cf24-4c8d-8061-6ed606c3be10 None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=b27bb6c229454c02b452ff114a7fa105, user.id=007925a53f0b43739d3cff9a77bd71ca) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:07.325247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f2791-cf24-4c8d-8061-6ed606c3be10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:07.326676 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401f2791-cf24-4c8d-8061-6ed606c3be10 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:07.332468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 554/1106] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:51:07 2022] GET /identity/v3/role_assignments?user.id=007925a53f0b43739d3cff9a77bd71ca&scope.project.id=b27bb6c229454c02b452ff114a7fa105&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:09.362327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166aadf-8a5a-4206-bab3-cc401e1b8f04 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:09.362899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166aadf-8a5a-4206-bab3-cc401e1b8f04 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:09.362899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166aadf-8a5a-4206-bab3-cc401e1b8f04 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:09.364301 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 553/1107] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:09.371356 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a4d7a-9b69-43ca-8fab-b66121763709 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:09.372028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a4d7a-9b69-43ca-8fab-b66121763709 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:09.372028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7a4d7a-9b69-43ca-8fab-b66121763709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:09.388968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-9c7a4d7a-9b69-43ca-8fab-b66121763709 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:09.390167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9c7a4d7a-9b69-43ca-8fab-b66121763709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:09.443949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:09.457448 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 555/1108] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:09.482753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166aadf-8a5a-4206-bab3-cc401e1b8f04 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:09.536477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:09.594649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166aadf-8a5a-4206-bab3-cc401e1b8f04 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:09.628263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fff8cb-bd27-4a76-8d2c-9a6228166b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:09.628975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fff8cb-bd27-4a76-8d2c-9a6228166b8d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:09.629261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fff8cb-bd27-4a76-8d2c-9a6228166b8d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:09.629539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fff8cb-bd27-4a76-8d2c-9a6228166b8d None admin] PATH_INFO: `/v3/domains/default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:09.630716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fff8cb-bd27-4a76-8d2c-9a6228166b8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:09.632811 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fff8cb-bd27-4a76-8d2c-9a6228166b8d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:09.634433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 554/1109] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:51:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:09.640327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a4d7a-9b69-43ca-8fab-b66121763709 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:09.735342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7a4d7a-9b69-43ca-8fab-b66121763709 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:09.770093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b756d6-7886-4680-94dd-d14f41dc0901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:09.770798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b756d6-7886-4680-94dd-d14f41dc0901 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:09.771085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b756d6-7886-4680-94dd-d14f41dc0901 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:09.771361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b756d6-7886-4680-94dd-d14f41dc0901 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:09.772096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b756d6-7886-4680-94dd-d14f41dc0901 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:09.774043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b756d6-7886-4680-94dd-d14f41dc0901 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:09.882546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 556/1110] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:51:09 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:11.945379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6d291-8569-43fe-837a-0631ebaf6a64 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.945899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6d291-8569-43fe-837a-0631ebaf6a64 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.945899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a6d291-8569-43fe-837a-0631ebaf6a64 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.947199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 555/1111] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:11.952436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faebcb-0870-4c77-87cb-ffa1a896d9a7 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:11.952842 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faebcb-0870-4c77-87cb-ffa1a896d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:11.953004 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8faebcb-0870-4c77-87cb-ffa1a896d9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:11.970043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-f8faebcb-0870-4c77-87cb-ffa1a896d9a7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:11.971232 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f8faebcb-0870-4c77-87cb-ffa1a896d9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:12.010087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:12.036421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 557/1112] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:12.060010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6d291-8569-43fe-837a-0631ebaf6a64 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:12.157548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a6d291-8569-43fe-837a-0631ebaf6a64 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:12.176689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:12.190679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ec718-43de-4e1c-9799-246b7b77ddd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:12.191516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ec718-43de-4e1c-9799-246b7b77ddd4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:12.191796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ec718-43de-4e1c-9799-246b7b77ddd4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:12.192097 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ec718-43de-4e1c-9799-246b7b77ddd4 None admin] PATH_INFO: `/v3/roles/d7474d28a1f24780a0b4c715fdff50b1` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:12.193545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ec718-43de-4e1c-9799-246b7b77ddd4 None admin] RBAC: Authorizing `identity:get_role(role_id=d7474d28a1f24780a0b4c715fdff50b1)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:12.195687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ec718-43de-4e1c-9799-246b7b77ddd4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:12.197086 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 556/1113] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:12 2022] GET /identity/v3/roles/d7474d28a1f24780a0b4c715fdff50b1 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:12.203298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faebcb-0870-4c77-87cb-ffa1a896d9a7 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:12.299517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8faebcb-0870-4c77-87cb-ffa1a896d9a7 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:12.332979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdb580-81a3-49b3-9f0e-39d18b8f03b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:12.333830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdb580-81a3-49b3-9f0e-39d18b8f03b3 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:12.334110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdb580-81a3-49b3-9f0e-39d18b8f03b3 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:12.334382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfdb580-81a3-49b3-9f0e-39d18b8f03b3 None admin] PATH_INFO: `/v3/users/45ed4339169249f7bad6987b8f2fab83` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:12.347190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdb580-81a3-49b3-9f0e-39d18b8f03b3 None admin] RBAC: Authorizing `identity:get_user(user_id=45ed4339169249f7bad6987b8f2fab83)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:12.348655 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfdb580-81a3-49b3-9f0e-39d18b8f03b3 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:12.350298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 558/1114] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:12 2022] GET /identity/v3/users/45ed4339169249f7bad6987b8f2fab83 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:12.356085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ec718-43de-4e1c-9799-246b7b77ddd4 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:12.454829 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ec718-43de-4e1c-9799-246b7b77ddd4 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:12.487678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c332391-e4fc-48ea-9d99-8dea52d9b62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:12.488344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c332391-e4fc-48ea-9d99-8dea52d9b62b None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:12.488630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c332391-e4fc-48ea-9d99-8dea52d9b62b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:12.488909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c332391-e4fc-48ea-9d99-8dea52d9b62b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:12.542409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:12.555247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c332391-e4fc-48ea-9d99-8dea52d9b62b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:12.556745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c332391-e4fc-48ea-9d99-8dea52d9b62b None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:12.654420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 557/1115] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:51:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:51:12.660305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdb580-81a3-49b3-9f0e-39d18b8f03b3 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:12.691755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:12.758833 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfdb580-81a3-49b3-9f0e-39d18b8f03b3 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:12.793276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78483d88-8726-4126-a892-a9377d2a0bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:12.794131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78483d88-8726-4126-a892-a9377d2a0bbb None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:12.794415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78483d88-8726-4126-a892-a9377d2a0bbb None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:12.794698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78483d88-8726-4126-a892-a9377d2a0bbb None admin] PATH_INFO: `/v3/projects/b27bb6c229454c02b452ff114a7fa105` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:12.795964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78483d88-8726-4126-a892-a9377d2a0bbb None admin] RBAC: Authorizing `identity:get_project(project_id=b27bb6c229454c02b452ff114a7fa105)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:12.797401 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78483d88-8726-4126-a892-a9377d2a0bbb None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:12.799103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 559/1116] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:51:12 2022] GET /identity/v3/projects/b27bb6c229454c02b452ff114a7fa105 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:12.805343 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c332391-e4fc-48ea-9d99-8dea52d9b62b None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:12.891709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:12.904124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c332391-e4fc-48ea-9d99-8dea52d9b62b None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:12.937016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b482922a-29bd-4438-abad-204855cd91c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:12.937658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482922a-29bd-4438-abad-204855cd91c4 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:12.937942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482922a-29bd-4438-abad-204855cd91c4 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:12.938217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b482922a-29bd-4438-abad-204855cd91c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:12.939030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482922a-29bd-4438-abad-204855cd91c4 None admin] RBAC: Adding query filter params (role.id=d7474d28a1f24780a0b4c715fdff50b1, scope.project.id=b27bb6c229454c02b452ff114a7fa105, user.id=45ed4339169249f7bad6987b8f2fab83) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:12.939335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482922a-29bd-4438-abad-204855cd91c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:12.940791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b482922a-29bd-4438-abad-204855cd91c4 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:12.946087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 558/1117] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:51:12 2022] GET /identity/v3/role_assignments?user.id=45ed4339169249f7bad6987b8f2fab83&scope.project.id=b27bb6c229454c02b452ff114a7fa105&role.id=d7474d28a1f24780a0b4c715fdff50b1 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:14.956261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b548e-9550-4c75-a99a-0dcb2a183ef9 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.956821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b548e-9550-4c75-a99a-0dcb2a183ef9 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.956821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826b548e-9550-4c75-a99a-0dcb2a183ef9 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.958196 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 560/1118] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:14.963602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c73edc-93b6-41a5-8f22-ba5e420bdee5 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:14.964089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c73edc-93b6-41a5-8f22-ba5e420bdee5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:14.964182 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c73edc-93b6-41a5-8f22-ba5e420bdee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:14.981600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-45c73edc-93b6-41a5-8f22-ba5e420bdee5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:14.982808 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-45c73edc-93b6-41a5-8f22-ba5e420bdee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:15.048926 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 559/1119] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:15.071448 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b548e-9550-4c75-a99a-0dcb2a183ef9 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.167019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:15.170638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826b548e-9550-4c75-a99a-0dcb2a183ef9 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:15.203589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43dc90-ffd2-4760-977f-40cbbf792197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:15.204468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43dc90-ffd2-4760-977f-40cbbf792197 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.204753 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43dc90-ffd2-4760-977f-40cbbf792197 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.205032 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec43dc90-ffd2-4760-977f-40cbbf792197 None admin] PATH_INFO: `/v3/roles/d7474d28a1f24780a0b4c715fdff50b1` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.206566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43dc90-ffd2-4760-977f-40cbbf792197 None admin] RBAC: Authorizing `identity:get_role(role_id=d7474d28a1f24780a0b4c715fdff50b1)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:15.207910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec43dc90-ffd2-4760-977f-40cbbf792197 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:15.209276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 561/1120] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:15 2022] GET /identity/v3/roles/d7474d28a1f24780a0b4c715fdff50b1 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:15.215761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c73edc-93b6-41a5-8f22-ba5e420bdee5 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.305940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:15.323270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c73edc-93b6-41a5-8f22-ba5e420bdee5 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:15.357767 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf33da-7354-4414-902c-3b100d371f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:15.358621 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf33da-7354-4414-902c-3b100d371f13 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.358905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf33da-7354-4414-902c-3b100d371f13 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.359176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf33da-7354-4414-902c-3b100d371f13 None admin] PATH_INFO: `/v3/users/45ed4339169249f7bad6987b8f2fab83` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.360386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf33da-7354-4414-902c-3b100d371f13 None admin] RBAC: Authorizing `identity:get_user(user_id=45ed4339169249f7bad6987b8f2fab83)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:15.361813 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bf33da-7354-4414-902c-3b100d371f13 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:15.363436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 560/1121] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:15 2022] GET /identity/v3/users/45ed4339169249f7bad6987b8f2fab83 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:15.369408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43dc90-ffd2-4760-977f-40cbbf792197 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.468739 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec43dc90-ffd2-4760-977f-40cbbf792197 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:15.501431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22924f78-f5e1-4212-8e2c-9b011828176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:15.502279 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22924f78-f5e1-4212-8e2c-9b011828176d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.502565 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22924f78-f5e1-4212-8e2c-9b011828176d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.502846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22924f78-f5e1-4212-8e2c-9b011828176d None admin] PATH_INFO: `/v3/projects/b27bb6c229454c02b452ff114a7fa105` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.504051 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22924f78-f5e1-4212-8e2c-9b011828176d None admin] RBAC: Authorizing `identity:get_project(project_id=b27bb6c229454c02b452ff114a7fa105)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:15.505494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22924f78-f5e1-4212-8e2c-9b011828176d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:15.508051 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 562/1122] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:51:15 2022] GET /identity/v3/projects/b27bb6c229454c02b452ff114a7fa105 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:15.514064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf33da-7354-4414-902c-3b100d371f13 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:15.622948 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf33da-7354-4414-902c-3b100d371f13 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:15.656960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd8fa4-cd4a-419b-ac3e-0bf8eccfd386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:15.657842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd8fa4-cd4a-419b-ac3e-0bf8eccfd386 None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:15.658126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd8fa4-cd4a-419b-ac3e-0bf8eccfd386 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:15.658403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd8fa4-cd4a-419b-ac3e-0bf8eccfd386 None admin] PATH_INFO: `/v3/projects/b27bb6c229454c02b452ff114a7fa105/users/45ed4339169249f7bad6987b8f2fab83/roles/d7474d28a1f24780a0b4c715fdff50b1` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:15.660610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd8fa4-cd4a-419b-ac3e-0bf8eccfd386 None admin] RBAC: Authorizing `identity:create_grant(project_id=b27bb6c229454c02b452ff114a7fa105, user_id=45ed4339169249f7bad6987b8f2fab83, role_id=d7474d28a1f24780a0b4c715fdff50b1)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:15.662055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd8fa4-cd4a-419b-ac3e-0bf8eccfd386 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:15.744873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 561/1123] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:51:15 2022] PUT /identity/v3/projects/b27bb6c229454c02b452ff114a7fa105/users/45ed4339169249f7bad6987b8f2fab83/roles/d7474d28a1f24780a0b4c715fdff50b1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:17.780933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdca9e0-4338-453a-a610-fbff52b1e326 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:17.781500 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdca9e0-4338-453a-a610-fbff52b1e326 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:17.781500 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdca9e0-4338-453a-a610-fbff52b1e326 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:17.782858 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 563/1124] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:17.788516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d14fb-4fd8-43ac-a918-29318cce87e0 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:17.788950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d14fb-4fd8-43ac-a918-29318cce87e0 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:17.789076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4d14fb-4fd8-43ac-a918-29318cce87e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:17.806199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-df4d14fb-4fd8-43ac-a918-29318cce87e0 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:17.807391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-df4d14fb-4fd8-43ac-a918-29318cce87e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:17.810186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:17.872756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 562/1125] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:17.896331 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdca9e0-4338-453a-a610-fbff52b1e326 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:17.932886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:17.997383 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdca9e0-4338-453a-a610-fbff52b1e326 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:18.030458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61ff92-e344-49f6-a29e-e3e57621d902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:18.031293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61ff92-e344-49f6-a29e-e3e57621d902 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:18.031574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61ff92-e344-49f6-a29e-e3e57621d902 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:18.031869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f61ff92-e344-49f6-a29e-e3e57621d902 None admin] PATH_INFO: `/v3/roles/d7474d28a1f24780a0b4c715fdff50b1` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:18.033319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61ff92-e344-49f6-a29e-e3e57621d902 None admin] RBAC: Authorizing `identity:get_role(role_id=d7474d28a1f24780a0b4c715fdff50b1)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:18.034682 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f61ff92-e344-49f6-a29e-e3e57621d902 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:18.036069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 564/1126] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:17 2022] GET /identity/v3/roles/d7474d28a1f24780a0b4c715fdff50b1 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:18.042482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d14fb-4fd8-43ac-a918-29318cce87e0 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:18.139150 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4d14fb-4fd8-43ac-a918-29318cce87e0 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:18.173226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0073-efbd-406f-8a51-5f3884875bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:18.174074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0073-efbd-406f-8a51-5f3884875bd0 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:18.174354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0073-efbd-406f-8a51-5f3884875bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:18.174627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010d0073-efbd-406f-8a51-5f3884875bd0 None admin] PATH_INFO: `/v3/users/45ed4339169249f7bad6987b8f2fab83` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:18.175841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0073-efbd-406f-8a51-5f3884875bd0 None admin] RBAC: Authorizing `identity:get_user(user_id=45ed4339169249f7bad6987b8f2fab83)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:18.177281 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010d0073-efbd-406f-8a51-5f3884875bd0 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:18.178929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 563/1127] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:18 2022] GET /identity/v3/users/45ed4339169249f7bad6987b8f2fab83 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:18.184859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61ff92-e344-49f6-a29e-e3e57621d902 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:18.282415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f61ff92-e344-49f6-a29e-e3e57621d902 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:18.284795 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:18.318467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc16bb-3956-473f-8621-0d828ad4689a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:18.318834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc16bb-3956-473f-8621-0d828ad4689a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:18.319145 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc16bb-3956-473f-8621-0d828ad4689a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:18.319423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc16bb-3956-473f-8621-0d828ad4689a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:18.386415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc16bb-3956-473f-8621-0d828ad4689a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:18.387916 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc16bb-3956-473f-8621-0d828ad4689a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:18.486186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 565/1128] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:51:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 10:51:18.492450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0073-efbd-406f-8a51-5f3884875bd0 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:18.502957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:18.604726 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010d0073-efbd-406f-8a51-5f3884875bd0 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:18.641397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f268c1-50d8-4548-a3eb-af9b000fe58e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:18.642247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f268c1-50d8-4548-a3eb-af9b000fe58e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:18.642528 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f268c1-50d8-4548-a3eb-af9b000fe58e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:18.642799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f268c1-50d8-4548-a3eb-af9b000fe58e None admin] PATH_INFO: `/v3/projects/b27bb6c229454c02b452ff114a7fa105` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:18.644002 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f268c1-50d8-4548-a3eb-af9b000fe58e None admin] RBAC: Authorizing `identity:get_project(project_id=b27bb6c229454c02b452ff114a7fa105)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:18.645431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f268c1-50d8-4548-a3eb-af9b000fe58e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:18.647111 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 564/1129] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:51:18 2022] GET /identity/v3/projects/b27bb6c229454c02b452ff114a7fa105 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:18.654572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc16bb-3956-473f-8621-0d828ad4689a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:18.657694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:18.753395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc16bb-3956-473f-8621-0d828ad4689a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:18.786951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3fa2c-6096-4daa-a178-6dd644c85ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:18.787592 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3fa2c-6096-4daa-a178-6dd644c85ee7 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:18.787920 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3fa2c-6096-4daa-a178-6dd644c85ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:18.788199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3fa2c-6096-4daa-a178-6dd644c85ee7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:18.789014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3fa2c-6096-4daa-a178-6dd644c85ee7 None admin] RBAC: Adding query filter params (role.id=d7474d28a1f24780a0b4c715fdff50b1, scope.project.id=b27bb6c229454c02b452ff114a7fa105, user.id=45ed4339169249f7bad6987b8f2fab83) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:18.789322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3fa2c-6096-4daa-a178-6dd644c85ee7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:18.790736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3fa2c-6096-4daa-a178-6dd644c85ee7 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:18.796406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 566/1130] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:51:18 2022] GET /identity/v3/role_assignments?user.id=45ed4339169249f7bad6987b8f2fab83&scope.project.id=b27bb6c229454c02b452ff114a7fa105&role.id=d7474d28a1f24780a0b4c715fdff50b1 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:20.846265 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2a271-d1d3-458b-91db-cd57bf012526 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:20.847048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2a271-d1d3-458b-91db-cd57bf012526 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:20.847048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f2a271-d1d3-458b-91db-cd57bf012526 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:20.848379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 565/1131] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:20.853677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b403e2-ad8d-422a-8c4e-9972df93f1a1 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:20.854066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b403e2-ad8d-422a-8c4e-9972df93f1a1 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:20.854232 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b403e2-ad8d-422a-8c4e-9972df93f1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:20.870729 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-35b403e2-ad8d-422a-8c4e-9972df93f1a1 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:20.871957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-35b403e2-ad8d-422a-8c4e-9972df93f1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:20.932367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:20.937731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 567/1132] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:51:20.962667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2a271-d1d3-458b-91db-cd57bf012526 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:21.040813 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:21.066482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f2a271-d1d3-458b-91db-cd57bf012526 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:21.101551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794505b5-3cf9-41e0-a75a-02cf7be1a7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:21.102249 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794505b5-3cf9-41e0-a75a-02cf7be1a7d7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:21.102531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794505b5-3cf9-41e0-a75a-02cf7be1a7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:21.102806 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794505b5-3cf9-41e0-a75a-02cf7be1a7d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:21.104010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794505b5-3cf9-41e0-a75a-02cf7be1a7d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:21.105447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794505b5-3cf9-41e0-a75a-02cf7be1a7d7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:21.107074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 566/1133] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:51:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:21.112945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b403e2-ad8d-422a-8c4e-9972df93f1a1 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:21.210704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b403e2-ad8d-422a-8c4e-9972df93f1a1 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:21.245098 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a9470-6a0f-403f-8940-43fa7021ab94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:21.245754 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9470-6a0f-403f-8940-43fa7021ab94 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:21.246040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9470-6a0f-403f-8940-43fa7021ab94 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:21.246322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9470-6a0f-403f-8940-43fa7021ab94 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:21.247036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a9470-6a0f-403f-8940-43fa7021ab94 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:21.248509 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a9470-6a0f-403f-8940-43fa7021ab94 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:21.363278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 568/1134] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:51:21 2022] POST /identity/v3/projects => generated 311 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:23.450876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55c5b3-e90d-4cb6-a6f3-6b106b83de18 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:23.451405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55c5b3-e90d-4cb6-a6f3-6b106b83de18 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:23.451530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55c5b3-e90d-4cb6-a6f3-6b106b83de18 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:23.452836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 567/1135] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:23.458009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3b88-1f23-4e05-9680-a4c66f38bc43 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:23.458412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3b88-1f23-4e05-9680-a4c66f38bc43 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:23.458563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd3b88-1f23-4e05-9680-a4c66f38bc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:23.476578 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-24dd3b88-1f23-4e05-9680-a4c66f38bc43 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:23.477771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-24dd3b88-1f23-4e05-9680-a4c66f38bc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:23.523770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:23.545088 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 569/1136] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:23.569987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55c5b3-e90d-4cb6-a6f3-6b106b83de18 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:23.687738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55c5b3-e90d-4cb6-a6f3-6b106b83de18 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:23.722481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db7223f-126a-467e-a52c-ec748613eeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:23.723264 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7223f-126a-467e-a52c-ec748613eeec None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:23.723542 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7223f-126a-467e-a52c-ec748613eeec None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:23.723838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7223f-126a-467e-a52c-ec748613eeec None admin] PATH_INFO: `/v3/domains/default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:23.725038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7223f-126a-467e-a52c-ec748613eeec None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:23.726532 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db7223f-126a-467e-a52c-ec748613eeec None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:23.728183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 568/1137] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:51:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:23.734011 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3b88-1f23-4e05-9680-a4c66f38bc43 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:23.830077 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd3b88-1f23-4e05-9680-a4c66f38bc43 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:23.863279 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5701ed-0f50-4a88-be7f-4c13131bfae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:23.863964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5701ed-0f50-4a88-be7f-4c13131bfae0 None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:23.864254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5701ed-0f50-4a88-be7f-4c13131bfae0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:23.864528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5701ed-0f50-4a88-be7f-4c13131bfae0 None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:23.865229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5701ed-0f50-4a88-be7f-4c13131bfae0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:23.866699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5701ed-0f50-4a88-be7f-4c13131bfae0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:23.968254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 570/1138] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:51:23 2022] POST /identity/v3/users => generated 286 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:26.050404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa1b7e-8e38-48a3-8239-e28916c782d6 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:26.050932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa1b7e-8e38-48a3-8239-e28916c782d6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:26.050932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfa1b7e-8e38-48a3-8239-e28916c782d6 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:26.052324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 569/1139] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:26.057430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7be49-af96-4ed3-afe3-d54dd0f4c9a9 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:26.057841 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7be49-af96-4ed3-afe3-d54dd0f4c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:26.057987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7be49-af96-4ed3-afe3-d54dd0f4c9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:26.075016 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-c8e7be49-af96-4ed3-afe3-d54dd0f4c9a9 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:26.076239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c8e7be49-af96-4ed3-afe3-d54dd0f4c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:26.104780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:26.142146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 571/1140] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:26.166238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa1b7e-8e38-48a3-8239-e28916c782d6 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:26.180925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:26.267126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfa1b7e-8e38-48a3-8239-e28916c782d6 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:26.300718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e9e5f-7fd3-48e6-99a8-673b14788be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:26.301429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e9e5f-7fd3-48e6-99a8-673b14788be9 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:26.301713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e9e5f-7fd3-48e6-99a8-673b14788be9 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:26.301992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e9e5f-7fd3-48e6-99a8-673b14788be9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:26.312557 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e9e5f-7fd3-48e6-99a8-673b14788be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-252e9e5f-7fd3-48e6-99a8-673b14788be9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:51:26.320704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:26.321800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:26.322672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 570/1141] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:51:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:26.328023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7be49-af96-4ed3-afe3-d54dd0f4c9a9 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:26.422741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7be49-af96-4ed3-afe3-d54dd0f4c9a9 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:26.456372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e1661-0193-4133-921d-5ce80c968a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:26.457021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e1661-0193-4133-921d-5ce80c968a22 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:26.457301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e1661-0193-4133-921d-5ce80c968a22 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:26.457581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178e1661-0193-4133-921d-5ce80c968a22 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:26.458317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e1661-0193-4133-921d-5ce80c968a22 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:26.458617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e1661-0193-4133-921d-5ce80c968a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:26.460003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178e1661-0193-4133-921d-5ce80c968a22 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:26.467862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 572/1142] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:51:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:26.473875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e9e5f-7fd3-48e6-99a8-673b14788be9 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:26.542518 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:26.572709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e9e5f-7fd3-48e6-99a8-673b14788be9 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:26.606310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e8e07-416d-498f-8cb3-393def261706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:26.607174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e8e07-416d-498f-8cb3-393def261706 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:26.607460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e8e07-416d-498f-8cb3-393def261706 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:26.607739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e8e07-416d-498f-8cb3-393def261706 None admin] PATH_INFO: `/v3/users/208ef173bf024e9ba7a9565ce1907610` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:26.621313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e8e07-416d-498f-8cb3-393def261706 None admin] RBAC: Authorizing `identity:get_user(user_id=208ef173bf024e9ba7a9565ce1907610)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:26.622767 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e8e07-416d-498f-8cb3-393def261706 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:26.624600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 571/1143] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:26 2022] GET /identity/v3/users/208ef173bf024e9ba7a9565ce1907610 => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:26.630429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e1661-0193-4133-921d-5ce80c968a22 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:26.659252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:26.731307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178e1661-0193-4133-921d-5ce80c968a22 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:26.764221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c02123-96fe-4ced-a415-f71ac89b1c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:26.764866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c02123-96fe-4ced-a415-f71ac89b1c59 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:26.765150 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c02123-96fe-4ced-a415-f71ac89b1c59 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:26.765430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c02123-96fe-4ced-a415-f71ac89b1c59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:26.830960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c02123-96fe-4ced-a415-f71ac89b1c59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:26.832385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c02123-96fe-4ced-a415-f71ac89b1c59 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:26.859496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:26.929975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 573/1144] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:51:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:51:26.935852 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e8e07-416d-498f-8cb3-393def261706 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:27.033073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e8e07-416d-498f-8cb3-393def261706 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:27.060601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:27.066147 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dedae2-fe19-49a2-b7f6-6c28680c3554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:27.067019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dedae2-fe19-49a2-b7f6-6c28680c3554 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:27.067302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dedae2-fe19-49a2-b7f6-6c28680c3554 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:27.072648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dedae2-fe19-49a2-b7f6-6c28680c3554 None admin] PATH_INFO: `/v3/projects/bcc5fe12cfe744f4aff619dd6b8b4ff6` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:27.072648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dedae2-fe19-49a2-b7f6-6c28680c3554 None admin] RBAC: Authorizing `identity:get_project(project_id=bcc5fe12cfe744f4aff619dd6b8b4ff6)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:27.072648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35dedae2-fe19-49a2-b7f6-6c28680c3554 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:27.072648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 572/1145] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:51:26 2022] GET /identity/v3/projects/bcc5fe12cfe744f4aff619dd6b8b4ff6 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:27.078058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c02123-96fe-4ced-a415-f71ac89b1c59 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:27.175946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c02123-96fe-4ced-a415-f71ac89b1c59 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:27.201790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:27.210028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb6bf67-8a4d-4163-8b3b-3c30c4eb29a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:27.210679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6bf67-8a4d-4163-8b3b-3c30c4eb29a7 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:27.215422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6bf67-8a4d-4163-8b3b-3c30c4eb29a7 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:27.215422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb6bf67-8a4d-4163-8b3b-3c30c4eb29a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:27.215422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6bf67-8a4d-4163-8b3b-3c30c4eb29a7 None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=bcc5fe12cfe744f4aff619dd6b8b4ff6, user.id=208ef173bf024e9ba7a9565ce1907610) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:27.215422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6bf67-8a4d-4163-8b3b-3c30c4eb29a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:27.215422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb6bf67-8a4d-4163-8b3b-3c30c4eb29a7 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:27.219408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 574/1146] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:51:27 2022] GET /identity/v3/role_assignments?user.id=208ef173bf024e9ba7a9565ce1907610&scope.project.id=bcc5fe12cfe744f4aff619dd6b8b4ff6&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:29.212864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e903c29-873f-42fe-9efb-81ab7aa59358 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.213504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e903c29-873f-42fe-9efb-81ab7aa59358 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.213504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e903c29-873f-42fe-9efb-81ab7aa59358 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.214779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 573/1147] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:29.219977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f77f8-d7bf-4740-9e7f-d65e9ba65d61 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.220428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f77f8-d7bf-4740-9e7f-d65e9ba65d61 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.220563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79f77f8-d7bf-4740-9e7f-d65e9ba65d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.237745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-d79f77f8-d7bf-4740-9e7f-d65e9ba65d61 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:29.238927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d79f77f8-d7bf-4740-9e7f-d65e9ba65d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:29.305033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 575/1148] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:29.327514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e903c29-873f-42fe-9efb-81ab7aa59358 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:29.428205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e903c29-873f-42fe-9efb-81ab7aa59358 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:29.461437 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18924d58-8ea9-4c1f-90f6-be0777ab7647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:29.462210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18924d58-8ea9-4c1f-90f6-be0777ab7647 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.462495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18924d58-8ea9-4c1f-90f6-be0777ab7647 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.462777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18924d58-8ea9-4c1f-90f6-be0777ab7647 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.473284 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18924d58-8ea9-4c1f-90f6-be0777ab7647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-18924d58-8ea9-4c1f-90f6-be0777ab7647 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:51:29.481357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:29.482604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:29.483800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 574/1149] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:51:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:29.488879 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f77f8-d7bf-4740-9e7f-d65e9ba65d61 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:29.590498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79f77f8-d7bf-4740-9e7f-d65e9ba65d61 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:29.613564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:29.625424 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f6e5c-bfa9-459e-a643-f3328db99456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:29.626697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f6e5c-bfa9-459e-a643-f3328db99456 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.626697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f6e5c-bfa9-459e-a643-f3328db99456 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.626697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9f6e5c-bfa9-459e-a643-f3328db99456 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.627391 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f6e5c-bfa9-459e-a643-f3328db99456 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:29.627700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f6e5c-bfa9-459e-a643-f3328db99456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:29.629195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9f6e5c-bfa9-459e-a643-f3328db99456 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:29.637818 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 576/1150] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:51:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:29.643619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18924d58-8ea9-4c1f-90f6-be0777ab7647 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:29.701708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:29.743404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18924d58-8ea9-4c1f-90f6-be0777ab7647 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:29.778430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf3769-da9d-4994-a755-64528a85bd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:29.779295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf3769-da9d-4994-a755-64528a85bd80 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.779577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf3769-da9d-4994-a755-64528a85bd80 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.779874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf3769-da9d-4994-a755-64528a85bd80 None admin] PATH_INFO: `/v3/users/208ef173bf024e9ba7a9565ce1907610` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.781049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf3769-da9d-4994-a755-64528a85bd80 None admin] RBAC: Authorizing `identity:get_user(user_id=208ef173bf024e9ba7a9565ce1907610)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:29.782485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf3769-da9d-4994-a755-64528a85bd80 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:29.784136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 575/1151] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:29 2022] GET /identity/v3/users/208ef173bf024e9ba7a9565ce1907610 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:29.789911 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f6e5c-bfa9-459e-a643-f3328db99456 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:29.891238 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9f6e5c-bfa9-459e-a643-f3328db99456 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:29.924885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5133372-26c0-4572-a6ae-414859a8699c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:29.925743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133372-26c0-4572-a6ae-414859a8699c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:29.926027 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133372-26c0-4572-a6ae-414859a8699c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:29.926301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5133372-26c0-4572-a6ae-414859a8699c None admin] PATH_INFO: `/v3/projects/bcc5fe12cfe744f4aff619dd6b8b4ff6` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:29.927469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5133372-26c0-4572-a6ae-414859a8699c None admin] RBAC: Authorizing `identity:get_project(project_id=bcc5fe12cfe744f4aff619dd6b8b4ff6)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:29.928977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5133372-26c0-4572-a6ae-414859a8699c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:29.930670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 577/1152] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:51:29 2022] GET /identity/v3/projects/bcc5fe12cfe744f4aff619dd6b8b4ff6 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:51:29.936574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf3769-da9d-4994-a755-64528a85bd80 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:30.034967 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf3769-da9d-4994-a755-64528a85bd80 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:30.059490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:30.068038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658eab24-16c4-4a97-8067-c347caa5ca0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:30.072597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658eab24-16c4-4a97-8067-c347caa5ca0e None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:30.072597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658eab24-16c4-4a97-8067-c347caa5ca0e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:30.072597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658eab24-16c4-4a97-8067-c347caa5ca0e None admin] PATH_INFO: `/v3/projects/bcc5fe12cfe744f4aff619dd6b8b4ff6/users/208ef173bf024e9ba7a9565ce1907610/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:30.072597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658eab24-16c4-4a97-8067-c347caa5ca0e None admin] RBAC: Authorizing `identity:create_grant(project_id=bcc5fe12cfe744f4aff619dd6b8b4ff6, user_id=208ef173bf024e9ba7a9565ce1907610, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:30.073419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658eab24-16c4-4a97-8067-c347caa5ca0e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:30.155211 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 576/1153] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:51:29 2022] PUT /identity/v3/projects/bcc5fe12cfe744f4aff619dd6b8b4ff6/users/208ef173bf024e9ba7a9565ce1907610/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:32.207729 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbf4d6-7511-4e26-95e5-e701584257fd None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:32.208303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbf4d6-7511-4e26-95e5-e701584257fd None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:32.208303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbbf4d6-7511-4e26-95e5-e701584257fd None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:32.210343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 578/1154] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:32.215461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84c0db-8abb-46e9-b89d-aee98bc56e04 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:32.215869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84c0db-8abb-46e9-b89d-aee98bc56e04 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:32.216051 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d84c0db-8abb-46e9-b89d-aee98bc56e04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:32.232890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5d84c0db-8abb-46e9-b89d-aee98bc56e04 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:32.234084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5d84c0db-8abb-46e9-b89d-aee98bc56e04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:32.299216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 577/1155] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:32.323863 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbf4d6-7511-4e26-95e5-e701584257fd None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:32.378280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:32.428167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbbf4d6-7511-4e26-95e5-e701584257fd None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:32.461230 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea84ad-2d16-4ff6-a556-0920c2c2e342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:32.461948 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea84ad-2d16-4ff6-a556-0920c2c2e342 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:32.462233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea84ad-2d16-4ff6-a556-0920c2c2e342 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:32.462514 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ea84ad-2d16-4ff6-a556-0920c2c2e342 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:32.473827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ea84ad-2d16-4ff6-a556-0920c2c2e342 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-b0ea84ad-2d16-4ff6-a556-0920c2c2e342 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:51:32.482072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:32.483191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:51:32.488446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 579/1156] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:51:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:32.489500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84c0db-8abb-46e9-b89d-aee98bc56e04 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:32.587058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d84c0db-8abb-46e9-b89d-aee98bc56e04 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:32.604373 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:32.621550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9a003-de33-41b8-8ec1-9741b6a0d412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:32.622203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a003-de33-41b8-8ec1-9741b6a0d412 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:32.622487 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a003-de33-41b8-8ec1-9741b6a0d412 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:32.622764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd9a003-de33-41b8-8ec1-9741b6a0d412 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:32.623499 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9a003-de33-41b8-8ec1-9741b6a0d412 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:32.623826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9a003-de33-41b8-8ec1-9741b6a0d412 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:32.625204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd9a003-de33-41b8-8ec1-9741b6a0d412 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:32.633396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 578/1157] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:51:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:51:32.639394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea84ad-2d16-4ff6-a556-0920c2c2e342 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:32.740005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ea84ad-2d16-4ff6-a556-0920c2c2e342 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:32.752705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:32.774329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4e94e-8f42-4a0f-b528-06082f5a1bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:32.775195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4e94e-8f42-4a0f-b528-06082f5a1bc8 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:32.775482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4e94e-8f42-4a0f-b528-06082f5a1bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:32.775758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c4e94e-8f42-4a0f-b528-06082f5a1bc8 None admin] PATH_INFO: `/v3/users/208ef173bf024e9ba7a9565ce1907610` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:32.777029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4e94e-8f42-4a0f-b528-06082f5a1bc8 None admin] RBAC: Authorizing `identity:get_user(user_id=208ef173bf024e9ba7a9565ce1907610)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:32.778874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c4e94e-8f42-4a0f-b528-06082f5a1bc8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:32.781034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 580/1158] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:32 2022] GET /identity/v3/users/208ef173bf024e9ba7a9565ce1907610 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:32.786560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9a003-de33-41b8-8ec1-9741b6a0d412 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:32.884813 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd9a003-de33-41b8-8ec1-9741b6a0d412 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:32.917530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78085d-323e-4bfb-8596-b6ed19e521a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:32.918165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78085d-323e-4bfb-8596-b6ed19e521a8 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:32.918444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78085d-323e-4bfb-8596-b6ed19e521a8 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:32.918715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac78085d-323e-4bfb-8596-b6ed19e521a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:32.963147 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:32.983860 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78085d-323e-4bfb-8596-b6ed19e521a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:32.985307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac78085d-323e-4bfb-8596-b6ed19e521a8 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:33.080802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 579/1159] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:51:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:51:33.086776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4e94e-8f42-4a0f-b528-06082f5a1bc8 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:33.186739 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c4e94e-8f42-4a0f-b528-06082f5a1bc8 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:33.219968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c88f486-7bc7-4d40-948c-ee4c0e87aaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:33.221059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88f486-7bc7-4d40-948c-ee4c0e87aaea None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:33.221351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88f486-7bc7-4d40-948c-ee4c0e87aaea None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:33.221630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c88f486-7bc7-4d40-948c-ee4c0e87aaea None admin] PATH_INFO: `/v3/projects/bcc5fe12cfe744f4aff619dd6b8b4ff6` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:33.222816 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88f486-7bc7-4d40-948c-ee4c0e87aaea None admin] RBAC: Authorizing `identity:get_project(project_id=bcc5fe12cfe744f4aff619dd6b8b4ff6)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:33.224279 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c88f486-7bc7-4d40-948c-ee4c0e87aaea None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:33.226700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 581/1160] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:51:33 2022] GET /identity/v3/projects/bcc5fe12cfe744f4aff619dd6b8b4ff6 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:33.232803 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78085d-323e-4bfb-8596-b6ed19e521a8 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:33.308451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:33.329404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac78085d-323e-4bfb-8596-b6ed19e521a8 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:33.363694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc983a0-9d98-47e7-81e3-7f767902de84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:33.364340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc983a0-9d98-47e7-81e3-7f767902de84 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:33.364695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc983a0-9d98-47e7-81e3-7f767902de84 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:33.365018 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc983a0-9d98-47e7-81e3-7f767902de84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:33.365920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc983a0-9d98-47e7-81e3-7f767902de84 None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=bcc5fe12cfe744f4aff619dd6b8b4ff6, user.id=208ef173bf024e9ba7a9565ce1907610) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:33.366285 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc983a0-9d98-47e7-81e3-7f767902de84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:33.367772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc983a0-9d98-47e7-81e3-7f767902de84 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:33.373550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 580/1161] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:51:33 2022] GET /identity/v3/role_assignments?user.id=208ef173bf024e9ba7a9565ce1907610&scope.project.id=bcc5fe12cfe744f4aff619dd6b8b4ff6&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:35.446059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753829b2-e9f6-4d12-9832-3eb3b7642e98 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:35.446617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753829b2-e9f6-4d12-9832-3eb3b7642e98 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:35.446617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753829b2-e9f6-4d12-9832-3eb3b7642e98 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:35.448014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 582/1162] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:35.453206 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e265b9d-99b4-4554-a84b-be3442893c5c None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:35.453596 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e265b9d-99b4-4554-a84b-be3442893c5c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:35.453771 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e265b9d-99b4-4554-a84b-be3442893c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:35.470554 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-7e265b9d-99b4-4554-a84b-be3442893c5c None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:35.472032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-7e265b9d-99b4-4554-a84b-be3442893c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:35.536135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 581/1163] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:35.559042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753829b2-e9f6-4d12-9832-3eb3b7642e98 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:35.608904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:35.657496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753829b2-e9f6-4d12-9832-3eb3b7642e98 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:35.690335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fcdaf-1fdb-4b43-bccb-625908234af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:35.690973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fcdaf-1fdb-4b43-bccb-625908234af4 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:35.691252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fcdaf-1fdb-4b43-bccb-625908234af4 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:35.691523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89fcdaf-1fdb-4b43-bccb-625908234af4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:35.759536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fcdaf-1fdb-4b43-bccb-625908234af4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:35.761058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89fcdaf-1fdb-4b43-bccb-625908234af4 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:35.807829 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:35.857875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 583/1164] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:51:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:51:35.863967 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e265b9d-99b4-4554-a84b-be3442893c5c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:35.931965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:35.959727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e265b9d-99b4-4554-a84b-be3442893c5c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:35.997981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ec621-de0a-4e91-a2e1-5f443d18fe5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:35.998778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ec621-de0a-4e91-a2e1-5f443d18fe5d None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:35.999063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ec621-de0a-4e91-a2e1-5f443d18fe5d None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:35.999338 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ec621-de0a-4e91-a2e1-5f443d18fe5d None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:36.005879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ec621-de0a-4e91-a2e1-5f443d18fe5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:36.007355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ec621-de0a-4e91-a2e1-5f443d18fe5d None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-366ec621-de0a-4e91-a2e1-5f443d18fe5d None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:36.021319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:36.023022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:36.024321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 582/1165] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Jun 23 10:51:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:36.028957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fcdaf-1fdb-4b43-bccb-625908234af4 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:36.125831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89fcdaf-1fdb-4b43-bccb-625908234af4 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:36.158879 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3afff7-36b3-46a9-aa94-8da1efcd52a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:36.159532 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3afff7-36b3-46a9-aa94-8da1efcd52a1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:36.159832 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3afff7-36b3-46a9-aa94-8da1efcd52a1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:36.160124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3afff7-36b3-46a9-aa94-8da1efcd52a1 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:36.160844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3afff7-36b3-46a9-aa94-8da1efcd52a1 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:36.161153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3afff7-36b3-46a9-aa94-8da1efcd52a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:36.162597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3afff7-36b3-46a9-aa94-8da1efcd52a1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:36.169655 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 584/1166] 10.222.0.52 () {56 vars in 1115 bytes} [Thu Jun 23 10:51:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:38.156643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5e674-66af-45cc-b802-a51453243fc1 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:38.157198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5e674-66af-45cc-b802-a51453243fc1 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:38.157198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da5e674-66af-45cc-b802-a51453243fc1 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:38.158560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 583/1167] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:38.164174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b839-cbd9-4a35-9c02-680921857d97 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:38.164597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b839-cbd9-4a35-9c02-680921857d97 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:38.164735 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0b839-cbd9-4a35-9c02-680921857d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:38.182466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-85b0b839-cbd9-4a35-9c02-680921857d97 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:38.183659 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-85b0b839-cbd9-4a35-9c02-680921857d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:38.190819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:38.249506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 585/1168] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:38.272458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5e674-66af-45cc-b802-a51453243fc1 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:38.372683 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da5e674-66af-45cc-b802-a51453243fc1 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:38.400879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:38.405634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f1633-aec6-48ab-bcaf-60b41c7873b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:38.406287 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f1633-aec6-48ab-bcaf-60b41c7873b6 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:38.406569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f1633-aec6-48ab-bcaf-60b41c7873b6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:38.406896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f1633-aec6-48ab-bcaf-60b41c7873b6 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:38.407616 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f1633-aec6-48ab-bcaf-60b41c7873b6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:38.409023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3f1633-aec6-48ab-bcaf-60b41c7873b6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:38.482389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 584/1169] 10.222.0.52 () {60 vars in 1138 bytes} [Thu Jun 23 10:51:38 2022] POST /identity/v3/domains => generated 267 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:40.577502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324d6b4-8e56-4c65-b2b5-e3e05efd9401 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:40.578016 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324d6b4-8e56-4c65-b2b5-e3e05efd9401 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:40.578169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7324d6b4-8e56-4c65-b2b5-e3e05efd9401 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:40.580060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 586/1170] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:40.585592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f373a-63e7-4088-9ab9-c50b48e29c92 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:40.586046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f373a-63e7-4088-9ab9-c50b48e29c92 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:40.586151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f373a-63e7-4088-9ab9-c50b48e29c92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:40.603333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-bc0f373a-63e7-4088-9ab9-c50b48e29c92 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:40.604568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-bc0f373a-63e7-4088-9ab9-c50b48e29c92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:40.669229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 585/1171] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:40.692681 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324d6b4-8e56-4c65-b2b5-e3e05efd9401 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:40.793050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7324d6b4-8e56-4c65-b2b5-e3e05efd9401 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:40.826802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9828cd4-d120-457a-9349-d4e9d7c4be43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:40.827706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9828cd4-d120-457a-9349-d4e9d7c4be43 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:40.827963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9828cd4-d120-457a-9349-d4e9d7c4be43 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:40.828239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9828cd4-d120-457a-9349-d4e9d7c4be43 None admin] PATH_INFO: `/v3/domains/9968b648010e482e8defe1f726cb32dd` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:40.838606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9828cd4-d120-457a-9349-d4e9d7c4be43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9968b648010e482e8defe1f726cb32dd)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:40.840090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9828cd4-d120-457a-9349-d4e9d7c4be43 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:40.841748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 587/1172] 10.222.0.52 () {56 vars in 1183 bytes} [Thu Jun 23 10:51:40 2022] GET /identity/v3/domains/9968b648010e482e8defe1f726cb32dd => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:40.847896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f373a-63e7-4088-9ab9-c50b48e29c92 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:40.943481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f373a-63e7-4088-9ab9-c50b48e29c92 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:40.964759 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:40.976623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae1d16e-aa30-4bf2-b74a-8a9e5dbec08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:40.977277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1d16e-aa30-4bf2-b74a-8a9e5dbec08a None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:40.977555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1d16e-aa30-4bf2-b74a-8a9e5dbec08a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:40.993971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae1d16e-aa30-4bf2-b74a-8a9e5dbec08a None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:40.993971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1d16e-aa30-4bf2-b74a-8a9e5dbec08a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:40.993971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae1d16e-aa30-4bf2-b74a-8a9e5dbec08a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:41.054083 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 586/1173] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:51:40 2022] POST /identity/v3/projects => generated 361 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:43.103106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ff780-44d8-4490-8e85-b3d3cb948b31 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:43.103693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ff780-44d8-4490-8e85-b3d3cb948b31 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:43.103693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ff780-44d8-4490-8e85-b3d3cb948b31 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:43.105199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 588/1174] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:43.110330 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b37124-a886-41dd-af91-2990144ee1cb None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:43.110726 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b37124-a886-41dd-af91-2990144ee1cb None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:43.110907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b37124-a886-41dd-af91-2990144ee1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:43.127867 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-16b37124-a886-41dd-af91-2990144ee1cb None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:43.129073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-16b37124-a886-41dd-af91-2990144ee1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:43.200794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 587/1175] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:43.225903 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ff780-44d8-4490-8e85-b3d3cb948b31 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:43.228806 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:43.328071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ff780-44d8-4490-8e85-b3d3cb948b31 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:43.375552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37babf9a-84ef-4aec-a108-39c98f5ed048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:43.376351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37babf9a-84ef-4aec-a108-39c98f5ed048 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:43.376631 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37babf9a-84ef-4aec-a108-39c98f5ed048 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:43.376903 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37babf9a-84ef-4aec-a108-39c98f5ed048 None admin] PATH_INFO: `/v3/domains/9968b648010e482e8defe1f726cb32dd` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:43.378062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37babf9a-84ef-4aec-a108-39c98f5ed048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9968b648010e482e8defe1f726cb32dd)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:43.379496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37babf9a-84ef-4aec-a108-39c98f5ed048 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:43.381656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 589/1176] 10.222.0.52 () {56 vars in 1183 bytes} [Thu Jun 23 10:51:43 2022] GET /identity/v3/domains/9968b648010e482e8defe1f726cb32dd => generated 267 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:43.387438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b37124-a886-41dd-af91-2990144ee1cb None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:43.488587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b37124-a886-41dd-af91-2990144ee1cb None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:43.490957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:43.523927 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ee0422-7e36-4090-b957-11a1ac057d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:43.524597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee0422-7e36-4090-b957-11a1ac057d14 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:43.524880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee0422-7e36-4090-b957-11a1ac057d14 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:43.525154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ee0422-7e36-4090-b957-11a1ac057d14 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:43.525868 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee0422-7e36-4090-b957-11a1ac057d14 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:43.527318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ee0422-7e36-4090-b957-11a1ac057d14 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:43.589477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 588/1177] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:51:43 2022] POST /identity/v3/users => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:51:45.647364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a2511-b937-40b6-bac5-5f61ac27a813 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:45.647909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a2511-b937-40b6-bac5-5f61ac27a813 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:45.648001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a2511-b937-40b6-bac5-5f61ac27a813 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:45.649354 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 590/1178] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:45.654548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8de66e-e6ec-4483-b6ee-4bea3aeb9355 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:45.654970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8de66e-e6ec-4483-b6ee-4bea3aeb9355 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:45.655109 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8de66e-e6ec-4483-b6ee-4bea3aeb9355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:45.672012 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-fb8de66e-e6ec-4483-b6ee-4bea3aeb9355 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:45.673277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-fb8de66e-e6ec-4483-b6ee-4bea3aeb9355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:45.737436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 589/1179] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:45.760761 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a2511-b937-40b6-bac5-5f61ac27a813 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:45.859401 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:45.894339 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a2511-b937-40b6-bac5-5f61ac27a813 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:45.930189 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43d1c8-13ab-4e2e-9836-37a2ba6b1870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:45.930993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43d1c8-13ab-4e2e-9836-37a2ba6b1870 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:45.931277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43d1c8-13ab-4e2e-9836-37a2ba6b1870 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:45.931558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b43d1c8-13ab-4e2e-9836-37a2ba6b1870 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:45.942260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b43d1c8-13ab-4e2e-9836-37a2ba6b1870 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-2b43d1c8-13ab-4e2e-9836-37a2ba6b1870 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:51:45.949992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:45.951217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:51:45.952157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 591/1180] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:51:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:45.957454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8de66e-e6ec-4483-b6ee-4bea3aeb9355 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:46.052016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:46.061367 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8de66e-e6ec-4483-b6ee-4bea3aeb9355 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:46.095751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20e55a-3dbc-4ba1-a932-50f32bcbe584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:46.096435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20e55a-3dbc-4ba1-a932-50f32bcbe584 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:46.096717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20e55a-3dbc-4ba1-a932-50f32bcbe584 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:46.096990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c20e55a-3dbc-4ba1-a932-50f32bcbe584 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:46.097726 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20e55a-3dbc-4ba1-a932-50f32bcbe584 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:46.098027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20e55a-3dbc-4ba1-a932-50f32bcbe584 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:46.099979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c20e55a-3dbc-4ba1-a932-50f32bcbe584 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:46.107829 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 590/1181] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:51:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:46.113769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43d1c8-13ab-4e2e-9836-37a2ba6b1870 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:46.215591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b43d1c8-13ab-4e2e-9836-37a2ba6b1870 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:46.243290 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:46.248898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8a530-0310-4558-aabe-fa9ca87336c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:46.256783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8a530-0310-4558-aabe-fa9ca87336c5 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:46.256783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8a530-0310-4558-aabe-fa9ca87336c5 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:46.256783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8a530-0310-4558-aabe-fa9ca87336c5 None admin] PATH_INFO: `/v3/users/88ff9f4fc14a4b85b625c7c26d3ab942` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:46.263956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8a530-0310-4558-aabe-fa9ca87336c5 None admin] RBAC: Authorizing `identity:get_user(user_id=88ff9f4fc14a4b85b625c7c26d3ab942)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:46.265380 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8a530-0310-4558-aabe-fa9ca87336c5 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:46.267047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 592/1182] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:46 2022] GET /identity/v3/users/88ff9f4fc14a4b85b625c7c26d3ab942 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:46.273425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20e55a-3dbc-4ba1-a932-50f32bcbe584 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:46.369875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c20e55a-3dbc-4ba1-a932-50f32bcbe584 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:46.403386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae25495-432d-4b0c-a922-648654e7a4a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:46.404059 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae25495-432d-4b0c-a922-648654e7a4a7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:46.404352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae25495-432d-4b0c-a922-648654e7a4a7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:46.404630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae25495-432d-4b0c-a922-648654e7a4a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:46.425901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:46.477163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae25495-432d-4b0c-a922-648654e7a4a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:46.478624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae25495-432d-4b0c-a922-648654e7a4a7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:46.574791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 591/1183] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:51:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:51:46.580828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8a530-0310-4558-aabe-fa9ca87336c5 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:46.679697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8a530-0310-4558-aabe-fa9ca87336c5 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:46.713999 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb09b2b-fea6-472c-983d-cda93a6bc965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:46.714843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb09b2b-fea6-472c-983d-cda93a6bc965 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:46.715117 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb09b2b-fea6-472c-983d-cda93a6bc965 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:46.715390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb09b2b-fea6-472c-983d-cda93a6bc965 None admin] PATH_INFO: `/v3/projects/72ed0478a1e34275beba3aeafee17b19` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:46.716581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb09b2b-fea6-472c-983d-cda93a6bc965 None admin] RBAC: Authorizing `identity:get_project(project_id=72ed0478a1e34275beba3aeafee17b19)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:46.718009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb09b2b-fea6-472c-983d-cda93a6bc965 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:46.719680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 593/1184] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:51:46 2022] GET /identity/v3/projects/72ed0478a1e34275beba3aeafee17b19 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:46.726292 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae25495-432d-4b0c-a922-648654e7a4a7 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:46.778055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:46.824427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae25495-432d-4b0c-a922-648654e7a4a7 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:46.857282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179fba7-7358-4210-b091-a7755cb06681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:46.857919 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179fba7-7358-4210-b091-a7755cb06681 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:46.858210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179fba7-7358-4210-b091-a7755cb06681 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:46.858482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179fba7-7358-4210-b091-a7755cb06681 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:46.859303 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179fba7-7358-4210-b091-a7755cb06681 None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=72ed0478a1e34275beba3aeafee17b19, user.id=88ff9f4fc14a4b85b625c7c26d3ab942) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:46.859607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179fba7-7358-4210-b091-a7755cb06681 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:46.861068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179fba7-7358-4210-b091-a7755cb06681 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:46.866949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 592/1185] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:51:46 2022] GET /identity/v3/role_assignments?user.id=88ff9f4fc14a4b85b625c7c26d3ab942&scope.project.id=72ed0478a1e34275beba3aeafee17b19&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:48.861071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6626d-8781-403c-99a0-f7eed918ba61 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:48.861572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6626d-8781-403c-99a0-f7eed918ba61 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:48.861572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af6626d-8781-403c-99a0-f7eed918ba61 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:48.863014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 594/1186] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 10:51:48.869060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040f2e6-d448-4ce1-82b7-869f98c8ee18 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:48.869465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040f2e6-d448-4ce1-82b7-869f98c8ee18 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:48.869615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040f2e6-d448-4ce1-82b7-869f98c8ee18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:48.886838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-a040f2e6-d448-4ce1-82b7-869f98c8ee18 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:48.888065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a040f2e6-d448-4ce1-82b7-869f98c8ee18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:48.953152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 593/1187] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:48.976023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6626d-8781-403c-99a0-f7eed918ba61 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:49.034266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:49.078661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af6626d-8781-403c-99a0-f7eed918ba61 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:49.112594 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09795eb5-fe5a-42a2-b707-29c9552879b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:49.113310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09795eb5-fe5a-42a2-b707-29c9552879b2 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:49.113595 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09795eb5-fe5a-42a2-b707-29c9552879b2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:49.113876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09795eb5-fe5a-42a2-b707-29c9552879b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:49.125124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09795eb5-fe5a-42a2-b707-29c9552879b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-09795eb5-fe5a-42a2-b707-29c9552879b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:51:49.134404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:49.135589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:51:49.136668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 595/1188] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:51:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 23 10:51:49.143085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040f2e6-d448-4ce1-82b7-869f98c8ee18 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:49.189315 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:49.242762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040f2e6-d448-4ce1-82b7-869f98c8ee18 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:49.277520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ead527-d297-4221-8ce4-54bc1d307d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:49.278175 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead527-d297-4221-8ce4-54bc1d307d2a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:49.278459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead527-d297-4221-8ce4-54bc1d307d2a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:49.278735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ead527-d297-4221-8ce4-54bc1d307d2a None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:49.280199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ead527-d297-4221-8ce4-54bc1d307d2a None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:49.280199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ead527-d297-4221-8ce4-54bc1d307d2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:49.281193 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ead527-d297-4221-8ce4-54bc1d307d2a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:49.289532 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 594/1189] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:51:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:49.295331 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09795eb5-fe5a-42a2-b707-29c9552879b2 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:49.393593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09795eb5-fe5a-42a2-b707-29c9552879b2 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:49.411107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:49.429482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181960d2-4524-41c2-b627-448e85869fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:49.430357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181960d2-4524-41c2-b627-448e85869fd5 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:49.430638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181960d2-4524-41c2-b627-448e85869fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:49.430917 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181960d2-4524-41c2-b627-448e85869fd5 None admin] PATH_INFO: `/v3/users/88ff9f4fc14a4b85b625c7c26d3ab942` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:49.432153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181960d2-4524-41c2-b627-448e85869fd5 None admin] RBAC: Authorizing `identity:get_user(user_id=88ff9f4fc14a4b85b625c7c26d3ab942)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:49.433605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181960d2-4524-41c2-b627-448e85869fd5 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:49.435250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 596/1190] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:49 2022] GET /identity/v3/users/88ff9f4fc14a4b85b625c7c26d3ab942 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:49.441449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ead527-d297-4221-8ce4-54bc1d307d2a None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:49.549833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ead527-d297-4221-8ce4-54bc1d307d2a None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:49.559114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:49.583833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df524f78-24c2-4325-a7c4-366c1533d829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:49.589974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524f78-24c2-4325-a7c4-366c1533d829 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:49.589974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524f78-24c2-4325-a7c4-366c1533d829 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:49.589974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df524f78-24c2-4325-a7c4-366c1533d829 None admin] PATH_INFO: `/v3/projects/72ed0478a1e34275beba3aeafee17b19` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:49.589974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df524f78-24c2-4325-a7c4-366c1533d829 None admin] RBAC: Authorizing `identity:get_project(project_id=72ed0478a1e34275beba3aeafee17b19)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:49.589974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df524f78-24c2-4325-a7c4-366c1533d829 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:49.589974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 595/1191] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:51:49 2022] GET /identity/v3/projects/72ed0478a1e34275beba3aeafee17b19 => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:49.595775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181960d2-4524-41c2-b627-448e85869fd5 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:49.694568 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181960d2-4524-41c2-b627-448e85869fd5 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:49.727129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01da9abe-e2ca-4a10-8e4f-854e2996eb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:49.728040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da9abe-e2ca-4a10-8e4f-854e2996eb64 None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:49.728330 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da9abe-e2ca-4a10-8e4f-854e2996eb64 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:49.728605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01da9abe-e2ca-4a10-8e4f-854e2996eb64 None admin] PATH_INFO: `/v3/projects/72ed0478a1e34275beba3aeafee17b19/users/88ff9f4fc14a4b85b625c7c26d3ab942/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:49.730571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da9abe-e2ca-4a10-8e4f-854e2996eb64 None admin] RBAC: Authorizing `identity:create_grant(project_id=72ed0478a1e34275beba3aeafee17b19, user_id=88ff9f4fc14a4b85b625c7c26d3ab942, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:49.732031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01da9abe-e2ca-4a10-8e4f-854e2996eb64 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:49.807425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 597/1192] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:51:49 2022] PUT /identity/v3/projects/72ed0478a1e34275beba3aeafee17b19/users/88ff9f4fc14a4b85b625c7c26d3ab942/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:51:51.805801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be49bf-c52f-4fe0-b44c-25a21952516f None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:51.806682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be49bf-c52f-4fe0-b44c-25a21952516f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:51.806682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54be49bf-c52f-4fe0-b44c-25a21952516f None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:51.807854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 596/1193] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:51:51.813315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f84b-f2da-4d58-8265-8e1d0e3ca6f4 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:51.813724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f84b-f2da-4d58-8265-8e1d0e3ca6f4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:51.813865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8435f84b-f2da-4d58-8265-8e1d0e3ca6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:51.830847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-8435f84b-f2da-4d58-8265-8e1d0e3ca6f4 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:51:51.832006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8435f84b-f2da-4d58-8265-8e1d0e3ca6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:51:51.872448 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:51.898711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 598/1194] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:51:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:51:51.922394 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be49bf-c52f-4fe0-b44c-25a21952516f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:52.022552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54be49bf-c52f-4fe0-b44c-25a21952516f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:52.054504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2696059-9cbe-4b08-839a-9dcefb8fd59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:52.055270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2696059-9cbe-4b08-839a-9dcefb8fd59f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:52.055547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2696059-9cbe-4b08-839a-9dcefb8fd59f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:52.055837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2696059-9cbe-4b08-839a-9dcefb8fd59f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:52.065942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2696059-9cbe-4b08-839a-9dcefb8fd59f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-f2696059-9cbe-4b08-839a-9dcefb8fd59f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:51:52.074042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:51:52.075166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:51:52.076236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 597/1195] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:51:52.081559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435f84b-f2da-4d58-8265-8e1d0e3ca6f4 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:52.179474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8435f84b-f2da-4d58-8265-8e1d0e3ca6f4 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:52.213020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25dfb3-9423-46aa-ac21-686e84f2c58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:52.213757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25dfb3-9423-46aa-ac21-686e84f2c58d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:52.214047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25dfb3-9423-46aa-ac21-686e84f2c58d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:52.214331 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df25dfb3-9423-46aa-ac21-686e84f2c58d None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:52.215072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25dfb3-9423-46aa-ac21-686e84f2c58d None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:52.215379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25dfb3-9423-46aa-ac21-686e84f2c58d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:52.216824 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df25dfb3-9423-46aa-ac21-686e84f2c58d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:52.225766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 599/1196] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:51:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:52.231880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2696059-9cbe-4b08-839a-9dcefb8fd59f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:52.266152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:52.329322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2696059-9cbe-4b08-839a-9dcefb8fd59f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:52.362472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7968e6-2cc9-4db7-9c72-a8311b9f474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:52.363256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7968e6-2cc9-4db7-9c72-a8311b9f474f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:52.363539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7968e6-2cc9-4db7-9c72-a8311b9f474f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:52.363839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7968e6-2cc9-4db7-9c72-a8311b9f474f None admin] PATH_INFO: `/v3/users/88ff9f4fc14a4b85b625c7c26d3ab942` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:52.365683 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7968e6-2cc9-4db7-9c72-a8311b9f474f None admin] RBAC: Authorizing `identity:get_user(user_id=88ff9f4fc14a4b85b625c7c26d3ab942)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:52.367127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7968e6-2cc9-4db7-9c72-a8311b9f474f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:52.368787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 598/1197] 10.222.0.52 () {56 vars in 1177 bytes} [Thu Jun 23 10:51:52 2022] GET /identity/v3/users/88ff9f4fc14a4b85b625c7c26d3ab942 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:52.374817 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25dfb3-9423-46aa-ac21-686e84f2c58d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:52.412081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:52.477469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df25dfb3-9423-46aa-ac21-686e84f2c58d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:52.509379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a522154-fdca-46b4-ac54-33f0e9c5c0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:52.510008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a522154-fdca-46b4-ac54-33f0e9c5c0a1 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:52.510288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a522154-fdca-46b4-ac54-33f0e9c5c0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:52.510563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a522154-fdca-46b4-ac54-33f0e9c5c0a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:52.576778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a522154-fdca-46b4-ac54-33f0e9c5c0a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:52.578240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a522154-fdca-46b4-ac54-33f0e9c5c0a1 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:52.612590 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:52.676039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 600/1198] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:51:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:51:52.681790 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7968e6-2cc9-4db7-9c72-a8311b9f474f None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:52.779342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7968e6-2cc9-4db7-9c72-a8311b9f474f None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:52.781681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:52.812692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c76d06-5c34-44a2-854b-ac8001658a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:52.813593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c76d06-5c34-44a2-854b-ac8001658a21 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:52.813875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c76d06-5c34-44a2-854b-ac8001658a21 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:52.814150 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c76d06-5c34-44a2-854b-ac8001658a21 None admin] PATH_INFO: `/v3/projects/72ed0478a1e34275beba3aeafee17b19` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:52.815321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c76d06-5c34-44a2-854b-ac8001658a21 None admin] RBAC: Authorizing `identity:get_project(project_id=72ed0478a1e34275beba3aeafee17b19)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:52.816805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c76d06-5c34-44a2-854b-ac8001658a21 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:52.818525 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 599/1199] 10.222.0.52 () {56 vars in 1186 bytes} [Thu Jun 23 10:51:52 2022] GET /identity/v3/projects/72ed0478a1e34275beba3aeafee17b19 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:51:52.824927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a522154-fdca-46b4-ac54-33f0e9c5c0a1 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:51:52.927059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a522154-fdca-46b4-ac54-33f0e9c5c0a1 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:51:52.961267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ecd9fb-fa0c-4a85-8058-b1817308b2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:51:52.961910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd9fb-fa0c-4a85-8058-b1817308b2db None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:51:52.962193 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd9fb-fa0c-4a85-8058-b1817308b2db None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:51:52.962469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ecd9fb-fa0c-4a85-8058-b1817308b2db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:51:52.963291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecd9fb-fa0c-4a85-8058-b1817308b2db None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=72ed0478a1e34275beba3aeafee17b19, user.id=88ff9f4fc14a4b85b625c7c26d3ab942) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:51:52.963606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecd9fb-fa0c-4a85-8058-b1817308b2db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:51:52.965168 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ecd9fb-fa0c-4a85-8058-b1817308b2db None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:51:52.967996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:51:52.971522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 601/1200] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:51:52 2022] GET /identity/v3/role_assignments?user.id=88ff9f4fc14a4b85b625c7c26d3ab942&scope.project.id=72ed0478a1e34275beba3aeafee17b19&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:52:02.823496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=14 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:13.090052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72bab1-e661-49c6-8264-8e2553f67f40 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:13.090877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72bab1-e661-49c6-8264-8e2553f67f40 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:13.090877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72bab1-e661-49c6-8264-8e2553f67f40 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:13.091987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 600/1201] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:53:13.097505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a7593-fb2b-42ac-8f69-4a6c839bb351 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:13.097951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a7593-fb2b-42ac-8f69-4a6c839bb351 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:13.098070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018a7593-fb2b-42ac-8f69-4a6c839bb351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:13.114694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-018a7593-fb2b-42ac-8f69-4a6c839bb351 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:13.115921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-018a7593-fb2b-42ac-8f69-4a6c839bb351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:13.183290 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 602/1202] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:53:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:53:13.208636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72bab1-e661-49c6-8264-8e2553f67f40 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:13.308516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72bab1-e661-49c6-8264-8e2553f67f40 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:13.341789 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8d887-d70f-439a-bd72-3b357e5a579b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:13.342759 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d887-d70f-439a-bd72-3b357e5a579b None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:13.343037 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d887-d70f-439a-bd72-3b357e5a579b None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:13.343314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e8d887-d70f-439a-bd72-3b357e5a579b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:13.353162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8d887-d70f-439a-bd72-3b357e5a579b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:13.357901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e8d887-d70f-439a-bd72-3b357e5a579b None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-b8e8d887-d70f-439a-bd72-3b357e5a579b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:13.373404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:13.374629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:13.375926 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:13.375926 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:13.375926 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:13.375926 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:13.375926 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 601/1203] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:13.380793 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a7593-fb2b-42ac-8f69-4a6c839bb351 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:13.481799 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018a7593-fb2b-42ac-8f69-4a6c839bb351 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:13.510513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:13.516358 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd054cf-5504-474e-94ea-451cf709e019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:13.517027 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd054cf-5504-474e-94ea-451cf709e019 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:13.517320 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd054cf-5504-474e-94ea-451cf709e019 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:13.517602 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd054cf-5504-474e-94ea-451cf709e019 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:13.518342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd054cf-5504-474e-94ea-451cf709e019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:13.518654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd054cf-5504-474e-94ea-451cf709e019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:13.520059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd054cf-5504-474e-94ea-451cf709e019 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:13.531486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 603/1204] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:13.537451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8d887-d70f-439a-bd72-3b357e5a579b None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:13.593090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:13.640113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e8d887-d70f-439a-bd72-3b357e5a579b None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:13.676138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a2ce7a-9b31-405a-ac45-2ff382f0b308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:13.676796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ce7a-9b31-405a-ac45-2ff382f0b308 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:13.677080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ce7a-9b31-405a-ac45-2ff382f0b308 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:13.677409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a2ce7a-9b31-405a-ac45-2ff382f0b308 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:13.678068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2ce7a-9b31-405a-ac45-2ff382f0b308 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:13.679515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a2ce7a-9b31-405a-ac45-2ff382f0b308 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:13.782279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 602/1205] 10.222.0.52 () {60 vars in 1132 bytes} [Thu Jun 23 10:53:13 2022] POST /identity/v3/users => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:53:15.854593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fa9f9-8751-42d3-bd7a-19a03626e8fa None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:15.855173 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fa9f9-8751-42d3-bd7a-19a03626e8fa None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:15.855173 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fa9f9-8751-42d3-bd7a-19a03626e8fa None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:15.856578 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 604/1206] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:53:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:53:15.862424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c31803-fe0a-4613-b052-96df80e1acbd None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:15.862882 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c31803-fe0a-4613-b052-96df80e1acbd None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:15.863022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c31803-fe0a-4613-b052-96df80e1acbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:15.880140 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-12c31803-fe0a-4613-b052-96df80e1acbd None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:15.881332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-12c31803-fe0a-4613-b052-96df80e1acbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:15.949118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 603/1207] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:53:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:53:15.973495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fa9f9-8751-42d3-bd7a-19a03626e8fa None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:16.076332 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fa9f9-8751-42d3-bd7a-19a03626e8fa None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:16.110714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5eaf7-4034-40a1-8106-f80641122f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:16.111439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5eaf7-4034-40a1-8106-f80641122f47 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:16.111721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5eaf7-4034-40a1-8106-f80641122f47 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:16.112025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d5eaf7-4034-40a1-8106-f80641122f47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:16.123734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d5eaf7-4034-40a1-8106-f80641122f47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-69d5eaf7-4034-40a1-8106-f80641122f47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:53:16.131466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:16.132614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:16.133855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 605/1208] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:53:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:16.138668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c31803-fe0a-4613-b052-96df80e1acbd None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:16.178079 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:16.235702 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c31803-fe0a-4613-b052-96df80e1acbd None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:16.269495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58068bff-3a24-4566-bbe1-935e9eb59ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:16.270155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58068bff-3a24-4566-bbe1-935e9eb59ba8 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:16.270437 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58068bff-3a24-4566-bbe1-935e9eb59ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:16.270712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58068bff-3a24-4566-bbe1-935e9eb59ba8 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:16.271453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58068bff-3a24-4566-bbe1-935e9eb59ba8 None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:16.271762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58068bff-3a24-4566-bbe1-935e9eb59ba8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:16.273166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58068bff-3a24-4566-bbe1-935e9eb59ba8 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:16.281083 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 604/1209] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:53:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:16.286855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5eaf7-4034-40a1-8106-f80641122f47 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:16.338074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:16.389501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d5eaf7-4034-40a1-8106-f80641122f47 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:16.423260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68540f5d-c409-429e-8d95-2ea1032c3dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:16.424210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68540f5d-c409-429e-8d95-2ea1032c3dd3 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:16.424516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68540f5d-c409-429e-8d95-2ea1032c3dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:16.424791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68540f5d-c409-429e-8d95-2ea1032c3dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:16.434847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68540f5d-c409-429e-8d95-2ea1032c3dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:16.436329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68540f5d-c409-429e-8d95-2ea1032c3dd3 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-68540f5d-c409-429e-8d95-2ea1032c3dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:16.454137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:16.455191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:16.456451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:16.456451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:16.456451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:16.456451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:16.456451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 606/1210] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:16.461110 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58068bff-3a24-4566-bbe1-935e9eb59ba8 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:16.565587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:16.568568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58068bff-3a24-4566-bbe1-935e9eb59ba8 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:16.602895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9a361-fe36-43d7-88b0-c56c56a18eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:16.607443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9a361-fe36-43d7-88b0-c56c56a18eea None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:16.607443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9a361-fe36-43d7-88b0-c56c56a18eea None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:16.607443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f9a361-fe36-43d7-88b0-c56c56a18eea None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:16.607443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9a361-fe36-43d7-88b0-c56c56a18eea None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:16.607443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9a361-fe36-43d7-88b0-c56c56a18eea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:16.607443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f9a361-fe36-43d7-88b0-c56c56a18eea None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:16.618091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 605/1211] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:16.623749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68540f5d-c409-429e-8d95-2ea1032c3dd3 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:16.723218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68540f5d-c409-429e-8d95-2ea1032c3dd3 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:16.724821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:16.756977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a49023-2d74-4c31-870c-57ad9d66e80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:16.757771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49023-2d74-4c31-870c-57ad9d66e80a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:16.758059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49023-2d74-4c31-870c-57ad9d66e80a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:16.758341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a49023-2d74-4c31-870c-57ad9d66e80a None admin] PATH_INFO: `/v3/users/placement` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:16.765936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a49023-2d74-4c31-870c-57ad9d66e80a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:16.767382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a49023-2d74-4c31-870c-57ad9d66e80a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-02a49023-2d74-4c31-870c-57ad9d66e80a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:53:16.782420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:16.783529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:16.784523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:16.784523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:16.784523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:53:16.784523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:53:16.784523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:53:16.784523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:53:16.784523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:53:16.784523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:53:16.784523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:53:16.784523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:16.784523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 607/1212] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:16.789656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9a361-fe36-43d7-88b0-c56c56a18eea None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:16.888391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f9a361-fe36-43d7-88b0-c56c56a18eea None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:16.921756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855d2b-5894-4e67-bb78-020411b3cff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:16.922408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855d2b-5894-4e67-bb78-020411b3cff3 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:16.922708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855d2b-5894-4e67-bb78-020411b3cff3 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:16.922973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b855d2b-5894-4e67-bb78-020411b3cff3 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:16.923829 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b855d2b-5894-4e67-bb78-020411b3cff3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:16.924133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b855d2b-5894-4e67-bb78-020411b3cff3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:16.925566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b855d2b-5894-4e67-bb78-020411b3cff3 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:16.942832 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 606/1213] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Jun 23 10:53:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:16.949218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a49023-2d74-4c31-870c-57ad9d66e80a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:17.048686 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a49023-2d74-4c31-870c-57ad9d66e80a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:17.083524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abbc07-14a4-4842-8409-d5340d195260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:17.084198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abbc07-14a4-4842-8409-d5340d195260 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:17.084488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abbc07-14a4-4842-8409-d5340d195260 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:17.084768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0abbc07-14a4-4842-8409-d5340d195260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:17.114530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:17.151078 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abbc07-14a4-4842-8409-d5340d195260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:17.152562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0abbc07-14a4-4842-8409-d5340d195260 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:17.248214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 608/1214] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:53:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:53:17.254057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855d2b-5894-4e67-bb78-020411b3cff3 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:17.273415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:17.354599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b855d2b-5894-4e67-bb78-020411b3cff3 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:17.388820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caac2c-cde2-4100-b46e-188bcc1207de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:17.389602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caac2c-cde2-4100-b46e-188bcc1207de None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:17.389886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caac2c-cde2-4100-b46e-188bcc1207de None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:17.390165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55caac2c-cde2-4100-b46e-188bcc1207de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:17.400406 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caac2c-cde2-4100-b46e-188bcc1207de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:17.401875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55caac2c-cde2-4100-b46e-188bcc1207de None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-55caac2c-cde2-4100-b46e-188bcc1207de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:17.420493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:17.421478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:17.422562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:17.422562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:17.422562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:17.422562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:17.422562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 607/1215] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:17.427619 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abbc07-14a4-4842-8409-d5340d195260 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:17.489848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:17.528011 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0abbc07-14a4-4842-8409-d5340d195260 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:17.561642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37835e-d15a-416a-9d6a-e44530bf5447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:17.562315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37835e-d15a-416a-9d6a-e44530bf5447 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:17.562587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37835e-d15a-416a-9d6a-e44530bf5447 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:17.562867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f37835e-d15a-416a-9d6a-e44530bf5447 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:17.563586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37835e-d15a-416a-9d6a-e44530bf5447 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:17.563941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37835e-d15a-416a-9d6a-e44530bf5447 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:17.565325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f37835e-d15a-416a-9d6a-e44530bf5447 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:17.577679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 609/1216] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:17.583373 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caac2c-cde2-4100-b46e-188bcc1207de None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:17.650956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:17.680947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55caac2c-cde2-4100-b46e-188bcc1207de None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:17.715226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670e28a-0ef5-4dff-a262-45e16aebdab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:17.716040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670e28a-0ef5-4dff-a262-45e16aebdab2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:17.716322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670e28a-0ef5-4dff-a262-45e16aebdab2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:17.716596 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9670e28a-0ef5-4dff-a262-45e16aebdab2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:17.726313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670e28a-0ef5-4dff-a262-45e16aebdab2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:17.729012 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9670e28a-0ef5-4dff-a262-45e16aebdab2 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-9670e28a-0ef5-4dff-a262-45e16aebdab2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:53:17.744672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:17.745793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:17.746880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:53:17.746880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:53:17.746880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:53:17.746880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:53:17.746880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:53:17.746880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:53:17.746880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:53:17.746880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:17.746880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 608/1217] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:53:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:17.752070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37835e-d15a-416a-9d6a-e44530bf5447 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:17.852484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f37835e-d15a-416a-9d6a-e44530bf5447 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:17.874908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:17.886010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a953c2-306e-4de7-bc9c-c06e5e7d93c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:17.886662 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a953c2-306e-4de7-bc9c-c06e5e7d93c7 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:17.886942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a953c2-306e-4de7-bc9c-c06e5e7d93c7 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:17.887219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a953c2-306e-4de7-bc9c-c06e5e7d93c7 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:17.888023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a953c2-306e-4de7-bc9c-c06e5e7d93c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:17.892876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a953c2-306e-4de7-bc9c-c06e5e7d93c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:17.892876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a953c2-306e-4de7-bc9c-c06e5e7d93c7 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:17.901867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 610/1218] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:53:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:17.907826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670e28a-0ef5-4dff-a262-45e16aebdab2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:18.007509 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9670e28a-0ef5-4dff-a262-45e16aebdab2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:18.035000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:18.041285 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3d318c-db01-44c0-995e-b3934898036f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:18.041929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d318c-db01-44c0-995e-b3934898036f None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:18.042214 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d318c-db01-44c0-995e-b3934898036f None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:18.042493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3d318c-db01-44c0-995e-b3934898036f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:18.043319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d318c-db01-44c0-995e-b3934898036f None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=e838dd9aa24f4571b64719125610c528) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:18.043630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d318c-db01-44c0-995e-b3934898036f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:18.045165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3d318c-db01-44c0-995e-b3934898036f None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:18.050721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 609/1219] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:53:17 2022] GET /identity/v3/role_assignments?user.id=e838dd9aa24f4571b64719125610c528&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:53:20.100372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf21af-e493-4e1d-909d-9f986c4dcd4e None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:20.100951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf21af-e493-4e1d-909d-9f986c4dcd4e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:20.100951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badf21af-e493-4e1d-909d-9f986c4dcd4e None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:20.102310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 611/1220] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:53:20.108220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed23f4-a123-41fb-ac4e-c6356933d2e3 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:20.108656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed23f4-a123-41fb-ac4e-c6356933d2e3 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:20.108777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bed23f4-a123-41fb-ac4e-c6356933d2e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:20.125337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5bed23f4-a123-41fb-ac4e-c6356933d2e3 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:20.126532 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5bed23f4-a123-41fb-ac4e-c6356933d2e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:20.192904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 610/1221] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:53:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:53:20.217067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf21af-e493-4e1d-909d-9f986c4dcd4e None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:20.316628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badf21af-e493-4e1d-909d-9f986c4dcd4e None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:20.351917 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282dfe2-7a9e-4217-915d-31ee9d774144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:20.352636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282dfe2-7a9e-4217-915d-31ee9d774144 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:20.352924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282dfe2-7a9e-4217-915d-31ee9d774144 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:20.353228 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7282dfe2-7a9e-4217-915d-31ee9d774144 None admin] PATH_INFO: `/v3/roles/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:20.367971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7282dfe2-7a9e-4217-915d-31ee9d774144 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-7282dfe2-7a9e-4217-915d-31ee9d774144 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:53:20.375778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:20.376930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:20.378039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 612/1222] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:53:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:20.383377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed23f4-a123-41fb-ac4e-c6356933d2e3 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:20.483249 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bed23f4-a123-41fb-ac4e-c6356933d2e3 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:20.506268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:20.517198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cad515-ee16-4f9c-9b7f-2b1aebd4ed88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:20.517859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cad515-ee16-4f9c-9b7f-2b1aebd4ed88 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:20.518143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cad515-ee16-4f9c-9b7f-2b1aebd4ed88 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:20.518418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cad515-ee16-4f9c-9b7f-2b1aebd4ed88 None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:20.519155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cad515-ee16-4f9c-9b7f-2b1aebd4ed88 None admin] RBAC: Adding query filter params (name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:20.519460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cad515-ee16-4f9c-9b7f-2b1aebd4ed88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:20.520865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cad515-ee16-4f9c-9b7f-2b1aebd4ed88 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:20.529778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 611/1223] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:53:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:20.537170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282dfe2-7a9e-4217-915d-31ee9d774144 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:20.584511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:20.640987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7282dfe2-7a9e-4217-915d-31ee9d774144 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:20.673939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0ff28-cd5a-4f58-9ac2-0cbcb81486c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:20.674716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0ff28-cd5a-4f58-9ac2-0cbcb81486c0 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:20.675003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0ff28-cd5a-4f58-9ac2-0cbcb81486c0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:20.675300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0ff28-cd5a-4f58-9ac2-0cbcb81486c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:20.693591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0ff28-cd5a-4f58-9ac2-0cbcb81486c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:20.695073 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0ff28-cd5a-4f58-9ac2-0cbcb81486c0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-a1e0ff28-cd5a-4f58-9ac2-0cbcb81486c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:20.713235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:20.714563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:20.715644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:20.715644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:20.715644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:20.715644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:20.715644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 613/1224] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:20.720694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cad515-ee16-4f9c-9b7f-2b1aebd4ed88 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:20.823628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cad515-ee16-4f9c-9b7f-2b1aebd4ed88 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:20.856801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33737645-1156-445a-b10c-f542196334c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:20.857486 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33737645-1156-445a-b10c-f542196334c7 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:20.857802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33737645-1156-445a-b10c-f542196334c7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:20.858076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33737645-1156-445a-b10c-f542196334c7 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:20.858782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33737645-1156-445a-b10c-f542196334c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:20.859081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33737645-1156-445a-b10c-f542196334c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:20.860467 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33737645-1156-445a-b10c-f542196334c7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:20.872533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 612/1225] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:20.878310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0ff28-cd5a-4f58-9ac2-0cbcb81486c0 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:20.971639 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:20.978718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0ff28-cd5a-4f58-9ac2-0cbcb81486c0 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:21.013394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a530ab-9451-4801-ab61-880375fa2685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:21.014191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a530ab-9451-4801-ab61-880375fa2685 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:21.014475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a530ab-9451-4801-ab61-880375fa2685 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:21.014752 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a530ab-9451-4801-ab61-880375fa2685 None admin] PATH_INFO: `/v3/users/placement` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:21.022042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a530ab-9451-4801-ab61-880375fa2685 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:21.023596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a530ab-9451-4801-ab61-880375fa2685 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-b1a530ab-9451-4801-ab61-880375fa2685 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:53:21.038365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:21.039526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:21.041257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:21.041257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:21.041257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:53:21.041257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:53:21.041257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:53:21.041257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:53:21.041257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:53:21.041257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:53:21.041257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:53:21.041257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:21.041257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 614/1226] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:21.046218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33737645-1156-445a-b10c-f542196334c7 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:21.092363 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:21.145093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33737645-1156-445a-b10c-f542196334c7 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:21.179062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015914e-3bd3-4431-a9fa-7a9635b1c7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:21.182774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015914e-3bd3-4431-a9fa-7a9635b1c7dd None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:21.182774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015914e-3bd3-4431-a9fa-7a9635b1c7dd None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:21.182774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3015914e-3bd3-4431-a9fa-7a9635b1c7dd None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:21.182774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015914e-3bd3-4431-a9fa-7a9635b1c7dd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:21.182774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015914e-3bd3-4431-a9fa-7a9635b1c7dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:21.183513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3015914e-3bd3-4431-a9fa-7a9635b1c7dd None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:21.200428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 613/1227] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Jun 23 10:53:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:53:21.206161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a530ab-9451-4801-ab61-880375fa2685 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:21.307135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a530ab-9451-4801-ab61-880375fa2685 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:21.341355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d8292-8217-476d-b620-53fb6ff20816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:21.342394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d8292-8217-476d-b620-53fb6ff20816 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:21.342679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d8292-8217-476d-b620-53fb6ff20816 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:21.342957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d8292-8217-476d-b620-53fb6ff20816 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:21.353099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d8292-8217-476d-b620-53fb6ff20816 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:21.355079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d8292-8217-476d-b620-53fb6ff20816 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-828d8292-8217-476d-b620-53fb6ff20816 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:21.372699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:21.374416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:21.376148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:21.376148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:21.376148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:21.376148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:21.376148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 615/1228] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:21.380061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015914e-3bd3-4431-a9fa-7a9635b1c7dd None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:21.484210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3015914e-3bd3-4431-a9fa-7a9635b1c7dd None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:21.486520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:21.516728 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a978a80-5f7e-40e2-9643-e9c392bcd8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:21.517376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a978a80-5f7e-40e2-9643-e9c392bcd8f8 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:21.517654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a978a80-5f7e-40e2-9643-e9c392bcd8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:21.517922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a978a80-5f7e-40e2-9643-e9c392bcd8f8 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:21.518626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a978a80-5f7e-40e2-9643-e9c392bcd8f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:21.518927 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a978a80-5f7e-40e2-9643-e9c392bcd8f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:21.520314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a978a80-5f7e-40e2-9643-e9c392bcd8f8 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:21.532972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 614/1229] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:21.537628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d8292-8217-476d-b620-53fb6ff20816 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:21.547073 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:21.638529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d8292-8217-476d-b620-53fb6ff20816 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:21.671703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc74ef-c6e8-4cf5-b04e-56e0da917269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:21.672518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc74ef-c6e8-4cf5-b04e-56e0da917269 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:21.672812 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc74ef-c6e8-4cf5-b04e-56e0da917269 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:21.673064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dc74ef-c6e8-4cf5-b04e-56e0da917269 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:21.679797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc74ef-c6e8-4cf5-b04e-56e0da917269 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:21.681303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dc74ef-c6e8-4cf5-b04e-56e0da917269 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-b9dc74ef-c6e8-4cf5-b04e-56e0da917269 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:53:21.694600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:21.695665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:21.697315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:53:21.697315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:53:21.697315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:53:21.697315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:53:21.697315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:53:21.697315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:53:21.697315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:53:21.697315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:21.697315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 616/1230] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:53:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:21.702370 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a978a80-5f7e-40e2-9643-e9c392bcd8f8 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:21.808956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a978a80-5f7e-40e2-9643-e9c392bcd8f8 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:21.842891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd8ed93-fd25-4a6f-a8f2-e72f12721627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:21.843478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8ed93-fd25-4a6f-a8f2-e72f12721627 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:21.843761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8ed93-fd25-4a6f-a8f2-e72f12721627 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:21.844065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd8ed93-fd25-4a6f-a8f2-e72f12721627 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:21.844840 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8ed93-fd25-4a6f-a8f2-e72f12721627 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:21.845153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8ed93-fd25-4a6f-a8f2-e72f12721627 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:21.846584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd8ed93-fd25-4a6f-a8f2-e72f12721627 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:21.858474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 615/1231] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:53:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:21.865579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc74ef-c6e8-4cf5-b04e-56e0da917269 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:21.931910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:21.967387 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dc74ef-c6e8-4cf5-b04e-56e0da917269 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:22.000548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719152e-9903-4aef-9b5d-6efe8fae6dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:22.001433 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719152e-9903-4aef-9b5d-6efe8fae6dc9 None admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:22.001716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719152e-9903-4aef-9b5d-6efe8fae6dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:22.001996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719152e-9903-4aef-9b5d-6efe8fae6dc9 None admin] PATH_INFO: `/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/e838dd9aa24f4571b64719125610c528/roles/c14c06359c8649ceaef626fadcc1fc3a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:22.016460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719152e-9903-4aef-9b5d-6efe8fae6dc9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27530ca8f8e4156a519c726bd98c2a0, user_id=e838dd9aa24f4571b64719125610c528, role_id=c14c06359c8649ceaef626fadcc1fc3a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:22.017907 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719152e-9903-4aef-9b5d-6efe8fae6dc9 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:22.122300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 617/1232] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:53:21 2022] PUT /identity/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/e838dd9aa24f4571b64719125610c528/roles/c14c06359c8649ceaef626fadcc1fc3a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:53:24.136054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fc9b2-498e-4ff9-99e7-8a2fbfb912e6 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:24.136594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fc9b2-498e-4ff9-99e7-8a2fbfb912e6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:24.136594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761fc9b2-498e-4ff9-99e7-8a2fbfb912e6 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:24.137994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 616/1233] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:53:24.143462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af8991-5f86-4f3b-93e7-9e37b066c4d7 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:24.143887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af8991-5f86-4f3b-93e7-9e37b066c4d7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:24.144124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4af8991-5f86-4f3b-93e7-9e37b066c4d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:24.160545 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b4af8991-5f86-4f3b-93e7-9e37b066c4d7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:24.161789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b4af8991-5f86-4f3b-93e7-9e37b066c4d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:24.230233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 618/1234] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:53:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:53:24.254270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fc9b2-498e-4ff9-99e7-8a2fbfb912e6 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:24.279639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:24.355276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761fc9b2-498e-4ff9-99e7-8a2fbfb912e6 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:24.390687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51c259-56bf-4915-9357-dbdc78b9fbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:24.391424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51c259-56bf-4915-9357-dbdc78b9fbce None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:24.391708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51c259-56bf-4915-9357-dbdc78b9fbce None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:24.392014 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51c259-56bf-4915-9357-dbdc78b9fbce None admin] PATH_INFO: `/v3/roles/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:24.403337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51c259-56bf-4915-9357-dbdc78b9fbce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-fa51c259-56bf-4915-9357-dbdc78b9fbce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:53:24.411189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:24.412358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:24.413377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 617/1235] 10.222.0.52 () {56 vars in 1102 bytes} [Thu Jun 23 10:53:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:24.419383 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af8991-5f86-4f3b-93e7-9e37b066c4d7 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:24.467419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:24.522125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4af8991-5f86-4f3b-93e7-9e37b066c4d7 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:24.568077 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5db82b-04eb-450e-846e-4fd38afefc5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:24.568909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5db82b-04eb-450e-846e-4fd38afefc5d None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:24.569208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5db82b-04eb-450e-846e-4fd38afefc5d None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:24.569486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5db82b-04eb-450e-846e-4fd38afefc5d None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:24.570243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5db82b-04eb-450e-846e-4fd38afefc5d None admin] RBAC: Adding query filter params (name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:24.570554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5db82b-04eb-450e-846e-4fd38afefc5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:24.572105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5db82b-04eb-450e-846e-4fd38afefc5d None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:24.581386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 619/1236] 10.222.0.52 () {56 vars in 1103 bytes} [Thu Jun 23 10:53:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:24.587995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51c259-56bf-4915-9357-dbdc78b9fbce None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:24.677152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:24.692743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51c259-56bf-4915-9357-dbdc78b9fbce None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:24.726514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f093915-e1db-4137-928f-3df933b8bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:24.727296 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f093915-e1db-4137-928f-3df933b8bb83 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:24.727576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f093915-e1db-4137-928f-3df933b8bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:24.728425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f093915-e1db-4137-928f-3df933b8bb83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:24.739038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f093915-e1db-4137-928f-3df933b8bb83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:24.740514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f093915-e1db-4137-928f-3df933b8bb83 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-3f093915-e1db-4137-928f-3df933b8bb83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:24.757878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:24.758982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:24.760103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:24.760103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:24.760103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:24.760103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:24.760103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 618/1237] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:24.765428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5db82b-04eb-450e-846e-4fd38afefc5d None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:24.866717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5db82b-04eb-450e-846e-4fd38afefc5d None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:24.876619 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:24.900455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b7e68-9e13-465d-b0b5-057c57053c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:24.901126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b7e68-9e13-465d-b0b5-057c57053c99 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:24.901412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b7e68-9e13-465d-b0b5-057c57053c99 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:24.918529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b7e68-9e13-465d-b0b5-057c57053c99 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:24.918529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b7e68-9e13-465d-b0b5-057c57053c99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:24.918529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b7e68-9e13-465d-b0b5-057c57053c99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:24.918529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58b7e68-9e13-465d-b0b5-057c57053c99 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:24.918529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 620/1238] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:24.922093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f093915-e1db-4137-928f-3df933b8bb83 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:25.029577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f093915-e1db-4137-928f-3df933b8bb83 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:25.063428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1b38a-2aaa-4f51-a2c5-a654089a84f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:25.064255 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1b38a-2aaa-4f51-a2c5-a654089a84f1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:25.064539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1b38a-2aaa-4f51-a2c5-a654089a84f1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:25.064813 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1b38a-2aaa-4f51-a2c5-a654089a84f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:25.067549 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:25.072655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1b38a-2aaa-4f51-a2c5-a654089a84f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:25.074117 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1b38a-2aaa-4f51-a2c5-a654089a84f1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-f5a1b38a-2aaa-4f51-a2c5-a654089a84f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:53:25.089359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:25.090562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:25.092044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:25.092044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:25.092044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:53:25.092044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:53:25.092044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:53:25.092044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:53:25.092044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:53:25.092044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:53:25.092044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:53:25.092044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:25.092044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 619/1239] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:25.096879 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b7e68-9e13-465d-b0b5-057c57053c99 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:25.197698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b7e68-9e13-465d-b0b5-057c57053c99 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:25.232529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c57b9-f3dc-4929-a490-b9bb1d1abf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:25.233198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c57b9-f3dc-4929-a490-b9bb1d1abf5c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:25.233484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c57b9-f3dc-4929-a490-b9bb1d1abf5c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:25.233763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c57b9-f3dc-4929-a490-b9bb1d1abf5c None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:25.234598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c57b9-f3dc-4929-a490-b9bb1d1abf5c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:25.234904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c57b9-f3dc-4929-a490-b9bb1d1abf5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:25.236386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c57b9-f3dc-4929-a490-b9bb1d1abf5c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:25.254253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 621/1240] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Jun 23 10:53:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:25.260652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1b38a-2aaa-4f51-a2c5-a654089a84f1 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:25.365568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1b38a-2aaa-4f51-a2c5-a654089a84f1 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:25.404990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b53f2-0e93-414b-affa-db7b652da288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:25.405638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b53f2-0e93-414b-affa-db7b652da288 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:25.405917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b53f2-0e93-414b-affa-db7b652da288 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:25.406192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74b53f2-0e93-414b-affa-db7b652da288 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:25.470234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:25.477084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b53f2-0e93-414b-affa-db7b652da288 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:25.479159 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74b53f2-0e93-414b-affa-db7b652da288 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:25.604769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 620/1241] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:53:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 23 10:53:25.611443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c57b9-f3dc-4929-a490-b9bb1d1abf5c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:25.642005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:25.717809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c57b9-f3dc-4929-a490-b9bb1d1abf5c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:25.753267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0e61a-ada1-4ea7-a598-4cd7f850e175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:25.754063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0e61a-ada1-4ea7-a598-4cd7f850e175 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:25.754345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0e61a-ada1-4ea7-a598-4cd7f850e175 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:25.754624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa0e61a-ada1-4ea7-a598-4cd7f850e175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:25.766160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0e61a-ada1-4ea7-a598-4cd7f850e175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:25.767749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa0e61a-ada1-4ea7-a598-4cd7f850e175 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-efa0e61a-ada1-4ea7-a598-4cd7f850e175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:25.789385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:25.791095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:25.792275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:25.792275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:25.792275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:25.792275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:25.792275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 622/1242] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:25.794288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b53f2-0e93-414b-affa-db7b652da288 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:25.897409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:25.903751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74b53f2-0e93-414b-affa-db7b652da288 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:25.946140 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac143c-d884-4442-b841-fc9f503e7322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:25.946815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac143c-d884-4442-b841-fc9f503e7322 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:25.947100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac143c-d884-4442-b841-fc9f503e7322 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:25.947381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ac143c-d884-4442-b841-fc9f503e7322 None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:25.948139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac143c-d884-4442-b841-fc9f503e7322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:25.948443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac143c-d884-4442-b841-fc9f503e7322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:25.949872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ac143c-d884-4442-b841-fc9f503e7322 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:25.961510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 621/1243] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:25.968486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0e61a-ada1-4ea7-a598-4cd7f850e175 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:26.066520 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:26.094620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa0e61a-ada1-4ea7-a598-4cd7f850e175 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:26.133199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9430e3f-f411-451b-ae89-1476e5980f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:26.134563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430e3f-f411-451b-ae89-1476e5980f17 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:26.135102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430e3f-f411-451b-ae89-1476e5980f17 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:26.135558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9430e3f-f411-451b-ae89-1476e5980f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:26.145030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9430e3f-f411-451b-ae89-1476e5980f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:26.146476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9430e3f-f411-451b-ae89-1476e5980f17 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-e9430e3f-f411-451b-ae89-1476e5980f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:53:26.161015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:26.162081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:26.170569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:53:26.170569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:53:26.170569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:53:26.170569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:53:26.170569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:53:26.170569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:53:26.170569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:53:26.170569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:26.170569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 623/1244] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:53:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:26.171073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac143c-d884-4442-b841-fc9f503e7322 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:26.284064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ac143c-d884-4442-b841-fc9f503e7322 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:26.319173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6b66b-b607-4684-bda1-3088573b7533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:26.319857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6b66b-b607-4684-bda1-3088573b7533 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:26.320137 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6b66b-b607-4684-bda1-3088573b7533 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:26.320408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6b66b-b607-4684-bda1-3088573b7533 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:26.321224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6b66b-b607-4684-bda1-3088573b7533 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:26.322079 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6b66b-b607-4684-bda1-3088573b7533 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:26.323497 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6b66b-b607-4684-bda1-3088573b7533 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:26.335352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 622/1245] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:53:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:26.342289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9430e3f-f411-451b-ae89-1476e5980f17 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:26.443240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9430e3f-f411-451b-ae89-1476e5980f17 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:26.477938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa83c7b1-5707-4fb9-92a2-409ebfd9830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:26.478587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83c7b1-5707-4fb9-92a2-409ebfd9830f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:26.478871 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83c7b1-5707-4fb9-92a2-409ebfd9830f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:26.479150 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa83c7b1-5707-4fb9-92a2-409ebfd9830f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:26.480004 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83c7b1-5707-4fb9-92a2-409ebfd9830f None admin] RBAC: Adding query filter params (role.id=c14c06359c8649ceaef626fadcc1fc3a, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=e838dd9aa24f4571b64719125610c528) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:26.480315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83c7b1-5707-4fb9-92a2-409ebfd9830f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:26.481753 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa83c7b1-5707-4fb9-92a2-409ebfd9830f None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:26.487584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 624/1246] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:53:26 2022] GET /identity/v3/role_assignments?user.id=e838dd9aa24f4571b64719125610c528&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=c14c06359c8649ceaef626fadcc1fc3a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:28.590217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35987d1-28bc-4959-86b0-e5348882cb3a None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:28.590629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35987d1-28bc-4959-86b0-e5348882cb3a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:28.590779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35987d1-28bc-4959-86b0-e5348882cb3a None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:28.592494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 623/1247] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:53:28.597804 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04abcdc-6b05-4f0f-932c-6249e9c83272 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:28.598178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04abcdc-6b05-4f0f-932c-6249e9c83272 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:28.598369 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04abcdc-6b05-4f0f-932c-6249e9c83272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:28.603929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:28.623147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b04abcdc-6b05-4f0f-932c-6249e9c83272 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:28.624409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b04abcdc-6b05-4f0f-932c-6249e9c83272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:28.691662 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 625/1248] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:53:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:53:28.716866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35987d1-28bc-4959-86b0-e5348882cb3a None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:28.735301 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:28.818516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35987d1-28bc-4959-86b0-e5348882cb3a None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:28.852688 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc0b9b-5d7d-44fe-8daa-345efc5d4146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:28.853414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc0b9b-5d7d-44fe-8daa-345efc5d4146 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:28.853699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc0b9b-5d7d-44fe-8daa-345efc5d4146 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:28.853978 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc0b9b-5d7d-44fe-8daa-345efc5d4146 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:28.864115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc0b9b-5d7d-44fe-8daa-345efc5d4146 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-01dc0b9b-5d7d-44fe-8daa-345efc5d4146 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:53:28.872372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:28.873490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:28.874527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 624/1249] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:53:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:28.879688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04abcdc-6b05-4f0f-932c-6249e9c83272 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:28.978613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04abcdc-6b05-4f0f-932c-6249e9c83272 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:29.008263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:29.013644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bf089-1ece-46e4-9132-7c095f45c120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:29.014305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bf089-1ece-46e4-9132-7c095f45c120 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:29.014583 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bf089-1ece-46e4-9132-7c095f45c120 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:29.014855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bf089-1ece-46e4-9132-7c095f45c120 None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:29.015586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bf089-1ece-46e4-9132-7c095f45c120 None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:29.015921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bf089-1ece-46e4-9132-7c095f45c120 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:29.017284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bf089-1ece-46e4-9132-7c095f45c120 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:29.025229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 626/1250] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:53:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:29.031324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc0b9b-5d7d-44fe-8daa-345efc5d4146 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:29.109515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:29.131389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc0b9b-5d7d-44fe-8daa-345efc5d4146 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:29.165760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e624f57-1e62-4502-8d85-a5dc03a6352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:29.166538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e624f57-1e62-4502-8d85-a5dc03a6352a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:29.166822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e624f57-1e62-4502-8d85-a5dc03a6352a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:29.167121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e624f57-1e62-4502-8d85-a5dc03a6352a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:29.177962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e624f57-1e62-4502-8d85-a5dc03a6352a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:29.179452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e624f57-1e62-4502-8d85-a5dc03a6352a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-3e624f57-1e62-4502-8d85-a5dc03a6352a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:29.196326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:29.197886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:29.199076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:29.199076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:29.199076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:29.199076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:29.200140 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 625/1251] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:29.203712 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bf089-1ece-46e4-9132-7c095f45c120 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:29.304431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bf089-1ece-46e4-9132-7c095f45c120 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:29.338426 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9b9b5-d2c6-4a74-9e0b-391fd3b0ecc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:29.339085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9b9b5-d2c6-4a74-9e0b-391fd3b0ecc3 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:29.339370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9b9b5-d2c6-4a74-9e0b-391fd3b0ecc3 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:29.339859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d9b9b5-d2c6-4a74-9e0b-391fd3b0ecc3 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:29.340549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9b9b5-d2c6-4a74-9e0b-391fd3b0ecc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:29.340859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9b9b5-d2c6-4a74-9e0b-391fd3b0ecc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:29.342487 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d9b9b5-d2c6-4a74-9e0b-391fd3b0ecc3 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:29.354278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 627/1252] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:29.360016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e624f57-1e62-4502-8d85-a5dc03a6352a None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:29.460154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e624f57-1e62-4502-8d85-a5dc03a6352a None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:29.487836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:29.496056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32f464-464e-470d-a0c7-00434d6ab5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:29.499938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32f464-464e-470d-a0c7-00434d6ab5f6 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:29.499938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32f464-464e-470d-a0c7-00434d6ab5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:29.499938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32f464-464e-470d-a0c7-00434d6ab5f6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:29.505032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32f464-464e-470d-a0c7-00434d6ab5f6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:29.506471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32f464-464e-470d-a0c7-00434d6ab5f6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-ac32f464-464e-470d-a0c7-00434d6ab5f6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:53:29.520973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:29.522061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:29.523202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:29.523202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:29.523202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:53:29.523202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:53:29.523202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:53:29.523202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:53:29.523202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:53:29.523202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:53:29.523202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:53:29.523202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:29.523202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 626/1253] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:29.528286 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9b9b5-d2c6-4a74-9e0b-391fd3b0ecc3 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:29.587039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:29.631773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d9b9b5-d2c6-4a74-9e0b-391fd3b0ecc3 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:29.666214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64541d5e-2e78-4fbc-9066-3e37f3ff582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:29.666875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64541d5e-2e78-4fbc-9066-3e37f3ff582c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:29.667159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64541d5e-2e78-4fbc-9066-3e37f3ff582c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:29.667438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64541d5e-2e78-4fbc-9066-3e37f3ff582c None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:29.668305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64541d5e-2e78-4fbc-9066-3e37f3ff582c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:29.668616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64541d5e-2e78-4fbc-9066-3e37f3ff582c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:29.670044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64541d5e-2e78-4fbc-9066-3e37f3ff582c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:29.687507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 628/1254] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Jun 23 10:53:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:29.693616 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32f464-464e-470d-a0c7-00434d6ab5f6 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:29.796763 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32f464-464e-470d-a0c7-00434d6ab5f6 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:29.830566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b020a-6030-4224-b87e-065ccb905066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:29.831215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b020a-6030-4224-b87e-065ccb905066 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:29.831495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b020a-6030-4224-b87e-065ccb905066 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:29.831768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3b020a-6030-4224-b87e-065ccb905066 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:29.889187 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:29.901104 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b020a-6030-4224-b87e-065ccb905066 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:29.902563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3b020a-6030-4224-b87e-065ccb905066 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:30.000515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 627/1255] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:53:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:53:30.006358 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64541d5e-2e78-4fbc-9066-3e37f3ff582c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:30.106542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64541d5e-2e78-4fbc-9066-3e37f3ff582c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:30.120289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:30.141838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3111a3b-5831-46e0-8f91-a89cc1340acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:30.142541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111a3b-5831-46e0-8f91-a89cc1340acb None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:30.142825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111a3b-5831-46e0-8f91-a89cc1340acb None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:30.143096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3111a3b-5831-46e0-8f91-a89cc1340acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:30.153317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3111a3b-5831-46e0-8f91-a89cc1340acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:30.154769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3111a3b-5831-46e0-8f91-a89cc1340acb None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-b3111a3b-5831-46e0-8f91-a89cc1340acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:30.172276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:30.173313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:30.174572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:30.174572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:30.174572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:30.174572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:30.174572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 629/1256] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:30.179326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b020a-6030-4224-b87e-065ccb905066 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:30.265949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:30.277825 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3b020a-6030-4224-b87e-065ccb905066 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:30.310953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b50d6-590c-4581-8bde-b4d215952d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:30.311625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b50d6-590c-4581-8bde-b4d215952d2e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:30.311937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b50d6-590c-4581-8bde-b4d215952d2e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:30.312215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221b50d6-590c-4581-8bde-b4d215952d2e None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:30.312927 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b50d6-590c-4581-8bde-b4d215952d2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:30.313233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b50d6-590c-4581-8bde-b4d215952d2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:30.314598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221b50d6-590c-4581-8bde-b4d215952d2e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:30.325490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 628/1257] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:30.331392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3111a3b-5831-46e0-8f91-a89cc1340acb None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:30.432873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3111a3b-5831-46e0-8f91-a89cc1340acb None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:30.467364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008a927-6aba-4675-8b5f-ad2f35d1587a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:30.468169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a927-6aba-4675-8b5f-ad2f35d1587a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:30.468450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a927-6aba-4675-8b5f-ad2f35d1587a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:30.468723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0008a927-6aba-4675-8b5f-ad2f35d1587a None admin] PATH_INFO: `/v3/projects/service` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:30.475565 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008a927-6aba-4675-8b5f-ad2f35d1587a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:30.477054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0008a927-6aba-4675-8b5f-ad2f35d1587a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-0008a927-6aba-4675-8b5f-ad2f35d1587a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:53:30.491246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:30.492329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:30.493456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:53:30.493456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:53:30.493456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:53:30.493456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:53:30.493456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:53:30.493456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:53:30.493456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:53:30.493456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:30.493456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 630/1258] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:53:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:30.498328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b50d6-590c-4581-8bde-b4d215952d2e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:30.671307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221b50d6-590c-4581-8bde-b4d215952d2e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:30.671307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c82561-4a7c-4877-acb0-6988af4bf695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:30.671307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c82561-4a7c-4877-acb0-6988af4bf695 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:30.671307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c82561-4a7c-4877-acb0-6988af4bf695 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:30.671781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c82561-4a7c-4877-acb0-6988af4bf695 None admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:30.671781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c82561-4a7c-4877-acb0-6988af4bf695 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:30.671781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c82561-4a7c-4877-acb0-6988af4bf695 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:30.671781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c82561-4a7c-4877-acb0-6988af4bf695 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:30.671781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 629/1259] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:53:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:30.672234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008a927-6aba-4675-8b5f-ad2f35d1587a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:30.682613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:30.758094 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0008a927-6aba-4675-8b5f-ad2f35d1587a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:30.796521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533b4db4-adea-424f-b9bf-eb1f78caec2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:30.797225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b4db4-adea-424f-b9bf-eb1f78caec2b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:30.797515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b4db4-adea-424f-b9bf-eb1f78caec2b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:30.797795 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533b4db4-adea-424f-b9bf-eb1f78caec2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:30.798630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b4db4-adea-424f-b9bf-eb1f78caec2b None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=e838dd9aa24f4571b64719125610c528) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:30.798942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b4db4-adea-424f-b9bf-eb1f78caec2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:30.800420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533b4db4-adea-424f-b9bf-eb1f78caec2b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:30.805982 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 631/1260] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:53:30 2022] GET /identity/v3/role_assignments?user.id=e838dd9aa24f4571b64719125610c528&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:53:32.821816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46bf10-c122-4ab2-ae06-5df848c03ecd None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:32.822398 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46bf10-c122-4ab2-ae06-5df848c03ecd None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:32.822398 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc46bf10-c122-4ab2-ae06-5df848c03ecd None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:32.823801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 630/1261] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:53:32.829013 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dd87e-84a3-4fe8-86aa-4b9c4dff856f None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:32.829440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dd87e-84a3-4fe8-86aa-4b9c4dff856f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:32.829641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4dd87e-84a3-4fe8-86aa-4b9c4dff856f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:32.846454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ab4dd87e-84a3-4fe8-86aa-4b9c4dff856f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:32.847653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ab4dd87e-84a3-4fe8-86aa-4b9c4dff856f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:32.914881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 632/1262] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:53:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:53:32.938148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46bf10-c122-4ab2-ae06-5df848c03ecd None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:32.949041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:33.041603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc46bf10-c122-4ab2-ae06-5df848c03ecd None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:33.074959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba16dd-c714-4bee-9e3b-956f4326ef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:33.075738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba16dd-c714-4bee-9e3b-956f4326ef81 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:33.076053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba16dd-c714-4bee-9e3b-956f4326ef81 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:33.076331 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba16dd-c714-4bee-9e3b-956f4326ef81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:33.086365 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba16dd-c714-4bee-9e3b-956f4326ef81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-16ba16dd-c714-4bee-9e3b-956f4326ef81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:53:33.094891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:33.096118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:33.097074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 631/1263] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:53:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:33.102317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dd87e-84a3-4fe8-86aa-4b9c4dff856f None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:33.121637 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:33.203139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4dd87e-84a3-4fe8-86aa-4b9c4dff856f None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:33.237061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b67d53-8379-4a63-a5dc-7168d6c7ee8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:33.237727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b67d53-8379-4a63-a5dc-7168d6c7ee8b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:33.238006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b67d53-8379-4a63-a5dc-7168d6c7ee8b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:33.238287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b67d53-8379-4a63-a5dc-7168d6c7ee8b None admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:33.239026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b67d53-8379-4a63-a5dc-7168d6c7ee8b None admin] RBAC: Adding query filter params (name=admin) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:33.239333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b67d53-8379-4a63-a5dc-7168d6c7ee8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:33.240742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b67d53-8379-4a63-a5dc-7168d6c7ee8b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:33.248866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 633/1264] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:53:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:33.254744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba16dd-c714-4bee-9e3b-956f4326ef81 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:33.321172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:33.356183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba16dd-c714-4bee-9e3b-956f4326ef81 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:33.390139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57995d2-973b-4441-ae3a-527f84eec169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:33.391000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57995d2-973b-4441-ae3a-527f84eec169 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:33.391281 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57995d2-973b-4441-ae3a-527f84eec169 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:33.391545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57995d2-973b-4441-ae3a-527f84eec169 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:33.402627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57995d2-973b-4441-ae3a-527f84eec169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:33.408843 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57995d2-973b-4441-ae3a-527f84eec169 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-e57995d2-973b-4441-ae3a-527f84eec169 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:33.422131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:33.423317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:33.427223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:33.427223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:33.427223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:33.427223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:33.427223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 632/1265] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:33.429152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b67d53-8379-4a63-a5dc-7168d6c7ee8b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:33.511649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:33.530826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b67d53-8379-4a63-a5dc-7168d6c7ee8b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:33.564622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fc011-8dc4-4ee1-8f81-41f89f7cccd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:33.565280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fc011-8dc4-4ee1-8f81-41f89f7cccd0 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:33.565609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fc011-8dc4-4ee1-8f81-41f89f7cccd0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:33.565893 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fc011-8dc4-4ee1-8f81-41f89f7cccd0 None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:33.566698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fc011-8dc4-4ee1-8f81-41f89f7cccd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:33.566919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fc011-8dc4-4ee1-8f81-41f89f7cccd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:33.568328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fc011-8dc4-4ee1-8f81-41f89f7cccd0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:33.580288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 634/1266] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:33.586159 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57995d2-973b-4441-ae3a-527f84eec169 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:33.687396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57995d2-973b-4441-ae3a-527f84eec169 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:33.706353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:33.720025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969914e-4bf2-4be4-af45-9bd2f70aa2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:33.720815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969914e-4bf2-4be4-af45-9bd2f70aa2e6 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:33.721091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969914e-4bf2-4be4-af45-9bd2f70aa2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:33.721360 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969914e-4bf2-4be4-af45-9bd2f70aa2e6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:33.729166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969914e-4bf2-4be4-af45-9bd2f70aa2e6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:33.730593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969914e-4bf2-4be4-af45-9bd2f70aa2e6 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-3969914e-4bf2-4be4-af45-9bd2f70aa2e6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:53:33.745024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:33.746153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:33.747318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:33.747318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:33.747318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:53:33.747318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:53:33.747318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:53:33.747318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:53:33.747318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:53:33.747318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:53:33.747318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:53:33.747318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:33.747318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 633/1267] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:33.752083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fc011-8dc4-4ee1-8f81-41f89f7cccd0 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:33.852053 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fc011-8dc4-4ee1-8f81-41f89f7cccd0 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:33.886745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378020fd-fc1d-4384-bd59-d9b53af7746f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:33.887410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378020fd-fc1d-4384-bd59-d9b53af7746f None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:33.889646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378020fd-fc1d-4384-bd59-d9b53af7746f None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:33.889646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378020fd-fc1d-4384-bd59-d9b53af7746f None admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:33.889646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378020fd-fc1d-4384-bd59-d9b53af7746f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:33.889646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378020fd-fc1d-4384-bd59-d9b53af7746f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:33.890507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378020fd-fc1d-4384-bd59-d9b53af7746f None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:33.899251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:33.908213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 635/1268] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Jun 23 10:53:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:33.913789 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969914e-4bf2-4be4-af45-9bd2f70aa2e6 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:34.013035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969914e-4bf2-4be4-af45-9bd2f70aa2e6 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:34.048307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ca320-d90a-4242-98a2-69147a1f39c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:34.049091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ca320-d90a-4242-98a2-69147a1f39c2 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:34.049372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ca320-d90a-4242-98a2-69147a1f39c2 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:34.049649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2ca320-d90a-4242-98a2-69147a1f39c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:34.060436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ca320-d90a-4242-98a2-69147a1f39c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:34.061891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2ca320-d90a-4242-98a2-69147a1f39c2 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-da2ca320-d90a-4242-98a2-69147a1f39c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:34.078631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:34.079835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:34.081010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:34.081010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:34.081010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:34.081010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:34.081010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 634/1269] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:34.085622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378020fd-fc1d-4384-bd59-d9b53af7746f None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:34.189776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378020fd-fc1d-4384-bd59-d9b53af7746f None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:34.224983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa73dd-dab9-407e-977e-4c137244303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:34.225675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa73dd-dab9-407e-977e-4c137244303c None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:34.225958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa73dd-dab9-407e-977e-4c137244303c None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:34.226233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa73dd-dab9-407e-977e-4c137244303c None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:34.226945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa73dd-dab9-407e-977e-4c137244303c None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:34.227249 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa73dd-dab9-407e-977e-4c137244303c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:34.228675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa73dd-dab9-407e-977e-4c137244303c None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:34.239850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 636/1270] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:34.245521 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ca320-d90a-4242-98a2-69147a1f39c2 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:34.277659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:34.344363 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2ca320-d90a-4242-98a2-69147a1f39c2 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:34.376876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874ff46-59d7-4b3b-a43e-408c58514164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:34.377656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ff46-59d7-4b3b-a43e-408c58514164 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:34.377940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ff46-59d7-4b3b-a43e-408c58514164 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:34.378219 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1874ff46-59d7-4b3b-a43e-408c58514164 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:34.385273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874ff46-59d7-4b3b-a43e-408c58514164 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:34.386721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1874ff46-59d7-4b3b-a43e-408c58514164 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-1874ff46-59d7-4b3b-a43e-408c58514164 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:53:34.401229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:34.406300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:34.407426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:53:34.407426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:53:34.407426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:53:34.407426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:53:34.407426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:53:34.407426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:53:34.407426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:53:34.407426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:34.407426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 635/1271] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:34.408754 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa73dd-dab9-407e-977e-4c137244303c None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:34.469431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:34.515060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa73dd-dab9-407e-977e-4c137244303c None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:34.547544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a62868a-d4b9-43d9-9c81-ca74a45b1779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:34.548156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62868a-d4b9-43d9-9c81-ca74a45b1779 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:34.548439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62868a-d4b9-43d9-9c81-ca74a45b1779 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:34.548721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a62868a-d4b9-43d9-9c81-ca74a45b1779 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:34.549516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62868a-d4b9-43d9-9c81-ca74a45b1779 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:34.549827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62868a-d4b9-43d9-9c81-ca74a45b1779 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:34.551307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a62868a-d4b9-43d9-9c81-ca74a45b1779 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:34.563766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 637/1272] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:34.569868 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874ff46-59d7-4b3b-a43e-408c58514164 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:34.666471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:34.675028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1874ff46-59d7-4b3b-a43e-408c58514164 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:34.713734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270a8637-067c-490b-8a46-a1208c7ee556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:34.714614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a8637-067c-490b-8a46-a1208c7ee556 None admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:34.714890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a8637-067c-490b-8a46-a1208c7ee556 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:34.715176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270a8637-067c-490b-8a46-a1208c7ee556 None admin] PATH_INFO: `/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/e838dd9aa24f4571b64719125610c528/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:34.717412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a8637-067c-490b-8a46-a1208c7ee556 None admin] RBAC: Authorizing `identity:create_grant(project_id=d27530ca8f8e4156a519c726bd98c2a0, user_id=e838dd9aa24f4571b64719125610c528, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:34.718851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270a8637-067c-490b-8a46-a1208c7ee556 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:34.832738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 636/1273] 10.222.0.52 () {58 vars in 1439 bytes} [Thu Jun 23 10:53:34 2022] PUT /identity/v3/projects/d27530ca8f8e4156a519c726bd98c2a0/users/e838dd9aa24f4571b64719125610c528/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 10:53:36.875466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817637d-fe9d-4f83-b95c-766dff7ca583 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:36.875998 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817637d-fe9d-4f83-b95c-766dff7ca583 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:36.875998 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3817637d-fe9d-4f83-b95c-766dff7ca583 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:36.877335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 638/1274] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:53:36.882582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f9d4-f43a-4e17-a0be-ff74a77e9098 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:36.882989 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f9d4-f43a-4e17-a0be-ff74a77e9098 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:36.883142 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b478f9d4-f43a-4e17-a0be-ff74a77e9098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:36.899764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b478f9d4-f43a-4e17-a0be-ff74a77e9098 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:36.901001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b478f9d4-f43a-4e17-a0be-ff74a77e9098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:36.970235 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 637/1275] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:53:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:53:36.994561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817637d-fe9d-4f83-b95c-766dff7ca583 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:37.097039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3817637d-fe9d-4f83-b95c-766dff7ca583 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:37.113902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:37.130522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d08d87-9fae-434a-b07c-417b108eb01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:37.131251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d08d87-9fae-434a-b07c-417b108eb01a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:37.131535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d08d87-9fae-434a-b07c-417b108eb01a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:37.131831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d08d87-9fae-434a-b07c-417b108eb01a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:37.142281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d08d87-9fae-434a-b07c-417b108eb01a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-33d08d87-9fae-434a-b07c-417b108eb01a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 23 10:53:37.149944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:37.151058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:37.152111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 639/1276] 10.222.0.52 () {56 vars in 1096 bytes} [Thu Jun 23 10:53:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:37.157189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f9d4-f43a-4e17-a0be-ff74a77e9098 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:37.241203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:37.259841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b478f9d4-f43a-4e17-a0be-ff74a77e9098 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:37.293174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac704f-57d2-4e24-aadc-6e1e715ca96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:37.293866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac704f-57d2-4e24-aadc-6e1e715ca96a None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:37.294155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac704f-57d2-4e24-aadc-6e1e715ca96a None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:37.294434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ac704f-57d2-4e24-aadc-6e1e715ca96a None admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:37.295174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac704f-57d2-4e24-aadc-6e1e715ca96a None admin] RBAC: Adding query filter params (name=admin) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:37.295484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac704f-57d2-4e24-aadc-6e1e715ca96a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:37.296901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ac704f-57d2-4e24-aadc-6e1e715ca96a None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:37.305017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 638/1277] 10.222.0.52 () {56 vars in 1099 bytes} [Thu Jun 23 10:53:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:37.311504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d08d87-9fae-434a-b07c-417b108eb01a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:37.413118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d08d87-9fae-434a-b07c-417b108eb01a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:37.448068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88904547-5220-4d62-bba1-b8140dbed75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:37.451607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88904547-5220-4d62-bba1-b8140dbed75a None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:37.451607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88904547-5220-4d62-bba1-b8140dbed75a None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:37.451607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88904547-5220-4d62-bba1-b8140dbed75a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:37.459689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88904547-5220-4d62-bba1-b8140dbed75a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:37.461168 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88904547-5220-4d62-bba1-b8140dbed75a None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-88904547-5220-4d62-bba1-b8140dbed75a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:37.491501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:37.492738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:37.494624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:37.494624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:37.494624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:37.494624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:37.494624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 640/1278] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:37.499786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac704f-57d2-4e24-aadc-6e1e715ca96a None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:37.606300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ac704f-57d2-4e24-aadc-6e1e715ca96a None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:37.640258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3b282-d5fa-4bef-969a-ce6ab916838e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:37.640912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3b282-d5fa-4bef-969a-ce6ab916838e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:37.641196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3b282-d5fa-4bef-969a-ce6ab916838e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:37.641470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3b282-d5fa-4bef-969a-ce6ab916838e None admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:37.642180 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3b282-d5fa-4bef-969a-ce6ab916838e None admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:37.642485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3b282-d5fa-4bef-969a-ce6ab916838e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:37.643902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae3b282-d5fa-4bef-969a-ce6ab916838e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:37.655317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 639/1279] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:37.661091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88904547-5220-4d62-bba1-b8140dbed75a None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:37.691829 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:37.760986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88904547-5220-4d62-bba1-b8140dbed75a None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:37.793578 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd182a00-5166-451e-8351-7b83f672bdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:37.794364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd182a00-5166-451e-8351-7b83f672bdaf None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:37.794649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd182a00-5166-451e-8351-7b83f672bdaf None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:37.794924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd182a00-5166-451e-8351-7b83f672bdaf None admin] PATH_INFO: `/v3/users/placement` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:37.802284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd182a00-5166-451e-8351-7b83f672bdaf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:37.803728 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd182a00-5166-451e-8351-7b83f672bdaf None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-dd182a00-5166-451e-8351-7b83f672bdaf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 23 10:53:37.818892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:37.823555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:37.824844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:37.824844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:37.824844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 23 10:53:37.824844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 23 10:53:37.824844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 23 10:53:37.824844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 23 10:53:37.824844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 23 10:53:37.824844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 23 10:53:37.824844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 23 10:53:37.824844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:37.824844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 641/1280] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:37.827317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3b282-d5fa-4bef-969a-ce6ab916838e None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:37.831968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:37.925549 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3b282-d5fa-4bef-969a-ce6ab916838e None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:37.958713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba32855-e8a7-412e-8383-88276bfac776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:37.959367 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba32855-e8a7-412e-8383-88276bfac776 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:37.959647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba32855-e8a7-412e-8383-88276bfac776 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:37.959953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba32855-e8a7-412e-8383-88276bfac776 None admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:37.960783 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba32855-e8a7-412e-8383-88276bfac776 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:37.961089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba32855-e8a7-412e-8383-88276bfac776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:37.962644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba32855-e8a7-412e-8383-88276bfac776 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:37.981089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 640/1281] 10.222.0.52 () {56 vars in 1143 bytes} [Thu Jun 23 10:53:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:37.986865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd182a00-5166-451e-8351-7b83f672bdaf None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:38.077801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:38.087651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd182a00-5166-451e-8351-7b83f672bdaf None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:38.119933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ba8f0-066a-4734-b925-4b5199decbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:38.120572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ba8f0-066a-4734-b925-4b5199decbb0 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:38.120854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ba8f0-066a-4734-b925-4b5199decbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:38.121130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12ba8f0-066a-4734-b925-4b5199decbb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:38.188777 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ba8f0-066a-4734-b925-4b5199decbb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:38.190260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12ba8f0-066a-4734-b925-4b5199decbb0 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:38.278513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:38.288303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 642/1282] 10.222.0.52 () {58 vars in 1282 bytes} [Thu Jun 23 10:53:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 23 10:53:38.294242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba32855-e8a7-412e-8383-88276bfac776 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:38.356316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:38.394078 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba32855-e8a7-412e-8383-88276bfac776 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:38.428112 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed3765-a04f-4d93-80f2-f5a087dd4bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:38.428949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed3765-a04f-4d93-80f2-f5a087dd4bcf None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:38.429238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed3765-a04f-4d93-80f2-f5a087dd4bcf None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:38.429515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ed3765-a04f-4d93-80f2-f5a087dd4bcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:38.440075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed3765-a04f-4d93-80f2-f5a087dd4bcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:38.441529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ed3765-a04f-4d93-80f2-f5a087dd4bcf None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-e1ed3765-a04f-4d93-80f2-f5a087dd4bcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 23 10:53:38.459034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:38.460108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:38.461229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 23 10:53:38.461229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 23 10:53:38.461229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 23 10:53:38.461229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:38.461229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 641/1283] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 10:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:38.466066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ba8f0-066a-4734-b925-4b5199decbb0 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:38.563200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12ba8f0-066a-4734-b925-4b5199decbb0 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:38.598575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c93ed7-b24d-4330-805c-77e66145702b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:38.599238 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c93ed7-b24d-4330-805c-77e66145702b None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:38.599522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c93ed7-b24d-4330-805c-77e66145702b None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:38.599799 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c93ed7-b24d-4330-805c-77e66145702b None admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:38.600621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c93ed7-b24d-4330-805c-77e66145702b None admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:38.600925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c93ed7-b24d-4330-805c-77e66145702b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:38.602304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c93ed7-b24d-4330-805c-77e66145702b None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:38.614291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 643/1284] 10.222.0.52 () {56 vars in 1109 bytes} [Thu Jun 23 10:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:38.620536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed3765-a04f-4d93-80f2-f5a087dd4bcf None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:38.725560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ed3765-a04f-4d93-80f2-f5a087dd4bcf None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:38.745144 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:38.766052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a6de8-2415-45eb-b1c8-e7235b2e65f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:38.766802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a6de8-2415-45eb-b1c8-e7235b2e65f1 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:38.767086 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a6de8-2415-45eb-b1c8-e7235b2e65f1 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:38.767364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211a6de8-2415-45eb-b1c8-e7235b2e65f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:38.774393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a6de8-2415-45eb-b1c8-e7235b2e65f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:38.775873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211a6de8-2415-45eb-b1c8-e7235b2e65f1 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application [None req-211a6de8-2415-45eb-b1c8-e7235b2e65f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 23 10:53:38.789892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:38.791376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:38.792506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 23 10:53:38.792506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 23 10:53:38.792506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 23 10:53:38.792506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 23 10:53:38.792506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 23 10:53:38.792506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 23 10:53:38.792506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 23 10:53:38.792506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: ERROR keystone.server.flask.application Jun 23 10:53:38.792506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 642/1285] 10.222.0.52 () {56 vars in 1111 bytes} [Thu Jun 23 10:53:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:38.797486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c93ed7-b24d-4330-805c-77e66145702b None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:38.848984 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:38.906144 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c93ed7-b24d-4330-805c-77e66145702b None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:38.939888 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807d8275-2977-44d8-877c-4f145d3673b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:38.940539 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d8275-2977-44d8-877c-4f145d3673b9 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:38.940819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d8275-2977-44d8-877c-4f145d3673b9 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:38.941092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807d8275-2977-44d8-877c-4f145d3673b9 None admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:38.941861 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d8275-2977-44d8-877c-4f145d3673b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:38.942165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d8275-2977-44d8-877c-4f145d3673b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:38.943614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807d8275-2977-44d8-877c-4f145d3673b9 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:38.955121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 644/1286] 10.222.0.52 () {56 vars in 1148 bytes} [Thu Jun 23 10:53:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:38.961215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a6de8-2415-45eb-b1c8-e7235b2e65f1 None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:39.060959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211a6de8-2415-45eb-b1c8-e7235b2e65f1 None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:39.094909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65a87a4-9e1e-416e-a1eb-778aef63c057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:39.095550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a87a4-9e1e-416e-a1eb-778aef63c057 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:39.096246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a87a4-9e1e-416e-a1eb-778aef63c057 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:39.096246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65a87a4-9e1e-416e-a1eb-778aef63c057 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:39.096977 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a87a4-9e1e-416e-a1eb-778aef63c057 None admin] RBAC: Adding query filter params (role.id=8e02985a870646e28fbd44e3b3a3c800, scope.project.id=d27530ca8f8e4156a519c726bd98c2a0, user.id=e838dd9aa24f4571b64719125610c528) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:39.097285 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a87a4-9e1e-416e-a1eb-778aef63c057 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:39.098711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65a87a4-9e1e-416e-a1eb-778aef63c057 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:39.105180 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 643/1287] 10.222.0.52 () {56 vars in 1374 bytes} [Thu Jun 23 10:53:38 2022] GET /identity/v3/role_assignments?user.id=e838dd9aa24f4571b64719125610c528&scope.project.id=d27530ca8f8e4156a519c726bd98c2a0&role.id=8e02985a870646e28fbd44e3b3a3c800 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:41.159498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc3de-6254-47ce-b0f7-4fac08276bc7 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:41.160104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc3de-6254-47ce-b0f7-4fac08276bc7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:41.160104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcc3de-6254-47ce-b0f7-4fac08276bc7 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:41.161474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 645/1288] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:53:41.167028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d7c13-1903-4fb2-aaee-f5ab7a148085 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:41.167436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d7c13-1903-4fb2-aaee-f5ab7a148085 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:41.167585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505d7c13-1903-4fb2-aaee-f5ab7a148085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:41.184935 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-505d7c13-1903-4fb2-aaee-f5ab7a148085 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:41.191092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-505d7c13-1903-4fb2-aaee-f5ab7a148085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:41.215230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:41.254355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 644/1289] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:53:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:53:41.277522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc3de-6254-47ce-b0f7-4fac08276bc7 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:41.379566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcc3de-6254-47ce-b0f7-4fac08276bc7 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:41.390226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:41.413511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b1ea1-db65-4944-8c3e-a57ae4249ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:41.414228 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b1ea1-db65-4944-8c3e-a57ae4249ce2 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:41.414528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b1ea1-db65-4944-8c3e-a57ae4249ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:41.414788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08b1ea1-db65-4944-8c3e-a57ae4249ce2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:41.416060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b1ea1-db65-4944-8c3e-a57ae4249ce2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:41.417447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08b1ea1-db65-4944-8c3e-a57ae4249ce2 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-c08b1ea1-db65-4944-8c3e-a57ae4249ce2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:41.429495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:41.431070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:41.432104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 646/1290] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Jun 23 10:53:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:41.436923 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d7c13-1903-4fb2-aaee-f5ab7a148085 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:41.532153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505d7c13-1903-4fb2-aaee-f5ab7a148085 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:41.565961 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7923cef-a1e9-4294-9fe4-7afbe99fe434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:41.566611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7923cef-a1e9-4294-9fe4-7afbe99fe434 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:41.576250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7923cef-a1e9-4294-9fe4-7afbe99fe434 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:41.576250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7923cef-a1e9-4294-9fe4-7afbe99fe434 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:41.576250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7923cef-a1e9-4294-9fe4-7afbe99fe434 None admin] RBAC: Adding query filter params (name=placement) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:41.576250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7923cef-a1e9-4294-9fe4-7afbe99fe434 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:41.576250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7923cef-a1e9-4294-9fe4-7afbe99fe434 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:41.576250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 645/1291] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Jun 23 10:53:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:41.580218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b1ea1-db65-4944-8c3e-a57ae4249ce2 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:41.679261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08b1ea1-db65-4944-8c3e-a57ae4249ce2 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:41.713620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341121d7-05de-4dcd-a317-9e9305b1acfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:41.714284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341121d7-05de-4dcd-a317-9e9305b1acfb None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:41.714570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341121d7-05de-4dcd-a317-9e9305b1acfb None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:41.714851 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341121d7-05de-4dcd-a317-9e9305b1acfb None admin] PATH_INFO: `/v3/services` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:41.715555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341121d7-05de-4dcd-a317-9e9305b1acfb None admin] RBAC: Adding query filter params (type=placement) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:41.715892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341121d7-05de-4dcd-a317-9e9305b1acfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:41.717577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341121d7-05de-4dcd-a317-9e9305b1acfb None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:41.722149 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 647/1292] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Jun 23 10:53:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:43.792767 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482cc21-d15c-4f66-acc4-8b606e9b3ff6 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:43.793329 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482cc21-d15c-4f66-acc4-8b606e9b3ff6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:43.793329 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0482cc21-d15c-4f66-acc4-8b606e9b3ff6 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:43.794685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 646/1293] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:53:43.799881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545ce36-b43e-4976-be96-4e34c23aaf03 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:43.800381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545ce36-b43e-4976-be96-4e34c23aaf03 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:43.800482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545ce36-b43e-4976-be96-4e34c23aaf03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:43.817547 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-2545ce36-b43e-4976-be96-4e34c23aaf03 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:43.818727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2545ce36-b43e-4976-be96-4e34c23aaf03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:43.849368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:43.886445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 648/1294] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:53:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 23 10:53:43.910066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482cc21-d15c-4f66-acc4-8b606e9b3ff6 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:43.941165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:44.013153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0482cc21-d15c-4f66-acc4-8b606e9b3ff6 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:44.045357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49485b5b-f61f-41f1-9bdb-054b74f3aba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:44.046009 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49485b5b-f61f-41f1-9bdb-054b74f3aba7 None admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:44.046295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49485b5b-f61f-41f1-9bdb-054b74f3aba7 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:44.046574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49485b5b-f61f-41f1-9bdb-054b74f3aba7 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:44.047289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49485b5b-f61f-41f1-9bdb-054b74f3aba7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:44.048706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49485b5b-f61f-41f1-9bdb-054b74f3aba7 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:44.245354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 647/1295] 10.222.0.52 () {60 vars in 1141 bytes} [Thu Jun 23 10:53:43 2022] POST /identity/v3/services => generated 246 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:53:46.294511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ce165-f5b5-4c96-9446-99762da061fd None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:46.295062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ce165-f5b5-4c96-9446-99762da061fd None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:46.295062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46ce165-f5b5-4c96-9446-99762da061fd None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:46.296494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 649/1296] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:53:46.301977 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4539-d270-4ad1-972f-159cf5fe063e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:46.302749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4539-d270-4ad1-972f-159cf5fe063e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:46.302909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56c4539-d270-4ad1-972f-159cf5fe063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:46.320359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-a56c4539-d270-4ad1-972f-159cf5fe063e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:46.321590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a56c4539-d270-4ad1-972f-159cf5fe063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:46.401927 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 648/1297] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:53:46 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:53:46.425945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ce165-f5b5-4c96-9446-99762da061fd None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:46.530994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46ce165-f5b5-4c96-9446-99762da061fd None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:46.565429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1b82c-daf7-485e-878a-896ad782b3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:46.566136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1b82c-daf7-485e-878a-896ad782b3d8 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:46.566461 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1b82c-daf7-485e-878a-896ad782b3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:46.566746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf1b82c-daf7-485e-878a-896ad782b3d8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:46.567391 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1b82c-daf7-485e-878a-896ad782b3d8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:46.568791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf1b82c-daf7-485e-878a-896ad782b3d8 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-6bf1b82c-daf7-485e-878a-896ad782b3d8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:46.580949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:46.582110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:46.583026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 650/1298] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Jun 23 10:53:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:46.588815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4539-d270-4ad1-972f-159cf5fe063e None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:46.607356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:46.685104 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56c4539-d270-4ad1-972f-159cf5fe063e None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:46.719174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e457333-99ec-4717-8c01-40fe410961cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:46.719882 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e457333-99ec-4717-8c01-40fe410961cb None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:46.720176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e457333-99ec-4717-8c01-40fe410961cb None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:46.720452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e457333-99ec-4717-8c01-40fe410961cb None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:46.721150 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e457333-99ec-4717-8c01-40fe410961cb None admin] RBAC: Adding query filter params (name=placement) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:46.721457 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e457333-99ec-4717-8c01-40fe410961cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:46.722825 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e457333-99ec-4717-8c01-40fe410961cb None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:46.727896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 649/1299] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Jun 23 10:53:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 10:53:46.733889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1b82c-daf7-485e-878a-896ad782b3d8 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:46.766564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:46.844799 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf1b82c-daf7-485e-878a-896ad782b3d8 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:46.877148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1293b49-393b-4095-ba23-146d26e9f1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:46.877806 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1293b49-393b-4095-ba23-146d26e9f1e4 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:46.878091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1293b49-393b-4095-ba23-146d26e9f1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:46.878370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1293b49-393b-4095-ba23-146d26e9f1e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:46.879165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1293b49-393b-4095-ba23-146d26e9f1e4 None admin] RBAC: Adding query filter params (interface=public, service_id=8defa48563ee451c96960dbcbf4925c6, region_id=RegionOne) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:46.879481 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1293b49-393b-4095-ba23-146d26e9f1e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:46.880889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1293b49-393b-4095-ba23-146d26e9f1e4 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:46.886359 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 651/1300] 10.222.0.52 () {56 vars in 1251 bytes} [Thu Jun 23 10:53:46 2022] GET /identity/v3/endpoints?service_id=8defa48563ee451c96960dbcbf4925c6&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:46.892051 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e457333-99ec-4717-8c01-40fe410961cb None admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:46.974536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:46.991702 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e457333-99ec-4717-8c01-40fe410961cb None admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:47.024734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9040e0e5-034c-4844-9a91-9d08ec30932e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:47.025377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040e0e5-034c-4844-9a91-9d08ec30932e None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:47.025657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040e0e5-034c-4844-9a91-9d08ec30932e None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:47.025933 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9040e0e5-034c-4844-9a91-9d08ec30932e None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:47.026596 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040e0e5-034c-4844-9a91-9d08ec30932e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:47.028023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9040e0e5-034c-4844-9a91-9d08ec30932e None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:47.034611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 650/1301] 10.222.0.52 () {56 vars in 1087 bytes} [Thu Jun 23 10:53:46 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 10:53:49.067696 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf8039-ed7e-48a9-9126-fb4e449be67d None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:49.068312 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf8039-ed7e-48a9-9126-fb4e449be67d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:49.068312 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf8039-ed7e-48a9-9126-fb4e449be67d None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:49.069740 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 652/1302] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 10:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 10:53:49.076218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220bc62-268b-4cb8-8140-d6d06a03ac27 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:49.085144 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220bc62-268b-4cb8-8140-d6d06a03ac27 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:49.085144 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220bc62-268b-4cb8-8140-d6d06a03ac27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:49.094584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-a220bc62-268b-4cb8-8140-d6d06a03ac27 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 10:53:49.095859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a220bc62-268b-4cb8-8140-d6d06a03ac27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 10:53:49.174062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 651/1303] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 10:53:49 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 23 10:53:49.198882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf8039-ed7e-48a9-9126-fb4e449be67d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:49.301347 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:49.308788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf8039-ed7e-48a9-9126-fb4e449be67d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:49.343693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea45b37-5f82-44af-9d8c-02d71e224c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:49.344457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea45b37-5f82-44af-9d8c-02d71e224c26 None admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:49.344736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea45b37-5f82-44af-9d8c-02d71e224c26 None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:49.345011 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea45b37-5f82-44af-9d8c-02d71e224c26 None admin] PATH_INFO: `/v3/services/placement` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:49.345713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea45b37-5f82-44af-9d8c-02d71e224c26 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:49.347121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea45b37-5f82-44af-9d8c-02d71e224c26 None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application [None req-7ea45b37-5f82-44af-9d8c-02d71e224c26 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 23 10:53:49.359744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 23 10:53:49.360978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.get_or_create( Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application with Lock( Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self._enter() Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application return self.creator() Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application created_value = creator( Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: ERROR keystone.server.flask.application Jun 23 10:53:49.361843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 653/1304] 10.222.0.52 () {56 vars in 1117 bytes} [Thu Jun 23 10:53:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 23 10:53:49.367427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220bc62-268b-4cb8-8140-d6d06a03ac27 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:49.447717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:49.470197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220bc62-268b-4cb8-8140-d6d06a03ac27 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:49.503151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea81e2-55fc-4b3e-b45a-76ac7f97be74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:49.503800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea81e2-55fc-4b3e-b45a-76ac7f97be74 None admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:49.504115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea81e2-55fc-4b3e-b45a-76ac7f97be74 None admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:49.504388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea81e2-55fc-4b3e-b45a-76ac7f97be74 None admin] PATH_INFO: `/v3/services` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:49.505087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea81e2-55fc-4b3e-b45a-76ac7f97be74 None admin] RBAC: Adding query filter params (name=placement) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 10:53:49.505391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea81e2-55fc-4b3e-b45a-76ac7f97be74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:49.506830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ea81e2-55fc-4b3e-b45a-76ac7f97be74 None admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:49.513091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 652/1305] 10.222.0.52 () {56 vars in 1116 bytes} [Thu Jun 23 10:53:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 10:53:49.519008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea45b37-5f82-44af-9d8c-02d71e224c26 None admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 10:53:49.621197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea45b37-5f82-44af-9d8c-02d71e224c26 None admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 10:53:49.659429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c27539-5c56-476c-aeea-7786b55f0fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 10:53:49.660131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27539-5c56-476c-aeea-7786b55f0fce None admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 10:53:49.660419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27539-5c56-476c-aeea-7786b55f0fce None admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 10:53:49.660698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c27539-5c56-476c-aeea-7786b55f0fce None admin] PATH_INFO: `/v3/endpoints` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 10:53:49.661444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c27539-5c56-476c-aeea-7786b55f0fce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 10:53:49.662831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c27539-5c56-476c-aeea-7786b55f0fce None admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 10:53:49.770680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 654/1306] 10.222.0.52 () {60 vars in 1144 bytes} [Thu Jun 23 10:53:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 10:53:59.509229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=30 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 10:53:59.765723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:56.318430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3f295-3563-40bd-964c-5961e917692d None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:56.319653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3f295-3563-40bd-964c-5961e917692d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:56.320122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3f295-3563-40bd-964c-5961e917692d None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:56.322189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 653/1307] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:01:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:01:56.327726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d161dce-4cac-4538-bdf3-99a8ffe9d9f4 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:56.328251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d161dce-4cac-4538-bdf3-99a8ffe9d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:56.328580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d161dce-4cac-4538-bdf3-99a8ffe9d9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:56.447303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-7d161dce-4cac-4538-bdf3-99a8ffe9d9f4 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:56.451254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7d161dce-4cac-4538-bdf3-99a8ffe9d9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:56.659498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 655/1308] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:01:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:56.703738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a4839-67f5-44ce-91ea-b68ee9059a4f None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:56.704053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a4839-67f5-44ce-91ea-b68ee9059a4f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:56.705367 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a4839-67f5-44ce-91ea-b68ee9059a4f None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:56.709046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 654/1309] 10.222.0.52 () {54 vars in 964 bytes} [Thu Jun 23 11:01:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:01:56.718800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2526-8be9-4dfd-a86c-3b3c2a44485a None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:56.719136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2526-8be9-4dfd-a86c-3b3c2a44485a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:56.719357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af2526-8be9-4dfd-a86c-3b3c2a44485a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:56.798497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-f3af2526-8be9-4dfd-a86c-3b3c2a44485a None None] MFA Rules not processed for user `2d903a8e2ce4489fa7f5b7479ff0b7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:56.799710 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f3af2526-8be9-4dfd-a86c-3b3c2a44485a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:56.821724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:56.925628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 656/1310] 10.222.0.52 () {58 vars in 1061 bytes} [Thu Jun 23 11:01:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:56.936020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a4839-67f5-44ce-91ea-b68ee9059a4f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:56.937885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d54a4839-67f5-44ce-91ea-b68ee9059a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:57.080812 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a4839-67f5-44ce-91ea-b68ee9059a4f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:01:57.175526 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c5c9cf-d46e-4637-bf87-d8f00af2da9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:01:57.176216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5c9cf-d46e-4637-bf87-d8f00af2da9c service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:57.176497 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5c9cf-d46e-4637-bf87-d8f00af2da9c service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:57.176770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c5c9cf-d46e-4637-bf87-d8f00af2da9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:57.178431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-06c5c9cf-d46e-4637-bf87-d8f00af2da9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:57.249415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:01:57.313384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5c9cf-d46e-4637-bf87-d8f00af2da9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:01:57.314846 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c5c9cf-d46e-4637-bf87-d8f00af2da9c service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:01:57.349800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 655/1311] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:01:59.735628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0526b-9902-4e6e-976d-5e89d73de4d4 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:59.736219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0526b-9902-4e6e-976d-5e89d73de4d4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:59.736219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a0526b-9902-4e6e-976d-5e89d73de4d4 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:59.737767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 657/1312] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:01:59.742766 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01be1fe-10a0-4752-a3ed-6f4fe1d5c61a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:01:59.743202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01be1fe-10a0-4752-a3ed-6f4fe1d5c61a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:01:59.743323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01be1fe-10a0-4752-a3ed-6f4fe1d5c61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:01:59.821122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-e01be1fe-10a0-4752-a3ed-6f4fe1d5c61a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:01:59.822544 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e01be1fe-10a0-4752-a3ed-6f4fe1d5c61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:01:59.932452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 656/1313] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:01:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:01:59.970949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0526b-9902-4e6e-976d-5e89d73de4d4 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:01:59.972743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e5a0526b-9902-4e6e-976d-5e89d73de4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:00.081187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a0526b-9902-4e6e-976d-5e89d73de4d4 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:00.157600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:00.160120 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0599f-70a7-4f06-b7a9-69582a9ada67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:00.160848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0599f-70a7-4f06-b7a9-69582a9ada67 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:00.161137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0599f-70a7-4f06-b7a9-69582a9ada67 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:00.161426 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0599f-70a7-4f06-b7a9-69582a9ada67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:00.163156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-43a0599f-70a7-4f06-b7a9-69582a9ada67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:00.278228 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0599f-70a7-4f06-b7a9-69582a9ada67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:00.279664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0599f-70a7-4f06-b7a9-69582a9ada67 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:00.299036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 658/1314] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:01:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:02.874570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819a1d1-5711-4aef-bfca-1adf97a68a7f None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:02.875082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819a1d1-5711-4aef-bfca-1adf97a68a7f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:02.875082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5819a1d1-5711-4aef-bfca-1adf97a68a7f None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:02.876553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 657/1315] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:02.881766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7e0f1-ff09-4f05-b27c-abb55019f35c None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:02.882183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7e0f1-ff09-4f05-b27c-abb55019f35c None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:02.882332 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7e0f1-ff09-4f05-b27c-abb55019f35c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:02.946891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-d5c7e0f1-ff09-4f05-b27c-abb55019f35c None None] MFA Rules not processed for user `46a7431e426c4d01bc6f4ec5de1e2a53`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:02.948133 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d5c7e0f1-ff09-4f05-b27c-abb55019f35c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:03.000209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:03.044175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 659/1316] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:02 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:03.084204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819a1d1-5711-4aef-bfca-1adf97a68a7f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:03.085764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5819a1d1-5711-4aef-bfca-1adf97a68a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:03.095726 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:03.188381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5819a1d1-5711-4aef-bfca-1adf97a68a7f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:03.259017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1dbffc-7e7e-40ce-b016-43da86b1bed2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:03.259653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dbffc-7e7e-40ce-b016-43da86b1bed2 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:03.259958 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dbffc-7e7e-40ce-b016-43da86b1bed2 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:03.260230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1dbffc-7e7e-40ce-b016-43da86b1bed2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:03.261900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5d1dbffc-7e7e-40ce-b016-43da86b1bed2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:03.322189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:03.367933 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dbffc-7e7e-40ce-b016-43da86b1bed2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:03.369374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1dbffc-7e7e-40ce-b016-43da86b1bed2 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:03.387706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 658/1317] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:03 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:06.462877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2176284-1e0f-4833-9036-3247109356f2 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:06.463398 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2176284-1e0f-4833-9036-3247109356f2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:06.463508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2176284-1e0f-4833-9036-3247109356f2 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:06.465348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 660/1318] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:06.470765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeb16c-090c-4f60-bd88-f48a8baab5c6 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:06.471197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeb16c-090c-4f60-bd88-f48a8baab5c6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:06.471331 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aeb16c-090c-4f60-bd88-f48a8baab5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:06.536034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-12aeb16c-090c-4f60-bd88-f48a8baab5c6 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:06.537231 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-12aeb16c-090c-4f60-bd88-f48a8baab5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:06.632754 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 659/1319] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:06 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:06.672066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2176284-1e0f-4833-9036-3247109356f2 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:06.673687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b2176284-1e0f-4833-9036-3247109356f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:06.777854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2176284-1e0f-4833-9036-3247109356f2 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:06.849715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475eecd4-3a2b-4531-aceb-59ab43c57d06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:06.850353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eecd4-3a2b-4531-aceb-59ab43c57d06 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:06.850633 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eecd4-3a2b-4531-aceb-59ab43c57d06 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:06.850906 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475eecd4-3a2b-4531-aceb-59ab43c57d06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:06.852591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-475eecd4-3a2b-4531-aceb-59ab43c57d06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:06.860601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:06.959136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eecd4-3a2b-4531-aceb-59ab43c57d06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:06.960597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475eecd4-3a2b-4531-aceb-59ab43c57d06 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:06.978412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 661/1320] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:06 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:09.937395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d9593-a544-469a-a2db-8c05bfd2c4f9 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:09.937933 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d9593-a544-469a-a2db-8c05bfd2c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:09.937933 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d9593-a544-469a-a2db-8c05bfd2c4f9 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:09.939512 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 660/1321] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:09.944970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab35bc-64f9-4a8b-90fb-60ae1de240c7 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:09.945413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab35bc-64f9-4a8b-90fb-60ae1de240c7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:09.945542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab35bc-64f9-4a8b-90fb-60ae1de240c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:10.012224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-dfab35bc-64f9-4a8b-90fb-60ae1de240c7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:10.013438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-dfab35bc-64f9-4a8b-90fb-60ae1de240c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:10.075000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:10.117657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 662/1322] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:10.154118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d9593-a544-469a-a2db-8c05bfd2c4f9 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:10.155706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c04d9593-a544-469a-a2db-8c05bfd2c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:10.177011 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:10.274534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d9593-a544-469a-a2db-8c05bfd2c4f9 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:10.354936 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f1e88-47b5-47b1-af42-e3a98de43d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:10.356206 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f1e88-47b5-47b1-af42-e3a98de43d37 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:10.356507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f1e88-47b5-47b1-af42-e3a98de43d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:10.356828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f1e88-47b5-47b1-af42-e3a98de43d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:10.358651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0a7f1e88-47b5-47b1-af42-e3a98de43d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:10.435935 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:10.473710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f1e88-47b5-47b1-af42-e3a98de43d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:10.475148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f1e88-47b5-47b1-af42-e3a98de43d37 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:10.494046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 661/1323] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:12.588439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb6cf7-a641-4990-8664-2ee3920f3dc4 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:12.588914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb6cf7-a641-4990-8664-2ee3920f3dc4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:12.589034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb6cf7-a641-4990-8664-2ee3920f3dc4 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:12.590865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 663/1324] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:12.596287 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5d9b1-3f7d-404a-9cd4-2057c121e715 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:12.596757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5d9b1-3f7d-404a-9cd4-2057c121e715 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:12.596853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5d9b1-3f7d-404a-9cd4-2057c121e715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:12.661004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-8dc5d9b1-3f7d-404a-9cd4-2057c121e715 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:12.662118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8dc5d9b1-3f7d-404a-9cd4-2057c121e715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:12.779517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 662/1325] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:12.828696 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147e281-b70f-46bf-8e10-bad5fb2a5698 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:12.828988 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147e281-b70f-46bf-8e10-bad5fb2a5698 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:12.829268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147e281-b70f-46bf-8e10-bad5fb2a5698 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:12.830708 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 664/1326] 10.222.0.52 () {54 vars in 964 bytes} [Thu Jun 23 11:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:12.837299 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260f1f2-8f0e-482a-aa93-18fc974bcc93 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:12.837579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260f1f2-8f0e-482a-aa93-18fc974bcc93 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:12.837886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3260f1f2-8f0e-482a-aa93-18fc974bcc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:12.868289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:12.914216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3260f1f2-8f0e-482a-aa93-18fc974bcc93 None None] MFA Rules not processed for user `2d903a8e2ce4489fa7f5b7479ff0b7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:12.915419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3260f1f2-8f0e-482a-aa93-18fc974bcc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:12.992080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 663/1327] 10.222.0.52 () {58 vars in 1061 bytes} [Thu Jun 23 11:02:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:02:13.001620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147e281-b70f-46bf-8e10-bad5fb2a5698 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:13.003239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a147e281-b70f-46bf-8e10-bad5fb2a5698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:13.116360 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147e281-b70f-46bf-8e10-bad5fb2a5698 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:13.191205 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b773731-6413-48f8-9b44-0fea0273b67c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:13.191891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773731-6413-48f8-9b44-0fea0273b67c service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:13.192179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773731-6413-48f8-9b44-0fea0273b67c service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:13.192460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b773731-6413-48f8-9b44-0fea0273b67c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:13.194129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5b773731-6413-48f8-9b44-0fea0273b67c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:13.211154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:13.317507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773731-6413-48f8-9b44-0fea0273b67c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:13.318970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b773731-6413-48f8-9b44-0fea0273b67c service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:13.338147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 665/1328] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:15.653559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475ab0-6649-420d-b521-f6a9cea0cf72 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:15.654152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475ab0-6649-420d-b521-f6a9cea0cf72 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:15.654152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38475ab0-6649-420d-b521-f6a9cea0cf72 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:15.655473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 664/1329] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:15.660836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d874b55-ce9c-4c23-8e8b-599e83a1353a None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:15.661258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d874b55-ce9c-4c23-8e8b-599e83a1353a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:15.661357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d874b55-ce9c-4c23-8e8b-599e83a1353a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:15.730735 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-4d874b55-ce9c-4c23-8e8b-599e83a1353a None None] MFA Rules not processed for user `46a7431e426c4d01bc6f4ec5de1e2a53`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:15.731992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-4d874b55-ce9c-4c23-8e8b-599e83a1353a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:15.796846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:15.830509 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 666/1330] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:15 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:15.877588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38475ab0-6649-420d-b521-f6a9cea0cf72 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:15.879211 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-38475ab0-6649-420d-b521-f6a9cea0cf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:16.000304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38475ab0-6649-420d-b521-f6a9cea0cf72 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:16.019893 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:16.073418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4311ae9f-c010-48c1-8166-66ed40f87770 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:16.074092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311ae9f-c010-48c1-8166-66ed40f87770 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:16.074368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311ae9f-c010-48c1-8166-66ed40f87770 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:16.074640 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4311ae9f-c010-48c1-8166-66ed40f87770 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:16.076318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4311ae9f-c010-48c1-8166-66ed40f87770 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:16.187069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311ae9f-c010-48c1-8166-66ed40f87770 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:16.188571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4311ae9f-c010-48c1-8166-66ed40f87770 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:16.208104 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 665/1331] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:15 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:18.776557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1290f6-8590-48b3-b03f-d25ac55c39ee None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:18.777135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1290f6-8590-48b3-b03f-d25ac55c39ee None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:18.777135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1290f6-8590-48b3-b03f-d25ac55c39ee None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:18.778559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 667/1332] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:18.784370 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832f1db-bb68-422a-a78a-3e474a75f550 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:18.784915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832f1db-bb68-422a-a78a-3e474a75f550 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:18.784915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2832f1db-bb68-422a-a78a-3e474a75f550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:18.852940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:18.856451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-2832f1db-bb68-422a-a78a-3e474a75f550 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:18.857696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2832f1db-bb68-422a-a78a-3e474a75f550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:18.955145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 666/1333] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:02:18.991127 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1290f6-8590-48b3-b03f-d25ac55c39ee None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:18.992727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8d1290f6-8590-48b3-b03f-d25ac55c39ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:19.098019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1290f6-8590-48b3-b03f-d25ac55c39ee None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:19.174876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6864540a-bae2-4967-a85c-5bfa4f8e90a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:19.175444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864540a-bae2-4967-a85c-5bfa4f8e90a4 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:19.175727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864540a-bae2-4967-a85c-5bfa4f8e90a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:19.176036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6864540a-bae2-4967-a85c-5bfa4f8e90a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:19.177706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-6864540a-bae2-4967-a85c-5bfa4f8e90a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:19.205160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:19.290250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864540a-bae2-4967-a85c-5bfa4f8e90a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:19.291713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6864540a-bae2-4967-a85c-5bfa4f8e90a4 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:19.310627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 668/1334] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:21.439880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f0eb0-c6c8-49be-a187-d370b96e3fb7 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:21.440441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f0eb0-c6c8-49be-a187-d370b96e3fb7 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:21.440441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f0eb0-c6c8-49be-a187-d370b96e3fb7 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:21.441807 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 667/1335] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:21.447164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db9e9f-4d47-4ab3-8610-677c46d2508f None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:21.447601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db9e9f-4d47-4ab3-8610-677c46d2508f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:21.447718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db9e9f-4d47-4ab3-8610-677c46d2508f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:21.512047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-52db9e9f-4d47-4ab3-8610-677c46d2508f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:21.513259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-52db9e9f-4d47-4ab3-8610-677c46d2508f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:21.588654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:21.612389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 669/1336] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:02:21.651174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f0eb0-c6c8-49be-a187-d370b96e3fb7 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:21.653233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ab8f0eb0-c6c8-49be-a187-d370b96e3fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:21.754996 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8f0eb0-c6c8-49be-a187-d370b96e3fb7 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:21.784378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:21.831572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ddce7-a54d-4009-9643-ceb866a9e1c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:21.832237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ddce7-a54d-4009-9643-ceb866a9e1c5 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:21.832514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ddce7-a54d-4009-9643-ceb866a9e1c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:21.832785 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ddce7-a54d-4009-9643-ceb866a9e1c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:21.834406 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b35ddce7-a54d-4009-9643-ceb866a9e1c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:21.941157 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ddce7-a54d-4009-9643-ceb866a9e1c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:21.942631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ddce7-a54d-4009-9643-ceb866a9e1c5 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:21.961732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 668/1337] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:24.632122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ab73c-2f6f-41be-b668-e7810de49bcd None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:24.632654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ab73c-2f6f-41be-b668-e7810de49bcd None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:24.632769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8ab73c-2f6f-41be-b668-e7810de49bcd None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:24.634072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 670/1338] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:24.639636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6f33-2118-47ba-aa51-0afad2cc2cba None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:24.640237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6f33-2118-47ba-aa51-0afad2cc2cba None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:24.640237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e6f33-2118-47ba-aa51-0afad2cc2cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:24.708701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-f05e6f33-2118-47ba-aa51-0afad2cc2cba None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:24.709911 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f05e6f33-2118-47ba-aa51-0afad2cc2cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:24.719304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:24.809260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 669/1339] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:02:24.846090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ab73c-2f6f-41be-b668-e7810de49bcd None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:24.847672 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3a8ab73c-2f6f-41be-b668-e7810de49bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:24.955527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8ab73c-2f6f-41be-b668-e7810de49bcd None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:25.036646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320536ad-60ac-4978-a53b-d2105dbfda90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:25.037305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320536ad-60ac-4978-a53b-d2105dbfda90 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:25.037694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320536ad-60ac-4978-a53b-d2105dbfda90 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:25.037870 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320536ad-60ac-4978-a53b-d2105dbfda90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:25.039562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-320536ad-60ac-4978-a53b-d2105dbfda90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:25.076672 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:25.150443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320536ad-60ac-4978-a53b-d2105dbfda90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:25.152357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320536ad-60ac-4978-a53b-d2105dbfda90 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:25.171019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 671/1340] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:24 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:29.585000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199130e-73fd-453b-a5e5-3b36a0d96875 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:29.585553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199130e-73fd-453b-a5e5-3b36a0d96875 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:29.585553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199130e-73fd-453b-a5e5-3b36a0d96875 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:29.587148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 670/1341] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:29.592548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785a0f-a2d5-4eef-920b-e360117e659a None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:29.593028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785a0f-a2d5-4eef-920b-e360117e659a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:29.593122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94785a0f-a2d5-4eef-920b-e360117e659a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:29.681755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-94785a0f-a2d5-4eef-920b-e360117e659a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:29.683585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-94785a0f-a2d5-4eef-920b-e360117e659a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:29.785715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:29.802481 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 672/1342] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:29.842103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199130e-73fd-453b-a5e5-3b36a0d96875 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:29.846438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f199130e-73fd-453b-a5e5-3b36a0d96875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:29.944246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f199130e-73fd-453b-a5e5-3b36a0d96875 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:29.947757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7749881d-6afd-43cc-8fce-772d1078251b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:29.948500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749881d-6afd-43cc-8fce-772d1078251b service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:29.949381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749881d-6afd-43cc-8fce-772d1078251b service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:29.949654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7749881d-6afd-43cc-8fce-772d1078251b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:29.959022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749881d-6afd-43cc-8fce-772d1078251b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:29.960505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7749881d-6afd-43cc-8fce-772d1078251b service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:29.970454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 671/1343] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:33.392809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b1379-efce-4a8d-b303-e5d2a8988834 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:33.393345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b1379-efce-4a8d-b303-e5d2a8988834 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:33.393345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85b1379-efce-4a8d-b303-e5d2a8988834 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:33.395195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 673/1344] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:33.403060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea78a0-f0da-46d9-942f-dd6f765c749d None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:33.403060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea78a0-f0da-46d9-942f-dd6f765c749d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:33.403060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ea78a0-f0da-46d9-942f-dd6f765c749d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:33.444575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-36ea78a0-f0da-46d9-942f-dd6f765c749d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:33.445790 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-36ea78a0-f0da-46d9-942f-dd6f765c749d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:33.478241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:33.532455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 672/1345] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:33.570223 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b1379-efce-4a8d-b303-e5d2a8988834 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:33.583131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85b1379-efce-4a8d-b303-e5d2a8988834 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:33.587361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6626f684-cee2-44aa-873f-342b36b0526b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:33.588239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626f684-cee2-44aa-873f-342b36b0526b service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:33.588597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626f684-cee2-44aa-873f-342b36b0526b service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:33.589111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6626f684-cee2-44aa-873f-342b36b0526b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:33.599319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626f684-cee2-44aa-873f-342b36b0526b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:33.603892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6626f684-cee2-44aa-873f-342b36b0526b service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:33.611135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 674/1346] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:33 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:38.250512 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52a08e-ca57-4e61-91c5-65db527ca052 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:38.250965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52a08e-ca57-4e61-91c5-65db527ca052 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:38.251057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52a08e-ca57-4e61-91c5-65db527ca052 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:38.252470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 673/1347] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:38.257956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5697c-98e7-4faa-91c0-1b47f243a894 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:38.258451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5697c-98e7-4faa-91c0-1b47f243a894 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:38.258561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5697c-98e7-4faa-91c0-1b47f243a894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:38.279986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-36b5697c-98e7-4faa-91c0-1b47f243a894 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:38.281234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-36b5697c-98e7-4faa-91c0-1b47f243a894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:38.289983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 675/1348] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:38.328234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52a08e-ca57-4e61-91c5-65db527ca052 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:38.340063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52a08e-ca57-4e61-91c5-65db527ca052 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:38.344086 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6be442b-10b1-4f12-a250-1a30ebc0cab2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:38.344743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be442b-10b1-4f12-a250-1a30ebc0cab2 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:38.345023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be442b-10b1-4f12-a250-1a30ebc0cab2 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:38.345296 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6be442b-10b1-4f12-a250-1a30ebc0cab2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:38.358673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be442b-10b1-4f12-a250-1a30ebc0cab2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:38.361252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6be442b-10b1-4f12-a250-1a30ebc0cab2 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:38.373006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 674/1349] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:43.286335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769522f9-6ac5-4f75-834b-7f5e3664c435 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:43.286828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769522f9-6ac5-4f75-834b-7f5e3664c435 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:43.286923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769522f9-6ac5-4f75-834b-7f5e3664c435 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:43.288349 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 676/1350] 10.222.0.52 () {54 vars in 921 bytes} [Thu Jun 23 11:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:43.294303 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cbd32-f697-437a-a506-1599d18498d8 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:43.294787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cbd32-f697-437a-a506-1599d18498d8 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:43.294884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72cbd32-f697-437a-a506-1599d18498d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:43.403658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-e72cbd32-f697-437a-a506-1599d18498d8 None None] MFA Rules not processed for user `e838dd9aa24f4571b64719125610c528`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:43.404872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e72cbd32-f697-437a-a506-1599d18498d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:43.533367 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 675/1351] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Jun 23 11:02:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:48.009235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21af170-dc6c-444c-826e-550393b0e5af None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:48.009825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21af170-dc6c-444c-826e-550393b0e5af None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:48.009825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21af170-dc6c-444c-826e-550393b0e5af None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:48.011943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 677/1352] 10.222.0.52 () {54 vars in 921 bytes} [Thu Jun 23 11:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:48.016990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d763785-a872-4be6-af6e-fb1db59c6d09 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:48.017479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d763785-a872-4be6-af6e-fb1db59c6d09 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:48.017653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d763785-a872-4be6-af6e-fb1db59c6d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:48.036372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-9d763785-a872-4be6-af6e-fb1db59c6d09 None None] MFA Rules not processed for user `e838dd9aa24f4571b64719125610c528`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:48.037679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-9d763785-a872-4be6-af6e-fb1db59c6d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:48.046490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 676/1353] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Jun 23 11:02:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:48.272518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=13 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:49.581194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0cc2e-23fe-48e6-9efd-83209a9deb60 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:49.581815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0cc2e-23fe-48e6-9efd-83209a9deb60 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:49.581815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0cc2e-23fe-48e6-9efd-83209a9deb60 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:49.583140 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 678/1354] 10.222.0.52 () {54 vars in 921 bytes} [Thu Jun 23 11:02:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:49.588791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc93d7-8adb-414e-9cec-719680746d4b None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:49.589234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc93d7-8adb-414e-9cec-719680746d4b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:49.589415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc93d7-8adb-414e-9cec-719680746d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:49.607904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-46dc93d7-8adb-414e-9cec-719680746d4b None None] MFA Rules not processed for user `e838dd9aa24f4571b64719125610c528`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:49.609092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-46dc93d7-8adb-414e-9cec-719680746d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:49.617510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 677/1355] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Jun 23 11:02:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:53.212499 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069cc99-8433-4afa-b03f-173364bcb644 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:53.213064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069cc99-8433-4afa-b03f-173364bcb644 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:53.213064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a069cc99-8433-4afa-b03f-173364bcb644 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:53.215926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 679/1356] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:53.220940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c7d9d-76c1-40e6-b85e-01cbe15d134e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:53.221421 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c7d9d-76c1-40e6-b85e-01cbe15d134e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:53.221527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210c7d9d-76c1-40e6-b85e-01cbe15d134e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:53.261975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-210c7d9d-76c1-40e6-b85e-01cbe15d134e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:53.263784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-210c7d9d-76c1-40e6-b85e-01cbe15d134e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:53.273792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 678/1357] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:53.330759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589db45-bdb5-4042-902b-57fdd2b455c5 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:53.331147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589db45-bdb5-4042-902b-57fdd2b455c5 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:53.331507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f589db45-bdb5-4042-902b-57fdd2b455c5 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:53.333331 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 680/1358] 10.222.0.52 () {54 vars in 961 bytes} [Thu Jun 23 11:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:53.342373 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78016618-0a6d-4b89-bef0-f94421adddb5 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:53.343273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78016618-0a6d-4b89-bef0-f94421adddb5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:53.343745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78016618-0a6d-4b89-bef0-f94421adddb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:53.394617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:02:53.403884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-78016618-0a6d-4b89-bef0-f94421adddb5 None None] MFA Rules not processed for user `a020e7fe06574a108b46f9f48bddc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:53.410633 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-78016618-0a6d-4b89-bef0-f94421adddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:53.497202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 679/1359] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Jun 23 11:02:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:53.506175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589db45-bdb5-4042-902b-57fdd2b455c5 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:53.523561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f589db45-bdb5-4042-902b-57fdd2b455c5 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:53.531460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4c836c-9b64-498c-adb8-4495eb6f7583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:53.532301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c836c-9b64-498c-adb8-4495eb6f7583 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:53.532810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c836c-9b64-498c-adb8-4495eb6f7583 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:53.533408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4c836c-9b64-498c-adb8-4495eb6f7583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:53.544805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c836c-9b64-498c-adb8-4495eb6f7583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:53.547503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4c836c-9b64-498c-adb8-4495eb6f7583 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:53.559419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 681/1360] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:02:55.866119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a536c99-9bbf-44e5-89f4-25ffb91db327 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:55.867069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a536c99-9bbf-44e5-89f4-25ffb91db327 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:55.867421 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a536c99-9bbf-44e5-89f4-25ffb91db327 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:55.868908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 680/1361] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:55.874956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4a0a4-9c46-46d6-af20-64550988ce4b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:55.875429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4a0a4-9c46-46d6-af20-64550988ce4b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:55.875528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4a0a4-9c46-46d6-af20-64550988ce4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:55.894017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0cf4a0a4-9c46-46d6-af20-64550988ce4b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:55.895222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0cf4a0a4-9c46-46d6-af20-64550988ce4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:55.903208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 682/1362] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:55.948165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a536c99-9bbf-44e5-89f4-25ffb91db327 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:55.963098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a536c99-9bbf-44e5-89f4-25ffb91db327 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:55.969030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9ac500-53f8-47ec-aa0e-9d43c1af27e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:55.969664 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ac500-53f8-47ec-aa0e-9d43c1af27e8 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:55.969947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ac500-53f8-47ec-aa0e-9d43c1af27e8 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:55.970222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9ac500-53f8-47ec-aa0e-9d43c1af27e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:55.979159 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ac500-53f8-47ec-aa0e-9d43c1af27e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:55.980791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9ac500-53f8-47ec-aa0e-9d43c1af27e8 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:55.990817 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 681/1363] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:02:58.507028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c62553-fdbc-416c-be42-7141aa92a2bc None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:58.507578 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c62553-fdbc-416c-be42-7141aa92a2bc None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:58.507578 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c62553-fdbc-416c-be42-7141aa92a2bc None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:58.516063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 683/1364] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:58.518677 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d8efa-0b89-4dbd-93ee-eefb3a4dda8e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:58.519138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d8efa-0b89-4dbd-93ee-eefb3a4dda8e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:58.519232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d8efa-0b89-4dbd-93ee-eefb3a4dda8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:58.543321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-738d8efa-0b89-4dbd-93ee-eefb3a4dda8e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:58.544575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-738d8efa-0b89-4dbd-93ee-eefb3a4dda8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:58.553072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 682/1365] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:02:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:58.604576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0371d-2dab-4b72-9f92-d8a78c4704b1 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:58.604992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0371d-2dab-4b72-9f92-d8a78c4704b1 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:58.605482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d0371d-2dab-4b72-9f92-d8a78c4704b1 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:58.607171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 684/1366] 10.222.0.52 () {54 vars in 961 bytes} [Thu Jun 23 11:02:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:02:58.613040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b40da6-d4e0-465b-a294-c2ec3c524b8d None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:58.613517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b40da6-d4e0-465b-a294-c2ec3c524b8d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:58.614023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b40da6-d4e0-465b-a294-c2ec3c524b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:58.633351 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-f0b40da6-d4e0-465b-a294-c2ec3c524b8d None None] MFA Rules not processed for user `a020e7fe06574a108b46f9f48bddc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:02:58.634573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f0b40da6-d4e0-465b-a294-c2ec3c524b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:02:58.644735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 683/1367] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Jun 23 11:02:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:02:58.654108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0371d-2dab-4b72-9f92-d8a78c4704b1 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:02:58.669056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d0371d-2dab-4b72-9f92-d8a78c4704b1 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:02:58.674687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc50a8d-0489-4a14-a32e-9afa5b177253 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:02:58.675397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc50a8d-0489-4a14-a32e-9afa5b177253 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:02:58.675689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc50a8d-0489-4a14-a32e-9afa5b177253 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:02:58.676009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc50a8d-0489-4a14-a32e-9afa5b177253 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:02:58.684657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc50a8d-0489-4a14-a32e-9afa5b177253 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:02:58.686311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc50a8d-0489-4a14-a32e-9afa5b177253 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:02:58.697393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 685/1368] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:02:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:03:01.020452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bb756-7983-465b-8634-5f29dfcda5dc None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:01.021028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bb756-7983-465b-8634-5f29dfcda5dc None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:01.021028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286bb756-7983-465b-8634-5f29dfcda5dc None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:01.023667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 684/1369] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:01.029611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cc183-89ba-46c7-9be7-0ed11a6ec50a None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:01.030097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cc183-89ba-46c7-9be7-0ed11a6ec50a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:01.030201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757cc183-89ba-46c7-9be7-0ed11a6ec50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:01.049478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-757cc183-89ba-46c7-9be7-0ed11a6ec50a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:01.050912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-757cc183-89ba-46c7-9be7-0ed11a6ec50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:01.059463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 686/1370] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:01.103949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bb756-7983-465b-8634-5f29dfcda5dc None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:01.119904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286bb756-7983-465b-8634-5f29dfcda5dc None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:01.125440 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4541b952-e609-4824-82f1-6f80b35b2780 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:01.126241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541b952-e609-4824-82f1-6f80b35b2780 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:01.126536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541b952-e609-4824-82f1-6f80b35b2780 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:01.126808 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4541b952-e609-4824-82f1-6f80b35b2780 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:01.136186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541b952-e609-4824-82f1-6f80b35b2780 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:01.137853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4541b952-e609-4824-82f1-6f80b35b2780 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:01.148889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 685/1371] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:01.600125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4763e9-949a-407a-9645-96ec7a76443b None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:01.600421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4763e9-949a-407a-9645-96ec7a76443b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:01.600884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4763e9-949a-407a-9645-96ec7a76443b None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:01.602276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 687/1372] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:01.608177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71b9e2-4093-4d38-883a-bcfbe81579c7 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:01.608469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71b9e2-4093-4d38-883a-bcfbe81579c7 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:01.608754 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b71b9e2-4093-4d38-883a-bcfbe81579c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:01.627587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-1b71b9e2-4093-4d38-883a-bcfbe81579c7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:01.628840 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1b71b9e2-4093-4d38-883a-bcfbe81579c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:01.637190 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 686/1373] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:03:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:01.956904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448935b8-f0a1-414c-8950-d74a7de5f824 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:01.957191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448935b8-f0a1-414c-8950-d74a7de5f824 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:01.957650 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448935b8-f0a1-414c-8950-d74a7de5f824 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:01.959038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 688/1374] 10.222.0.52 () {54 vars in 963 bytes} [Thu Jun 23 11:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:01.965376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761fd80-6806-4552-bc03-6bd35842b182 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:01.965748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761fd80-6806-4552-bc03-6bd35842b182 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:01.966106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761fd80-6806-4552-bc03-6bd35842b182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:02.020295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3761fd80-6806-4552-bc03-6bd35842b182 None None] MFA Rules not processed for user `71539f69f3c8446ca7e9833d244d20fb`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:02.021826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3761fd80-6806-4552-bc03-6bd35842b182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:02.092105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 687/1375] 10.222.0.52 () {58 vars in 1060 bytes} [Thu Jun 23 11:03:01 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:02.098937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448935b8-f0a1-414c-8950-d74a7de5f824 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:02.111208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448935b8-f0a1-414c-8950-d74a7de5f824 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:02.115117 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18fef9-c716-4900-b7f7-d8f61c75fc38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:02.116013 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18fef9-c716-4900-b7f7-d8f61c75fc38 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:02.116476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18fef9-c716-4900-b7f7-d8f61c75fc38 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:02.116934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18fef9-c716-4900-b7f7-d8f61c75fc38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:02.126985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18fef9-c716-4900-b7f7-d8f61c75fc38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:02.132988 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18fef9-c716-4900-b7f7-d8f61c75fc38 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:02.139078 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 689/1376] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:03.406512 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f6a80-4edb-4e69-b81a-64544095ee1c None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:03.407086 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f6a80-4edb-4e69-b81a-64544095ee1c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:03.407086 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31f6a80-4edb-4e69-b81a-64544095ee1c None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:03.408478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 688/1377] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:03.414079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12de0c-716f-4477-a6f5-0bed782dbe10 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:03.414558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12de0c-716f-4477-a6f5-0bed782dbe10 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:03.414702 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12de0c-716f-4477-a6f5-0bed782dbe10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:03.433341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-2e12de0c-716f-4477-a6f5-0bed782dbe10 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:03.434563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2e12de0c-716f-4477-a6f5-0bed782dbe10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:03.442452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 690/1378] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:03:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:03.486604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f6a80-4edb-4e69-b81a-64544095ee1c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:03.501655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31f6a80-4edb-4e69-b81a-64544095ee1c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:03.507106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e344dda-d83f-4505-afaf-f5a016b73345 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:03.507742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344dda-d83f-4505-afaf-f5a016b73345 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:03.508054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344dda-d83f-4505-afaf-f5a016b73345 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:03.508333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e344dda-d83f-4505-afaf-f5a016b73345 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:03.517235 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e344dda-d83f-4505-afaf-f5a016b73345 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:03.518823 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e344dda-d83f-4505-afaf-f5a016b73345 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:03.522831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:03.529177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 689/1379] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:05.727313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ea975-7aa6-457a-ba96-193155bf3841 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:05.727877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ea975-7aa6-457a-ba96-193155bf3841 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:05.727995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ea975-7aa6-457a-ba96-193155bf3841 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:05.729323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 691/1380] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:05.734678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8854-0bd2-4a81-a607-25add49def6c None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:05.735138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8854-0bd2-4a81-a607-25add49def6c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:05.735230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb8854-0bd2-4a81-a607-25add49def6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:05.753769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-badb8854-0bd2-4a81-a607-25add49def6c None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:05.754974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-badb8854-0bd2-4a81-a607-25add49def6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:05.763634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 690/1381] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:03:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:05.814869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ea975-7aa6-457a-ba96-193155bf3841 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:05.830275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ea975-7aa6-457a-ba96-193155bf3841 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:05.836165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d97b8b9-b7da-4a36-a0cf-f635fbbeaf9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:05.836752 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b8b9-b7da-4a36-a0cf-f635fbbeaf9c service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:05.837042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b8b9-b7da-4a36-a0cf-f635fbbeaf9c service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:05.837319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d97b8b9-b7da-4a36-a0cf-f635fbbeaf9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:05.845944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97b8b9-b7da-4a36-a0cf-f635fbbeaf9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:05.847536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d97b8b9-b7da-4a36-a0cf-f635fbbeaf9c service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:05.865199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 692/1382] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:08.058883 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56cf94-8baa-4275-85e6-2519e9dcf69f None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:08.059444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56cf94-8baa-4275-85e6-2519e9dcf69f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:08.059717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56cf94-8baa-4275-85e6-2519e9dcf69f None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:08.061238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 691/1383] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:08.066725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac2998-071e-4d88-8e7f-a20d21ba577a None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:08.067198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac2998-071e-4d88-8e7f-a20d21ba577a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:08.067322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac2998-071e-4d88-8e7f-a20d21ba577a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:08.086510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-79ac2998-071e-4d88-8e7f-a20d21ba577a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:08.088579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-79ac2998-071e-4d88-8e7f-a20d21ba577a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:08.108280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 693/1384] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:03:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:08.144190 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56cf94-8baa-4275-85e6-2519e9dcf69f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:08.161518 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56cf94-8baa-4275-85e6-2519e9dcf69f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:08.168446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27732d6b-2812-4647-9e8a-25efb66a2acc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:08.169378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27732d6b-2812-4647-9e8a-25efb66a2acc service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:08.169830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27732d6b-2812-4647-9e8a-25efb66a2acc service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:08.170263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27732d6b-2812-4647-9e8a-25efb66a2acc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:08.180382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27732d6b-2812-4647-9e8a-25efb66a2acc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:08.182466 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27732d6b-2812-4647-9e8a-25efb66a2acc service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:08.193840 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 692/1385] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:10.326970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2d72-c165-4b21-bb58-e253c80c4a81 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:10.327769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2d72-c165-4b21-bb58-e253c80c4a81 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:10.327769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14d2d72-c165-4b21-bb58-e253c80c4a81 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:10.329005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 694/1386] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:10.335326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ad92-fe54-4bc4-be0a-6f2adddaf7c0 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:10.335868 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ad92-fe54-4bc4-be0a-6f2adddaf7c0 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:10.336008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030ad92-fe54-4bc4-be0a-6f2adddaf7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:10.359612 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-8030ad92-fe54-4bc4-be0a-6f2adddaf7c0 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:10.361431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8030ad92-fe54-4bc4-be0a-6f2adddaf7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:10.372134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 693/1387] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:03:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:10.422402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2d72-c165-4b21-bb58-e253c80c4a81 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:10.444031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14d2d72-c165-4b21-bb58-e253c80c4a81 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:10.449847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fa7d3e-4a39-4825-b572-57fb710c1053 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:10.450506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa7d3e-4a39-4825-b572-57fb710c1053 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:10.450791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa7d3e-4a39-4825-b572-57fb710c1053 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:10.451062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fa7d3e-4a39-4825-b572-57fb710c1053 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:10.460388 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa7d3e-4a39-4825-b572-57fb710c1053 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:10.461914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fa7d3e-4a39-4825-b572-57fb710c1053 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:10.473404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 695/1388] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:13.233294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea1ea-99a6-4985-ab88-31689993a6db None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:13.234833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea1ea-99a6-4985-ab88-31689993a6db None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:13.234833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ea1ea-99a6-4985-ab88-31689993a6db None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:13.235331 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 694/1389] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:13.241598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38196-5ceb-4042-a0e9-0d53b77ebd6b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:13.242110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38196-5ceb-4042-a0e9-0d53b77ebd6b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:13.242213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc38196-5ceb-4042-a0e9-0d53b77ebd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:13.261720 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-6bc38196-5ceb-4042-a0e9-0d53b77ebd6b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:13.262926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-6bc38196-5ceb-4042-a0e9-0d53b77ebd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:13.271020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 696/1390] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:03:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:13.316455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea1ea-99a6-4985-ab88-31689993a6db None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:13.331464 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ea1ea-99a6-4985-ab88-31689993a6db None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:13.337449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86898d7b-e998-49c8-a07f-7d4015cf8634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:13.338166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86898d7b-e998-49c8-a07f-7d4015cf8634 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:13.338455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86898d7b-e998-49c8-a07f-7d4015cf8634 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:13.338738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86898d7b-e998-49c8-a07f-7d4015cf8634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:13.348155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86898d7b-e998-49c8-a07f-7d4015cf8634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:13.349771 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86898d7b-e998-49c8-a07f-7d4015cf8634 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:13.360292 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 695/1391] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:15.631159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce264c-de3b-474e-a164-6bf163e101c1 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:15.631981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce264c-de3b-474e-a164-6bf163e101c1 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:15.631981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ce264c-de3b-474e-a164-6bf163e101c1 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:15.633209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 697/1392] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:03:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:15.638807 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7e390-4703-4f55-81f1-7b7cd9e6a71a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:15.639359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7e390-4703-4f55-81f1-7b7cd9e6a71a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:15.639359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d7e390-4703-4f55-81f1-7b7cd9e6a71a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:15.660905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-20d7e390-4703-4f55-81f1-7b7cd9e6a71a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:15.662633 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-20d7e390-4703-4f55-81f1-7b7cd9e6a71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:15.673237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 696/1393] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:03:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:03:15.719259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce264c-de3b-474e-a164-6bf163e101c1 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:15.734359 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ce264c-de3b-474e-a164-6bf163e101c1 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:15.740075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f34395-18c6-440c-9d6a-9574616a1081 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:15.740723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f34395-18c6-440c-9d6a-9574616a1081 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:15.741007 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f34395-18c6-440c-9d6a-9574616a1081 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:15.747307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f34395-18c6-440c-9d6a-9574616a1081 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:15.750411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f34395-18c6-440c-9d6a-9574616a1081 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:15.752055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f34395-18c6-440c-9d6a-9574616a1081 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:15.761946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 698/1394] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:17.902217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a72a7a-d152-4549-9492-324bc5653a35 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:17.902787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a72a7a-d152-4549-9492-324bc5653a35 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:17.902787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a72a7a-d152-4549-9492-324bc5653a35 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:17.904158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 697/1395] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:03:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:17.909552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be0426-65c0-4f32-b320-aa434753cf9c None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:17.910000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be0426-65c0-4f32-b320-aa434753cf9c None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:17.910103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be0426-65c0-4f32-b320-aa434753cf9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:17.928371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-80be0426-65c0-4f32-b320-aa434753cf9c None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:17.929588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-80be0426-65c0-4f32-b320-aa434753cf9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:17.937403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 699/1396] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:03:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:17.993303 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afde3d-23b6-450e-a33a-3045568463dd None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:17.993609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afde3d-23b6-450e-a33a-3045568463dd None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:17.993952 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86afde3d-23b6-450e-a33a-3045568463dd None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:17.995543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 698/1397] 10.222.0.52 () {54 vars in 962 bytes} [Thu Jun 23 11:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:18.001185 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2055b7a-0e36-4ed5-a993-d9b9a0b88a47 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:18.001483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2055b7a-0e36-4ed5-a993-d9b9a0b88a47 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:18.001764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2055b7a-0e36-4ed5-a993-d9b9a0b88a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:18.051624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a2055b7a-0e36-4ed5-a993-d9b9a0b88a47 None None] MFA Rules not processed for user `5211ed409a3f43d281bca44382aa03fe`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:18.052907 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a2055b7a-0e36-4ed5-a993-d9b9a0b88a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:18.114463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 700/1398] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Jun 23 11:03:17 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:03:18.122551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afde3d-23b6-450e-a33a-3045568463dd None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:18.133601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86afde3d-23b6-450e-a33a-3045568463dd None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:18.137675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3038-2d33-4006-a8a5-d8603b7bd2f4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5211ed409a3f43d281bca44382aa03fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:18.138312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3038-2d33-4006-a8a5-d8603b7bd2f4 service glance] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:18.138597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3038-2d33-4006-a8a5-d8603b7bd2f4 service glance] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:18.138876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462c3038-2d33-4006-a8a5-d8603b7bd2f4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:18.146334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f88a85-60b9-4fa8-bb2c-c1d595998cd2 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:18.146609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f88a85-60b9-4fa8-bb2c-c1d595998cd2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:18.146905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f88a85-60b9-4fa8-bb2c-c1d595998cd2 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:18.148316 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 701/1399] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:03:18.148629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c3038-2d33-4006-a8a5-d8603b7bd2f4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:18.150701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462c3038-2d33-4006-a8a5-d8603b7bd2f4 service glance] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:18.154097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b73b8f-0abf-4ddd-b492-37375db68a32 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:18.154465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b73b8f-0abf-4ddd-b492-37375db68a32 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:18.154763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b73b8f-0abf-4ddd-b492-37375db68a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:18.160726 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 699/1400] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:18.173039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b7b73b8f-0abf-4ddd-b492-37375db68a32 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:18.174242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b7b73b8f-0abf-4ddd-b492-37375db68a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:18.182178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 702/1401] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:03:18.228863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3038-2d33-4006-a8a5-d8603b7bd2f4 service glance] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:18.241322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462c3038-2d33-4006-a8a5-d8603b7bd2f4 service glance] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:18.247175 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0c2ec-738d-4f08-8c9e-861c217bcde2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:18.247872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0c2ec-738d-4f08-8c9e-861c217bcde2 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:18.248182 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0c2ec-738d-4f08-8c9e-861c217bcde2 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:18.248463 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0c2ec-738d-4f08-8c9e-861c217bcde2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:18.257140 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0c2ec-738d-4f08-8c9e-861c217bcde2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:18.258718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0c2ec-738d-4f08-8c9e-861c217bcde2 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:18.268749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 700/1402] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:19.071853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1531473-9efc-4118-a5a5-8bd4e5a45994 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:19.072327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1531473-9efc-4118-a5a5-8bd4e5a45994 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:19.072327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1531473-9efc-4118-a5a5-8bd4e5a45994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:19.077463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=96 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:19.131775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b1531473-9efc-4118-a5a5-8bd4e5a45994 None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:19.133148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b1531473-9efc-4118-a5a5-8bd4e5a45994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:19.203430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 703/1403] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:03:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:19.254617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571507d-758b-4f38-a03d-8f79813b4798 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:19.255134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571507d-758b-4f38-a03d-8f79813b4798 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:19.255241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571507d-758b-4f38-a03d-8f79813b4798 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:19.256625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 701/1404] 10.222.0.52 () {54 vars in 942 bytes} [Thu Jun 23 11:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:19.263472 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b92083-5b72-4658-ab26-40a61a2d2afc None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:19.263971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b92083-5b72-4658-ab26-40a61a2d2afc None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:19.264290 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b92083-5b72-4658-ab26-40a61a2d2afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:19.315520 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-80b92083-5b72-4658-ab26-40a61a2d2afc None None] MFA Rules not processed for user `dd54976bc4b541a89a0c15788bfb71ed`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:19.316689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-80b92083-5b72-4658-ab26-40a61a2d2afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:19.389634 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 704/1405] 10.222.0.52 () {58 vars in 1039 bytes} [Thu Jun 23 11:03:19 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:19.398663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571507d-758b-4f38-a03d-8f79813b4798 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:19.413557 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571507d-758b-4f38-a03d-8f79813b4798 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:19.419402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72696315-4f12-4913-9f9d-eac2b31b384f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:19.420068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72696315-4f12-4913-9f9d-eac2b31b384f service swift] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:19.420353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72696315-4f12-4913-9f9d-eac2b31b384f service swift] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:19.420630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72696315-4f12-4913-9f9d-eac2b31b384f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:19.429382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72696315-4f12-4913-9f9d-eac2b31b384f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:19.430988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72696315-4f12-4913-9f9d-eac2b31b384f service swift] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:19.439350 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 702/1406] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:03:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:03:20.671470 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a4e4-1c00-44de-a2c4-f4b64b43858d None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:20.672038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a4e4-1c00-44de-a2c4-f4b64b43858d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:20.672038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948a4e4-1c00-44de-a2c4-f4b64b43858d None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:20.673869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 705/1407] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:03:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:20.678885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64448ca4-3637-4805-a89c-1fa5c2fe5caf None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:20.679711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64448ca4-3637-4805-a89c-1fa5c2fe5caf None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:20.680175 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64448ca4-3637-4805-a89c-1fa5c2fe5caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:20.701739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-64448ca4-3637-4805-a89c-1fa5c2fe5caf None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:20.702940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-64448ca4-3637-4805-a89c-1fa5c2fe5caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:20.713476 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 703/1408] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:20.765474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a4e4-1c00-44de-a2c4-f4b64b43858d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:20.786923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948a4e4-1c00-44de-a2c4-f4b64b43858d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:20.793454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b449d-2997-47f8-8397-1ab0052a8cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:20.794124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b449d-2997-47f8-8397-1ab0052a8cd9 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:20.794417 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b449d-2997-47f8-8397-1ab0052a8cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:20.794852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b449d-2997-47f8-8397-1ab0052a8cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:20.805474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b449d-2997-47f8-8397-1ab0052a8cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:20.807633 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b449d-2997-47f8-8397-1ab0052a8cd9 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:20.819703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 706/1409] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:30.696152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=43 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:30.814279 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:03:43.373914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683af91d-507e-4cd5-9df7-dab3fe65da41 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:43.374495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683af91d-507e-4cd5-9df7-dab3fe65da41 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:43.374495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683af91d-507e-4cd5-9df7-dab3fe65da41 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:43.375875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 704/1410] 10.222.0.52 () {54 vars in 918 bytes} [Thu Jun 23 11:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:43.380869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be3ba7-8371-4a6e-9d3a-113b6add81c1 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:43.381287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be3ba7-8371-4a6e-9d3a-113b6add81c1 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:43.381425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be3ba7-8371-4a6e-9d3a-113b6add81c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:43.399961 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-c0be3ba7-8371-4a6e-9d3a-113b6add81c1 None None] MFA Rules not processed for user `e838dd9aa24f4571b64719125610c528`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:43.401170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c0be3ba7-8371-4a6e-9d3a-113b6add81c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:43.409696 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 707/1411] 10.222.0.52 () {58 vars in 1015 bytes} [Thu Jun 23 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:43.424076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa7e26-a89b-43c8-813c-ebad0004e75c None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:43.424369 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa7e26-a89b-43c8-813c-ebad0004e75c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:43.424656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fa7e26-a89b-43c8-813c-ebad0004e75c None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:43.426021 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 705/1412] 10.222.0.52 () {54 vars in 918 bytes} [Thu Jun 23 11:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:43.431503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fec93-2661-4e30-97b0-c5dc0bbae1b8 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:43.431786 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fec93-2661-4e30-97b0-c5dc0bbae1b8 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:43.432090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fec93-2661-4e30-97b0-c5dc0bbae1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:43.450473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-1f6fec93-2661-4e30-97b0-c5dc0bbae1b8 None None] MFA Rules not processed for user `a020e7fe06574a108b46f9f48bddc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:43.451666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-1f6fec93-2661-4e30-97b0-c5dc0bbae1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:43.461124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 708/1413] 10.222.0.52 () {58 vars in 1015 bytes} [Thu Jun 23 11:03:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:45.968690 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df319a3-cfc1-4d0c-a6d3-7db25408fc65 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:45.969240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df319a3-cfc1-4d0c-a6d3-7db25408fc65 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:45.969240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df319a3-cfc1-4d0c-a6d3-7db25408fc65 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:45.970613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:45.975861 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe058e9-2168-4e30-b1d2-f8830ccb1958 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:45.976302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe058e9-2168-4e30-b1d2-f8830ccb1958 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:45.976514 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe058e9-2168-4e30-b1d2-f8830ccb1958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:45.995513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-afe058e9-2168-4e30-b1d2-f8830ccb1958 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:45.996747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-afe058e9-2168-4e30-b1d2-f8830ccb1958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:46.004503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:46.047484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df319a3-cfc1-4d0c-a6d3-7db25408fc65 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:46.062853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df319a3-cfc1-4d0c-a6d3-7db25408fc65 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:46.068208 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd34600-1bdc-4bf0-adae-8b18ccbd670e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:46.068884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd34600-1bdc-4bf0-adae-8b18ccbd670e service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:46.069117 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd34600-1bdc-4bf0-adae-8b18ccbd670e service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:46.069391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd34600-1bdc-4bf0-adae-8b18ccbd670e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:46.077599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd34600-1bdc-4bf0-adae-8b18ccbd670e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:46.079174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd34600-1bdc-4bf0-adae-8b18ccbd670e service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:46.088946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 707/1416] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:47.005228 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c48fc-27a3-44d4-bd53-144277a3ecf1 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:47.005762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c48fc-27a3-44d4-bd53-144277a3ecf1 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:47.005762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c48fc-27a3-44d4-bd53-144277a3ecf1 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:47.007162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:47.012827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c72562-8ef8-492b-9106-b0487d261942 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:47.013276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c72562-8ef8-492b-9106-b0487d261942 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:47.013385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c72562-8ef8-492b-9106-b0487d261942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:47.031624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-16c72562-8ef8-492b-9106-b0487d261942 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:47.032899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-16c72562-8ef8-492b-9106-b0487d261942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:47.040801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:03:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:47.192849 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c48fc-27a3-44d4-bd53-144277a3ecf1 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:47.207713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c48fc-27a3-44d4-bd53-144277a3ecf1 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:47.213495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec82f399-b2b2-4420-8ae9-1a0bade5937f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:47.214127 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82f399-b2b2-4420-8ae9-1a0bade5937f service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:47.214407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82f399-b2b2-4420-8ae9-1a0bade5937f service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:47.214687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec82f399-b2b2-4420-8ae9-1a0bade5937f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:47.222931 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82f399-b2b2-4420-8ae9-1a0bade5937f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:47.224657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec82f399-b2b2-4420-8ae9-1a0bade5937f service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:47.234141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 711/1419] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:03:48.121908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f799f-0b4b-407e-98c7-4617e2038dee None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:48.122458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f799f-0b4b-407e-98c7-4617e2038dee None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:48.122458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f799f-0b4b-407e-98c7-4617e2038dee None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:48.123860 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:03:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:48.128825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b142de-9a2a-44ea-9b5e-19de1c04259f None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:48.129255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b142de-9a2a-44ea-9b5e-19de1c04259f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:48.129392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b142de-9a2a-44ea-9b5e-19de1c04259f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:48.147930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-73b142de-9a2a-44ea-9b5e-19de1c04259f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:48.149741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-73b142de-9a2a-44ea-9b5e-19de1c04259f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:48.157528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:48.306942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f799f-0b4b-407e-98c7-4617e2038dee None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:48.321924 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f799f-0b4b-407e-98c7-4617e2038dee None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:48.327504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2a8d56-a67f-4021-b5e0-7dd2b1dd736d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:48.328176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a8d56-a67f-4021-b5e0-7dd2b1dd736d service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:48.328462 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a8d56-a67f-4021-b5e0-7dd2b1dd736d service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:48.328739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2a8d56-a67f-4021-b5e0-7dd2b1dd736d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:48.337985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a8d56-a67f-4021-b5e0-7dd2b1dd736d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:48.339572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2a8d56-a67f-4021-b5e0-7dd2b1dd736d service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:48.349103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 710/1422] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:49.218364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc15c69-00a0-4be1-b97b-c5a424de2d19 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:49.218987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc15c69-00a0-4be1-b97b-c5a424de2d19 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:49.218987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc15c69-00a0-4be1-b97b-c5a424de2d19 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:49.220394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:49.225258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f7637-6275-4c9c-966b-b85957d9bc86 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:49.225702 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f7637-6275-4c9c-966b-b85957d9bc86 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:49.225805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f7637-6275-4c9c-966b-b85957d9bc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:49.244174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-fc5f7637-6275-4c9c-966b-b85957d9bc86 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:49.245361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-fc5f7637-6275-4c9c-966b-b85957d9bc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:49.253092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:49.402404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc15c69-00a0-4be1-b97b-c5a424de2d19 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:49.419923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc15c69-00a0-4be1-b97b-c5a424de2d19 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:49.425517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679f0bab-1697-4e6f-9017-dbcd5fb9f530 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:49.426162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f0bab-1697-4e6f-9017-dbcd5fb9f530 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:49.426452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f0bab-1697-4e6f-9017-dbcd5fb9f530 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:49.426737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679f0bab-1697-4e6f-9017-dbcd5fb9f530 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:49.435429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f0bab-1697-4e6f-9017-dbcd5fb9f530 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:49.437213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679f0bab-1697-4e6f-9017-dbcd5fb9f530 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:49.446936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 714/1425] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:50.314259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116e086-26ee-464b-b061-4670f4b72996 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:50.314838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116e086-26ee-464b-b061-4670f4b72996 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:50.314838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f116e086-26ee-464b-b061-4670f4b72996 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:50.316384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:50.322099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a4bf4-2710-4bbf-8964-94e2b2701df3 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:50.322513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a4bf4-2710-4bbf-8964-94e2b2701df3 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:50.322680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825a4bf4-2710-4bbf-8964-94e2b2701df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:50.340719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-825a4bf4-2710-4bbf-8964-94e2b2701df3 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:50.341936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-825a4bf4-2710-4bbf-8964-94e2b2701df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:50.349935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:03:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:50.500199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116e086-26ee-464b-b061-4670f4b72996 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:50.515267 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f116e086-26ee-464b-b061-4670f4b72996 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:50.520681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef83595b-7914-402e-85a9-1c67b2ebb13f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:50.521312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83595b-7914-402e-85a9-1c67b2ebb13f service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:50.521599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83595b-7914-402e-85a9-1c67b2ebb13f service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:50.521882 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83595b-7914-402e-85a9-1c67b2ebb13f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:50.530744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83595b-7914-402e-85a9-1c67b2ebb13f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:50.532359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef83595b-7914-402e-85a9-1c67b2ebb13f service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:50.541857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 713/1428] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:51.381102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceb802-a183-4eed-8dad-87f9abe806ec None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:51.381653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceb802-a183-4eed-8dad-87f9abe806ec None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:51.381653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ceb802-a183-4eed-8dad-87f9abe806ec None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:51.383015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:51.388597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75e0a6-f454-48c3-bfd1-215c277d1d29 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:51.389053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75e0a6-f454-48c3-bfd1-215c277d1d29 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:51.389158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75e0a6-f454-48c3-bfd1-215c277d1d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:51.408024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3d75e0a6-f454-48c3-bfd1-215c277d1d29 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:51.409244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3d75e0a6-f454-48c3-bfd1-215c277d1d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:51.417193 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:03:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:51.578044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ceb802-a183-4eed-8dad-87f9abe806ec None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:51.592896 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ceb802-a183-4eed-8dad-87f9abe806ec None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:51.598591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd242d81-1f2c-4cee-b3fb-7dc5944e4079 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:51.599228 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd242d81-1f2c-4cee-b3fb-7dc5944e4079 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:51.599522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd242d81-1f2c-4cee-b3fb-7dc5944e4079 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:51.599901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd242d81-1f2c-4cee-b3fb-7dc5944e4079 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:51.608343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd242d81-1f2c-4cee-b3fb-7dc5944e4079 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:51.610020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd242d81-1f2c-4cee-b3fb-7dc5944e4079 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:51.620252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 717/1431] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:52.474246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f50136-0840-4d1d-851f-a41ebe2292da None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:52.474802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f50136-0840-4d1d-851f-a41ebe2292da None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:52.474802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f50136-0840-4d1d-851f-a41ebe2292da None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:52.476186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:52.481192 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159de572-f14a-4458-ae55-6fed2535af68 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:52.481622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159de572-f14a-4458-ae55-6fed2535af68 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:52.481784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159de572-f14a-4458-ae55-6fed2535af68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:52.499904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-159de572-f14a-4458-ae55-6fed2535af68 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:52.501093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-159de572-f14a-4458-ae55-6fed2535af68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:52.509302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:03:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:52.657916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f50136-0840-4d1d-851f-a41ebe2292da None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:52.672669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f50136-0840-4d1d-851f-a41ebe2292da None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:52.678009 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bce2981-2b24-41a3-a11a-e043053c703b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:52.678636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce2981-2b24-41a3-a11a-e043053c703b service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:52.678919 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce2981-2b24-41a3-a11a-e043053c703b service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:52.679194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bce2981-2b24-41a3-a11a-e043053c703b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:52.688220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce2981-2b24-41a3-a11a-e043053c703b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:52.689676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bce2981-2b24-41a3-a11a-e043053c703b service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:52.699287 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 716/1434] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:53.666525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2e687-4aaf-4221-a6b6-14474ece6b2f None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:53.667068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2e687-4aaf-4221-a6b6-14474ece6b2f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:53.667068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a2e687-4aaf-4221-a6b6-14474ece6b2f None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:53.668520 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:03:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:53.673545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38a46f-7767-4f0c-bcba-cbff0a3d4437 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:53.673947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38a46f-7767-4f0c-bcba-cbff0a3d4437 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:53.674090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a38a46f-7767-4f0c-bcba-cbff0a3d4437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:53.692464 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-1a38a46f-7767-4f0c-bcba-cbff0a3d4437 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:53.699705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1a38a46f-7767-4f0c-bcba-cbff0a3d4437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:53.701945 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:03:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:53.855269 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2e687-4aaf-4221-a6b6-14474ece6b2f None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:53.867191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a2e687-4aaf-4221-a6b6-14474ece6b2f None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:53.873355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a24d598-f9a7-4258-9094-10f47502bac6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:53.873992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24d598-f9a7-4258-9094-10f47502bac6 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:53.874277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24d598-f9a7-4258-9094-10f47502bac6 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:53.874558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a24d598-f9a7-4258-9094-10f47502bac6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:53.882928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24d598-f9a7-4258-9094-10f47502bac6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:53.885130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a24d598-f9a7-4258-9094-10f47502bac6 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:53.894692 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 720/1437] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:54.740762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3568c-c064-47e2-a057-c9b17728e112 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:54.741600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3568c-c064-47e2-a057-c9b17728e112 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:54.741791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a3568c-c064-47e2-a057-c9b17728e112 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:54.743439 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:54.748435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aead7-d383-4066-8053-6a98798bd6b5 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:54.748942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aead7-d383-4066-8053-6a98798bd6b5 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:54.750249 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17aead7-d383-4066-8053-6a98798bd6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:54.769225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a17aead7-d383-4066-8053-6a98798bd6b5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:54.770460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a17aead7-d383-4066-8053-6a98798bd6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:54.778940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:54.930127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3568c-c064-47e2-a057-c9b17728e112 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:54.944392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a3568c-c064-47e2-a057-c9b17728e112 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:54.950215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b77311-af25-4906-bb02-5b6f61c58bca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:54.950842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b77311-af25-4906-bb02-5b6f61c58bca service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:54.951134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b77311-af25-4906-bb02-5b6f61c58bca service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:54.951412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b77311-af25-4906-bb02-5b6f61c58bca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:54.959747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b77311-af25-4906-bb02-5b6f61c58bca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:54.961989 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b77311-af25-4906-bb02-5b6f61c58bca service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:54.971389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 719/1440] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:56.965275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca45222-158e-40fb-ab3f-564a48353f4a None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:56.965875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca45222-158e-40fb-ab3f-564a48353f4a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:56.965875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca45222-158e-40fb-ab3f-564a48353f4a None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:56.967273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:56.972907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6aaf2-0054-4c46-8510-d175b12b7691 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:56.973331 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6aaf2-0054-4c46-8510-d175b12b7691 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:56.973472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6aaf2-0054-4c46-8510-d175b12b7691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:56.991329 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-90e6aaf2-0054-4c46-8510-d175b12b7691 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:56.992575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-90e6aaf2-0054-4c46-8510-d175b12b7691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:57.000373 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:03:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:57.038722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca45222-158e-40fb-ab3f-564a48353f4a None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:57.050140 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca45222-158e-40fb-ab3f-564a48353f4a None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:57.053664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e300e9c0-4ae2-4af6-9f91-462986f4c6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:57.054289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e9c0-4ae2-4af6-9f91-462986f4c6fd service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:57.054575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e9c0-4ae2-4af6-9f91-462986f4c6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:57.054853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e300e9c0-4ae2-4af6-9f91-462986f4c6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:57.063877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300e9c0-4ae2-4af6-9f91-462986f4c6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:57.065302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e300e9c0-4ae2-4af6-9f91-462986f4c6fd service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:57.075244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 723/1443] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:03:59.301805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135fb21-f633-438f-acbb-829c8c7bc8ba None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:59.302409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135fb21-f633-438f-acbb-829c8c7bc8ba None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:59.302409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6135fb21-f633-438f-acbb-829c8c7bc8ba None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:59.303725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:03:59.310043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a8bd0-6d9b-4e8d-80a1-a7745efb0da9 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:59.310601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a8bd0-6d9b-4e8d-80a1-a7745efb0da9 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:59.310601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22a8bd0-6d9b-4e8d-80a1-a7745efb0da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:59.328905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b22a8bd0-6d9b-4e8d-80a1-a7745efb0da9 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:03:59.330095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b22a8bd0-6d9b-4e8d-80a1-a7745efb0da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:59.338093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:03:59.377224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135fb21-f633-438f-acbb-829c8c7bc8ba None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:03:59.378942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6135fb21-f633-438f-acbb-829c8c7bc8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:03:59.392027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6135fb21-f633-438f-acbb-829c8c7bc8ba None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:03:59.395522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcf7a09-d9ef-442b-85b2-31ed7696866f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:03:59.396192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7a09-d9ef-442b-85b2-31ed7696866f service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:03:59.396479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7a09-d9ef-442b-85b2-31ed7696866f service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:03:59.396753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcf7a09-d9ef-442b-85b2-31ed7696866f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:03:59.406435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf7a09-d9ef-442b-85b2-31ed7696866f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:03:59.407931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcf7a09-d9ef-442b-85b2-31ed7696866f service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:03:59.418253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 722/1446] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:01.934818 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78b504-0f29-4ff2-b21a-c5dfdab0238f None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:01.935355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78b504-0f29-4ff2-b21a-c5dfdab0238f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:01.935355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a78b504-0f29-4ff2-b21a-c5dfdab0238f None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:01.936705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:01.941984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e76e2-ca0f-47f6-9e94-1d76330b1233 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:01.942438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e76e2-ca0f-47f6-9e94-1d76330b1233 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:01.942548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e76e2-ca0f-47f6-9e94-1d76330b1233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:01.960839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-404e76e2-ca0f-47f6-9e94-1d76330b1233 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:01.962509 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-404e76e2-ca0f-47f6-9e94-1d76330b1233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:01.970185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:04:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:02.008019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78b504-0f29-4ff2-b21a-c5dfdab0238f None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:02.018789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a78b504-0f29-4ff2-b21a-c5dfdab0238f None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:02.022607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b8fc6-eb8c-4216-b518-3458c6d6efbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:02.023241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b8fc6-eb8c-4216-b518-3458c6d6efbb service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:02.024058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b8fc6-eb8c-4216-b518-3458c6d6efbb service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:02.024343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b8fc6-eb8c-4216-b518-3458c6d6efbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:02.033250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b8fc6-eb8c-4216-b518-3458c6d6efbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:02.034689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686b8fc6-eb8c-4216-b518-3458c6d6efbb service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:02.045225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 726/1449] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:04.228120 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2d39e-f2cd-46d3-bbda-8b2c513401a3 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:04.228688 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2d39e-f2cd-46d3-bbda-8b2c513401a3 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:04.228688 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e2d39e-f2cd-46d3-bbda-8b2c513401a3 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:04.230065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:04:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:04.235276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9464f02-1a95-44f9-b83a-024f85b28122 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:04.235771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9464f02-1a95-44f9-b83a-024f85b28122 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:04.235899 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9464f02-1a95-44f9-b83a-024f85b28122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:04.255421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b9464f02-1a95-44f9-b83a-024f85b28122 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:04.256658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b9464f02-1a95-44f9-b83a-024f85b28122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:04.264963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:04.303571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2d39e-f2cd-46d3-bbda-8b2c513401a3 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:04.314786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e2d39e-f2cd-46d3-bbda-8b2c513401a3 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:04.318344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2cb695-d7c2-4931-922b-2db094d9927a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:04.318969 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cb695-d7c2-4931-922b-2db094d9927a service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:04.319253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cb695-d7c2-4931-922b-2db094d9927a service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:04.319527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2cb695-d7c2-4931-922b-2db094d9927a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:04.329450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cb695-d7c2-4931-922b-2db094d9927a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:04.330917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2cb695-d7c2-4931-922b-2db094d9927a service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:04.343430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 725/1452] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:06.412001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36d87a-cf13-483e-a8c1-400bc8291d96 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:06.412535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36d87a-cf13-483e-a8c1-400bc8291d96 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:06.412535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b36d87a-cf13-483e-a8c1-400bc8291d96 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:06.413913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:06.419606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb517b-d302-468c-ba17-3b00432afbc9 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:06.420027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb517b-d302-468c-ba17-3b00432afbc9 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:06.420223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afb517b-d302-468c-ba17-3b00432afbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:06.439792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-2afb517b-d302-468c-ba17-3b00432afbc9 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:06.441013 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2afb517b-d302-468c-ba17-3b00432afbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:06.449378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:06.486719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36d87a-cf13-483e-a8c1-400bc8291d96 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:06.498240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b36d87a-cf13-483e-a8c1-400bc8291d96 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:06.501906 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54172eb-b610-439b-817d-8e09093993de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:06.502537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54172eb-b610-439b-817d-8e09093993de service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:06.502822 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54172eb-b610-439b-817d-8e09093993de service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:06.503102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54172eb-b610-439b-817d-8e09093993de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:06.512975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54172eb-b610-439b-817d-8e09093993de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:06.514455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54172eb-b610-439b-817d-8e09093993de service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:06.524046 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 729/1455] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:08.606231 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed96918-fdf9-4b54-bc53-8fdcf0d665b3 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:08.606755 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed96918-fdf9-4b54-bc53-8fdcf0d665b3 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:08.606876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed96918-fdf9-4b54-bc53-8fdcf0d665b3 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:08.608198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:08.613527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03583de7-d2b5-4384-ba5b-1d7f935067a2 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:08.614002 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03583de7-d2b5-4384-ba5b-1d7f935067a2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:08.614107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03583de7-d2b5-4384-ba5b-1d7f935067a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:08.631362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-03583de7-d2b5-4384-ba5b-1d7f935067a2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:08.633086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-03583de7-d2b5-4384-ba5b-1d7f935067a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:08.640787 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:08.678619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed96918-fdf9-4b54-bc53-8fdcf0d665b3 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:08.689832 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed96918-fdf9-4b54-bc53-8fdcf0d665b3 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:08.693318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46788f4-6b9a-4549-b29b-e54442383859 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:08.693954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46788f4-6b9a-4549-b29b-e54442383859 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:08.694239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46788f4-6b9a-4549-b29b-e54442383859 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:08.694517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46788f4-6b9a-4549-b29b-e54442383859 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:08.704026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46788f4-6b9a-4549-b29b-e54442383859 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:08.705463 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46788f4-6b9a-4549-b29b-e54442383859 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:08.715209 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 728/1458] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:10.813478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae828e9-785f-4732-8a1d-9258625289c3 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:10.814201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae828e9-785f-4732-8a1d-9258625289c3 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:10.814201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae828e9-785f-4732-8a1d-9258625289c3 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:10.815414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:10.821390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651235da-4cb9-49b2-aa78-76dad1470c80 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:10.821876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651235da-4cb9-49b2-aa78-76dad1470c80 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:10.821972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651235da-4cb9-49b2-aa78-76dad1470c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:10.828336 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=70 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:10.841303 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-651235da-4cb9-49b2-aa78-76dad1470c80 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:10.842442 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-651235da-4cb9-49b2-aa78-76dad1470c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:10.850451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:04:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:10.890823 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae828e9-785f-4732-8a1d-9258625289c3 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:10.898061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=73 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:10.905562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae828e9-785f-4732-8a1d-9258625289c3 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:10.911742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e874db7e-3b98-4bc2-8b08-9839e6ddc091 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:10.917797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874db7e-3b98-4bc2-8b08-9839e6ddc091 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:10.918087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874db7e-3b98-4bc2-8b08-9839e6ddc091 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:10.918363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e874db7e-3b98-4bc2-8b08-9839e6ddc091 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:10.931783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874db7e-3b98-4bc2-8b08-9839e6ddc091 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:10.933266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e874db7e-3b98-4bc2-8b08-9839e6ddc091 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:10.943218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 732/1461] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:13.048399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb4c18-5ded-4110-a232-ddf4c8836de6 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:13.048971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb4c18-5ded-4110-a232-ddf4c8836de6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:13.048971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeb4c18-5ded-4110-a232-ddf4c8836de6 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:13.050346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:04:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:13.056351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862089-f3f5-4f61-b03c-13335093be72 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:13.056788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862089-f3f5-4f61-b03c-13335093be72 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:13.056942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb862089-f3f5-4f61-b03c-13335093be72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:13.074516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-fb862089-f3f5-4f61-b03c-13335093be72 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:13.075717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-fb862089-f3f5-4f61-b03c-13335093be72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:13.083707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:13.121437 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb4c18-5ded-4110-a232-ddf4c8836de6 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:13.131885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeb4c18-5ded-4110-a232-ddf4c8836de6 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:13.136036 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d415d-4165-4fc1-b6da-8b209e27f441 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:13.136679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d415d-4165-4fc1-b6da-8b209e27f441 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:13.136966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d415d-4165-4fc1-b6da-8b209e27f441 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:13.137246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d415d-4165-4fc1-b6da-8b209e27f441 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:13.146476 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d415d-4165-4fc1-b6da-8b209e27f441 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:13.147943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d415d-4165-4fc1-b6da-8b209e27f441 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:13.157634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 731/1464] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:15.232877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1268ffd-255f-4b16-ba74-b00fd49cb465 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:15.233520 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1268ffd-255f-4b16-ba74-b00fd49cb465 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:15.233520 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1268ffd-255f-4b16-ba74-b00fd49cb465 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:15.234808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:15.240383 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaf3d3-237f-4bd4-975a-de0e8cc2cd0b None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:15.240887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaf3d3-237f-4bd4-975a-de0e8cc2cd0b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:15.240981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfaf3d3-237f-4bd4-975a-de0e8cc2cd0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:15.259849 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-cdfaf3d3-237f-4bd4-975a-de0e8cc2cd0b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:15.261095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-cdfaf3d3-237f-4bd4-975a-de0e8cc2cd0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:15.268826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:04:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:15.306094 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1268ffd-255f-4b16-ba74-b00fd49cb465 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:15.317005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1268ffd-255f-4b16-ba74-b00fd49cb465 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:15.321130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4336be45-25f6-4cd8-8e51-5cbd1600d9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:15.321775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336be45-25f6-4cd8-8e51-5cbd1600d9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:15.322059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336be45-25f6-4cd8-8e51-5cbd1600d9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:15.322343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4336be45-25f6-4cd8-8e51-5cbd1600d9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:15.331607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336be45-25f6-4cd8-8e51-5cbd1600d9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:15.333090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4336be45-25f6-4cd8-8e51-5cbd1600d9c5 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:15.343883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 735/1467] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:17.425148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f8e52-98d8-4f59-a9cb-e24342a1cec0 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:17.425733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f8e52-98d8-4f59-a9cb-e24342a1cec0 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:17.425733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f8e52-98d8-4f59-a9cb-e24342a1cec0 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:17.427072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:17.433318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fd1f7-8184-46af-8d1e-87185fff5001 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:17.433771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fd1f7-8184-46af-8d1e-87185fff5001 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:17.433906 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11fd1f7-8184-46af-8d1e-87185fff5001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:17.451742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-d11fd1f7-8184-46af-8d1e-87185fff5001 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:17.452971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d11fd1f7-8184-46af-8d1e-87185fff5001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:17.461064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:04:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:17.498219 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f8e52-98d8-4f59-a9cb-e24342a1cec0 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:17.508950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f8e52-98d8-4f59-a9cb-e24342a1cec0 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:17.512522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c120b3-931a-44db-844d-af6f00cccb29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:17.513153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c120b3-931a-44db-844d-af6f00cccb29 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:17.513435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c120b3-931a-44db-844d-af6f00cccb29 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:17.513712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c120b3-931a-44db-844d-af6f00cccb29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:17.522579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c120b3-931a-44db-844d-af6f00cccb29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:17.524045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c120b3-931a-44db-844d-af6f00cccb29 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:17.533401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 734/1470] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:27.446610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=17 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:27.529216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=17 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:04:37.509097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87601bb5-d71b-4dc4-8e96-372060e85c73 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:37.509719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87601bb5-d71b-4dc4-8e96-372060e85c73 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:37.509719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87601bb5-d71b-4dc4-8e96-372060e85c73 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:37.511174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 737/1471] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:37.516769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23903afd-c796-44fa-abd8-6955e44c9430 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:37.517218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23903afd-c796-44fa-abd8-6955e44c9430 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:37.517322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23903afd-c796-44fa-abd8-6955e44c9430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:37.535221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-23903afd-c796-44fa-abd8-6955e44c9430 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:37.536453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-23903afd-c796-44fa-abd8-6955e44c9430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:37.544962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 735/1472] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:37.593661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847fee1-8593-4fb0-a6b7-d15c9adf52aa None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:37.593957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847fee1-8593-4fb0-a6b7-d15c9adf52aa None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:37.594244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9847fee1-8593-4fb0-a6b7-d15c9adf52aa None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:37.595629 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 738/1473] 10.222.0.52 () {54 vars in 962 bytes} [Thu Jun 23 11:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:37.600477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf37c0c-e1d6-4a2e-9f58-00f24f9a610f None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:37.600770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf37c0c-e1d6-4a2e-9f58-00f24f9a610f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:37.601053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf37c0c-e1d6-4a2e-9f58-00f24f9a610f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:37.618843 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-0bf37c0c-e1d6-4a2e-9f58-00f24f9a610f None None] MFA Rules not processed for user `5211ed409a3f43d281bca44382aa03fe`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:37.620082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0bf37c0c-e1d6-4a2e-9f58-00f24f9a610f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:37.626519 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 736/1474] 10.222.0.52 () {58 vars in 1059 bytes} [Thu Jun 23 11:04:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:37.634443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847fee1-8593-4fb0-a6b7-d15c9adf52aa None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:37.645414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9847fee1-8593-4fb0-a6b7-d15c9adf52aa None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:37.649522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb16ef-7ba6-4c1a-b673-ef7c127200e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5211ed409a3f43d281bca44382aa03fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:37.650147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb16ef-7ba6-4c1a-b673-ef7c127200e9 service glance] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:37.650425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb16ef-7ba6-4c1a-b673-ef7c127200e9 service glance] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:37.650699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb16ef-7ba6-4c1a-b673-ef7c127200e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:37.659490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb16ef-7ba6-4c1a-b673-ef7c127200e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:37.660942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb16ef-7ba6-4c1a-b673-ef7c127200e9 service glance] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:37.670283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 739/1475] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:39.835765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92818c9-a41e-44dd-a234-18ba5db941d7 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:39.836347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92818c9-a41e-44dd-a234-18ba5db941d7 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:39.836347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92818c9-a41e-44dd-a234-18ba5db941d7 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:39.837635 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 737/1476] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:39.843086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3010c5-5289-4c00-8fb3-b096de379d68 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:39.843581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3010c5-5289-4c00-8fb3-b096de379d68 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:39.843687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3010c5-5289-4c00-8fb3-b096de379d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:39.863470 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-be3010c5-5289-4c00-8fb3-b096de379d68 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:39.864744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-be3010c5-5289-4c00-8fb3-b096de379d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:39.873990 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 740/1477] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:39.903067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92818c9-a41e-44dd-a234-18ba5db941d7 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:39.916945 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92818c9-a41e-44dd-a234-18ba5db941d7 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:39.922076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8017d60e-2915-4d59-8459-b8ff09b8a80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:39.922732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d60e-2915-4d59-8459-b8ff09b8a80c admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:39.923015 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d60e-2915-4d59-8459-b8ff09b8a80c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:39.923291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8017d60e-2915-4d59-8459-b8ff09b8a80c admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:39.924136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017d60e-2915-4d59-8459-b8ff09b8a80c admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:39.927102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: WARNING py.warnings [None req-8017d60e-2915-4d59-8459-b8ff09b8a80c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:04:39.927102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: warnings.warn(msg) Jun 23 11:04:39.927102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: Jun 23 11:04:39.928861 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8017d60e-2915-4d59-8459-b8ff09b8a80c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:39.949353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 738/1478] 10.222.0.52 () {56 vars in 1108 bytes} [Thu Jun 23 11:04:39 2022] GET /identity/v3/projects => generated 2553 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:04:42.063336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849f925-c853-4126-b8b3-73e8f5fa01fe None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.063940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849f925-c853-4126-b8b3-73e8f5fa01fe None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.063940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c849f925-c853-4126-b8b3-73e8f5fa01fe None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.065285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 741/1479] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:42.071120 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383481a-2cb6-4bed-9b59-2ec675d48e15 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.071558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383481a-2cb6-4bed-9b59-2ec675d48e15 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.071660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383481a-2cb6-4bed-9b59-2ec675d48e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.089562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-1383481a-2cb6-4bed-9b59-2ec675d48e15 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:42.090770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1383481a-2cb6-4bed-9b59-2ec675d48e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:42.098702 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 739/1480] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:04:42.141601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849f925-c853-4126-b8b3-73e8f5fa01fe None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:42.155617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c849f925-c853-4126-b8b3-73e8f5fa01fe None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:42.161000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9172c-8cac-4f66-8533-4a6d72a4563f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:42.161634 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9172c-8cac-4f66-8533-4a6d72a4563f service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:42.161917 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9172c-8cac-4f66-8533-4a6d72a4563f service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:42.162195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9172c-8cac-4f66-8533-4a6d72a4563f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:42.171087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9172c-8cac-4f66-8533-4a6d72a4563f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:42.176797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9172c-8cac-4f66-8533-4a6d72a4563f service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:42.184391 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 742/1481] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:44.440290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d5e76-1d02-4a11-b54d-03c54caa8fc2 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:44.440832 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d5e76-1d02-4a11-b54d-03c54caa8fc2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:44.440832 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d5e76-1d02-4a11-b54d-03c54caa8fc2 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:44.442203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 740/1482] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:44.447662 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36b8f1-c42b-4f1a-abc7-c87e026e9f00 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:44.448160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36b8f1-c42b-4f1a-abc7-c87e026e9f00 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:44.448304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea36b8f1-c42b-4f1a-abc7-c87e026e9f00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:44.466045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ea36b8f1-c42b-4f1a-abc7-c87e026e9f00 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:44.467255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ea36b8f1-c42b-4f1a-abc7-c87e026e9f00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:44.475700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 743/1483] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:04:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:44.513475 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d5e76-1d02-4a11-b54d-03c54caa8fc2 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:44.524374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d5e76-1d02-4a11-b54d-03c54caa8fc2 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:44.527971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51555665-e39a-452c-9ac4-ad1dad1a5e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:44.528608 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555665-e39a-452c-9ac4-ad1dad1a5e42 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:44.528908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555665-e39a-452c-9ac4-ad1dad1a5e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:44.529215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51555665-e39a-452c-9ac4-ad1dad1a5e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:44.538888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51555665-e39a-452c-9ac4-ad1dad1a5e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:44.540298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51555665-e39a-452c-9ac4-ad1dad1a5e42 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:44.549806 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 741/1484] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:46.620150 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f220805-9f54-4737-a0ca-fea0a0249c43 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.620815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f220805-9f54-4737-a0ca-fea0a0249c43 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.620815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f220805-9f54-4737-a0ca-fea0a0249c43 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.622060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 744/1485] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:04:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:46.627436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4665b-01c7-4881-b592-f47a2d26d58e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.627974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4665b-01c7-4881-b592-f47a2d26d58e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.628076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4665b-01c7-4881-b592-f47a2d26d58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.646694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b0d4665b-01c7-4881-b592-f47a2d26d58e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:46.648474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b0d4665b-01c7-4881-b592-f47a2d26d58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:46.656781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 742/1486] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:04:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:46.695045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f220805-9f54-4737-a0ca-fea0a0249c43 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:46.705772 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f220805-9f54-4737-a0ca-fea0a0249c43 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:46.710070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d06f971-80df-41b9-a3a6-55d61a0568d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:46.710720 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06f971-80df-41b9-a3a6-55d61a0568d0 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:46.711000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06f971-80df-41b9-a3a6-55d61a0568d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:46.711275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d06f971-80df-41b9-a3a6-55d61a0568d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:46.720234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06f971-80df-41b9-a3a6-55d61a0568d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:46.723194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d06f971-80df-41b9-a3a6-55d61a0568d0 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:46.731092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 745/1487] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:48.883755 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ca21d-2e95-4af0-8833-a59797eebe55 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:48.884313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ca21d-2e95-4af0-8833-a59797eebe55 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:48.884313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ca21d-2e95-4af0-8833-a59797eebe55 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:48.885629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 743/1488] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:48.891098 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2832f-95f5-4a7c-841c-649be43f7728 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:48.891551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2832f-95f5-4a7c-841c-649be43f7728 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:48.891748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe2832f-95f5-4a7c-841c-649be43f7728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:48.909953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-bfe2832f-95f5-4a7c-841c-649be43f7728 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:48.911166 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-bfe2832f-95f5-4a7c-841c-649be43f7728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:48.919113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 746/1489] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:04:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:48.961552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ca21d-2e95-4af0-8833-a59797eebe55 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:48.972988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ca21d-2e95-4af0-8833-a59797eebe55 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:48.976590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e62587-75c6-4e66-b599-f999a8392a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:48.977237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e62587-75c6-4e66-b599-f999a8392a95 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:48.977520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e62587-75c6-4e66-b599-f999a8392a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:48.977797 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e62587-75c6-4e66-b599-f999a8392a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:48.987201 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e62587-75c6-4e66-b599-f999a8392a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:48.988684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e62587-75c6-4e66-b599-f999a8392a95 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:48.998487 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 744/1490] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:04:51.473483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750711-e95a-41e0-8619-aed290ab7bd4 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:51.474039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750711-e95a-41e0-8619-aed290ab7bd4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:51.474039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1750711-e95a-41e0-8619-aed290ab7bd4 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:51.476043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 747/1491] 10.222.0.52 () {54 vars in 926 bytes} [Thu Jun 23 11:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:04:51.481317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefcb40-f1b3-4d61-92f2-745d4703c2b8 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:51.481738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefcb40-f1b3-4d61-92f2-745d4703c2b8 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:51.481879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eefcb40-f1b3-4d61-92f2-745d4703c2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:51.499350 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4eefcb40-f1b3-4d61-92f2-745d4703c2b8 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:04:51.500581 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4eefcb40-f1b3-4d61-92f2-745d4703c2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:04:51.508460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 745/1492] 10.222.0.52 () {58 vars in 1023 bytes} [Thu Jun 23 11:04:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:04:51.547376 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1750711-e95a-41e0-8619-aed290ab7bd4 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:04:51.558136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1750711-e95a-41e0-8619-aed290ab7bd4 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:04:51.561702 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46775a-c918-4edf-ac1a-60a792c73c5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:04:51.562334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46775a-c918-4edf-ac1a-60a792c73c5a service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:04:51.562624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46775a-c918-4edf-ac1a-60a792c73c5a service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:04:51.562901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46775a-c918-4edf-ac1a-60a792c73c5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:04:51.571973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46775a-c918-4edf-ac1a-60a792c73c5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:04:51.573413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df46775a-c918-4edf-ac1a-60a792c73c5a service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:04:51.584178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 748/1493] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:04:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:05:01.494339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=33 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:05:01.579284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=33 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:25.967696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03a61-aca3-43bc-9077-9f9b0ba95f03 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:25.972562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03a61-aca3-43bc-9077-9f9b0ba95f03 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:25.972562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae03a61-aca3-43bc-9077-9f9b0ba95f03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:25.986178 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-6ae03a61-aca3-43bc-9077-9f9b0ba95f03 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:25.987388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6ae03a61-aca3-43bc-9077-9f9b0ba95f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:25.995730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 746/1494] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:26.005803 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167bd92-64ae-43d8-be9d-ab806e16c705 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.006394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167bd92-64ae-43d8-be9d-ab806e16c705 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.006394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6167bd92-64ae-43d8-be9d-ab806e16c705 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.024083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-6167bd92-64ae-43d8-be9d-ab806e16c705 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:26.025277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-6167bd92-64ae-43d8-be9d-ab806e16c705 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:26.033543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 749/1495] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:06:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:26.037826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae03a61-aca3-43bc-9077-9f9b0ba95f03 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:26.047483 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae03a61-aca3-43bc-9077-9f9b0ba95f03 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:26.052726 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec6761-d7e6-4822-8876-cc42da113fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:26.053379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec6761-d7e6-4822-8876-cc42da113fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.053690 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec6761-d7e6-4822-8876-cc42da113fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.053970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dec6761-d7e6-4822-8876-cc42da113fa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.054690 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec6761-d7e6-4822-8876-cc42da113fa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:06:26.054999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec6761-d7e6-4822-8876-cc42da113fa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:26.056063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: WARNING py.warnings [None req-9dec6761-d7e6-4822-8876-cc42da113fa4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:06:26.056063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: warnings.warn(msg) Jun 23 11:06:26.056063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: Jun 23 11:06:26.056956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dec6761-d7e6-4822-8876-cc42da113fa4 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:26.069493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 747/1496] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:06:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:06:26.077198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167bd92-64ae-43d8-be9d-ab806e16c705 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:26.086765 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6167bd92-64ae-43d8-be9d-ab806e16c705 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:26.095004 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63faaf3-09b4-4fdc-a6a8-4190fae001dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:26.096935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63faaf3-09b4-4fdc-a6a8-4190fae001dd admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.097253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63faaf3-09b4-4fdc-a6a8-4190fae001dd admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.097540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63faaf3-09b4-4fdc-a6a8-4190fae001dd admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.098258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63faaf3-09b4-4fdc-a6a8-4190fae001dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:26.100116 dv-cinder-826607-6-smb devstack@keystone.service[75629]: WARNING py.warnings [None req-b63faaf3-09b4-4fdc-a6a8-4190fae001dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:06:26.100116 dv-cinder-826607-6-smb devstack@keystone.service[75629]: warnings.warn(msg) Jun 23 11:06:26.100116 dv-cinder-826607-6-smb devstack@keystone.service[75629]: Jun 23 11:06:26.101324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63faaf3-09b4-4fdc-a6a8-4190fae001dd admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:26.255591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 750/1497] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:06:26 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:06:26.259991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec6761-d7e6-4822-8876-cc42da113fa4 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:26.270232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dec6761-d7e6-4822-8876-cc42da113fa4 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:26.327425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2768e9f-329e-4e65-8c0a-ae8698c69933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:26.328110 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2768e9f-329e-4e65-8c0a-ae8698c69933 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.328393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2768e9f-329e-4e65-8c0a-ae8698c69933 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.328669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2768e9f-329e-4e65-8c0a-ae8698c69933 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.329357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2768e9f-329e-4e65-8c0a-ae8698c69933 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:26.330632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: WARNING py.warnings [None req-a2768e9f-329e-4e65-8c0a-ae8698c69933 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:06:26.330632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: warnings.warn(msg) Jun 23 11:06:26.330632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: Jun 23 11:06:26.331913 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2768e9f-329e-4e65-8c0a-ae8698c69933 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:26.448127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 748/1498] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:06:26 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:06:26.452233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63faaf3-09b4-4fdc-a6a8-4190fae001dd admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:26.462891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63faaf3-09b4-4fdc-a6a8-4190fae001dd admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:26.467308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b518d5-1682-4c52-99d8-87ae86976518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:26.467989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b518d5-1682-4c52-99d8-87ae86976518 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.468274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b518d5-1682-4c52-99d8-87ae86976518 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.468544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b518d5-1682-4c52-99d8-87ae86976518 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.469282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b518d5-1682-4c52-99d8-87ae86976518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:26.470294 dv-cinder-826607-6-smb devstack@keystone.service[75629]: WARNING py.warnings [None req-91b518d5-1682-4c52-99d8-87ae86976518 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:06:26.470294 dv-cinder-826607-6-smb devstack@keystone.service[75629]: warnings.warn(msg) Jun 23 11:06:26.470294 dv-cinder-826607-6-smb devstack@keystone.service[75629]: Jun 23 11:06:26.471166 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b518d5-1682-4c52-99d8-87ae86976518 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:26.484275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 751/1499] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:06:26.488280 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2768e9f-329e-4e65-8c0a-ae8698c69933 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:26.501512 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2768e9f-329e-4e65-8c0a-ae8698c69933 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:26.508021 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d14e0c-b54b-4a18-8d08-632fd7049bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:26.509054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d14e0c-b54b-4a18-8d08-632fd7049bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.509485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d14e0c-b54b-4a18-8d08-632fd7049bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.509775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d14e0c-b54b-4a18-8d08-632fd7049bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.510743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d14e0c-b54b-4a18-8d08-632fd7049bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:26.512174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: WARNING py.warnings [None req-82d14e0c-b54b-4a18-8d08-632fd7049bb8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:06:26.512174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: warnings.warn(msg) Jun 23 11:06:26.512174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: Jun 23 11:06:26.513126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d14e0c-b54b-4a18-8d08-632fd7049bb8 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:26.527942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 749/1500] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:06:26.532108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b518d5-1682-4c52-99d8-87ae86976518 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:26.542457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b518d5-1682-4c52-99d8-87ae86976518 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:26.546912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c197aef4-0a13-42c7-8e51-bbd9b23877e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:26.547777 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197aef4-0a13-42c7-8e51-bbd9b23877e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.548087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197aef4-0a13-42c7-8e51-bbd9b23877e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.548362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c197aef4-0a13-42c7-8e51-bbd9b23877e3 admin admin] PATH_INFO: `/v3/projects/39304015d294488681042be60f51a005/users/a9e788617edc4277b713b195c1f7dd66/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.563689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197aef4-0a13-42c7-8e51-bbd9b23877e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39304015d294488681042be60f51a005, user_id=a9e788617edc4277b713b195c1f7dd66, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:26.564746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: WARNING py.warnings [None req-c197aef4-0a13-42c7-8e51-bbd9b23877e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:06:26.564746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: warnings.warn(msg) Jun 23 11:06:26.564746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: Jun 23 11:06:26.566935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c197aef4-0a13-42c7-8e51-bbd9b23877e3 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:26.740174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 752/1501] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:06:26 2022] PUT /identity/v3/projects/39304015d294488681042be60f51a005/users/a9e788617edc4277b713b195c1f7dd66/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:06:26.751512 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8fa2e-6518-4c52-a8f2-36d1b4f73360 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.751802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8fa2e-6518-4c52-a8f2-36d1b4f73360 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.752106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e8fa2e-6518-4c52-a8f2-36d1b4f73360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.778497 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b2e8fa2e-6518-4c52-a8f2-36d1b4f73360 None None] MFA Rules not processed for user `a9e788617edc4277b713b195c1f7dd66`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:26.779627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b2e8fa2e-6518-4c52-a8f2-36d1b4f73360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:26.844192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 750/1502] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:06:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:26.859075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b85fd-ce72-4557-a487-4dcf49456aa3 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.859075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b85fd-ce72-4557-a487-4dcf49456aa3 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.859075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341b85fd-ce72-4557-a487-4dcf49456aa3 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.859967 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 753/1503] 10.222.0.52 () {54 vars in 963 bytes} [Thu Jun 23 11:06:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:06:26.865412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb123-3631-4b40-af3f-cfd511f913f9 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.865701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb123-3631-4b40-af3f-cfd511f913f9 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.865982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0fb123-3631-4b40-af3f-cfd511f913f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.883733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-0d0fb123-3631-4b40-af3f-cfd511f913f9 None None] MFA Rules not processed for user `71539f69f3c8446ca7e9833d244d20fb`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:26.884955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0d0fb123-3631-4b40-af3f-cfd511f913f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:26.928760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:26.935993 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 751/1504] 10.222.0.52 () {58 vars in 1060 bytes} [Thu Jun 23 11:06:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:06:26.943550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b85fd-ce72-4557-a487-4dcf49456aa3 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:26.954343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341b85fd-ce72-4557-a487-4dcf49456aa3 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:26.958772 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aebc18-b524-4001-a578-c7a9f25670ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:26.959404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aebc18-b524-4001-a578-c7a9f25670ea service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:26.959691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aebc18-b524-4001-a578-c7a9f25670ea service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:26.960009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aebc18-b524-4001-a578-c7a9f25670ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:26.968386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aebc18-b524-4001-a578-c7a9f25670ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:26.970427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aebc18-b524-4001-a578-c7a9f25670ea service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:26.979654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 754/1505] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:06:26 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:06:27.025539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b95b7b-e28f-4d73-a6cd-637cfbb4d522 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:27.025985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b95b7b-e28f-4d73-a6cd-637cfbb4d522 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:27.026094 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b95b7b-e28f-4d73-a6cd-637cfbb4d522 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:27.027382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 752/1506] 10.222.0.52 () {52 vars in 829 bytes} [Thu Jun 23 11:06:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:06:27.030974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aebc18-b524-4001-a578-c7a9f25670ea service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:27.095201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aebc18-b524-4001-a578-c7a9f25670ea service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:27.100417 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:27.101291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:27.101572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:27.101850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] PATH_INFO: `/v3/users/a9e788617edc4277b713b195c1f7dd66` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:27.103053 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e788617edc4277b713b195c1f7dd66)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:27.104105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: WARNING py.warnings [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:06:27.104105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: warnings.warn(msg) Jun 23 11:06:27.104105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: Jun 23 11:06:27.105339 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:27.539749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e788617edc4277b713b195c1f7dd66'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:27.540403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e788617edc4277b713b195c1f7dd66'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:27.541099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e788617edc4277b713b195c1f7dd66'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:27.607989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e788617edc4277b713b195c1f7dd66'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:27.621767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e788617edc4277b713b195c1f7dd66'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:27.638714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:27.646835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 755/1507] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:06:27 2022] DELETE /identity/v3/users/a9e788617edc4277b713b195c1f7dd66 => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:06:27.651199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de352ad4-7747-4f61-b983-979ac4ed5d30 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:27.651486 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de352ad4-7747-4f61-b983-979ac4ed5d30 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:27.651776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de352ad4-7747-4f61-b983-979ac4ed5d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:27.669390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-de352ad4-7747-4f61-b983-979ac4ed5d30 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:06:27.670672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-de352ad4-7747-4f61-b983-979ac4ed5d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:27.730743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 753/1508] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:06:27.740899 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:27.742348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:27.802162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31336ba-a8c1-4282-8301-1240d265b1e6 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:27.805664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b5ec2-e484-461f-8a0b-e36b8ab18073 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:27.806319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5ec2-e484-461f-8a0b-e36b8ab18073 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:27.806605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5ec2-e484-461f-8a0b-e36b8ab18073 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:27.806887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b5ec2-e484-461f-8a0b-e36b8ab18073 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:27.815833 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b5ec2-e484-461f-8a0b-e36b8ab18073 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:27.817321 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b5ec2-e484-461f-8a0b-e36b8ab18073 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:27.826801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 756/1509] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:06:28.381792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de352ad4-7747-4f61-b983-979ac4ed5d30 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:06:28.383274 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-de352ad4-7747-4f61-b983-979ac4ed5d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:06:28.395934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de352ad4-7747-4f61-b983-979ac4ed5d30 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:06:28.401255 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:06:28.402478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:06:28.402769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:06:28.403050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] PATH_INFO: `/v3/projects/39304015d294488681042be60f51a005` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:06:28.404333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39304015d294488681042be60f51a005)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:06:28.405374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: WARNING py.warnings [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:06:28.405374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: warnings.warn(msg) Jun 23 11:06:28.405374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: Jun 23 11:06:28.406729 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:06:28.538040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39304015d294488681042be60f51a005', 'request_id': 'req-22d261b7-09be-49a7-8bec-db3b75e776f2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:28.544756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39304015d294488681042be60f51a005', 'request_id': 'req-22d261b7-09be-49a7-8bec-db3b75e776f2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:28.558732 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39304015d294488681042be60f51a005', 'request_id': 'req-22d261b7-09be-49a7-8bec-db3b75e776f2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:28.665470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] The token cache is being invalidate because project 39304015d294488681042be60f51a005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:06:28.665760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:28.666640 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-22d261b7-09be-49a7-8bec-db3b75e776f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:06:28.668231 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 754/1510] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:06:28 2022] DELETE /identity/v3/projects/39304015d294488681042be60f51a005 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:06:37.822585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:06:38.661904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:14.315596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f1381-9a3d-4277-910d-141f55d20b41 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:14.316245 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f1381-9a3d-4277-910d-141f55d20b41 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:14.316245 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1f1381-9a3d-4277-910d-141f55d20b41 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:14.317632 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:08:14.323431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab00dbe-8cd4-4b25-85b2-6199a80d8642 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:14.324122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab00dbe-8cd4-4b25-85b2-6199a80d8642 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:14.324122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab00dbe-8cd4-4b25-85b2-6199a80d8642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:14.342495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-eab00dbe-8cd4-4b25-85b2-6199a80d8642 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:08:14.343747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-eab00dbe-8cd4-4b25-85b2-6199a80d8642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:14.402225 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:08:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:08:14.556193 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f1381-9a3d-4277-910d-141f55d20b41 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:08:14.558615 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3a1f1381-9a3d-4277-910d-141f55d20b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:14.635459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1f1381-9a3d-4277-910d-141f55d20b41 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:08:14.641078 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8237270c-eac3-41b3-995d-d857042b96bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:08:14.641729 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237270c-eac3-41b3-995d-d857042b96bf service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:14.642019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237270c-eac3-41b3-995d-d857042b96bf service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:14.642304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8237270c-eac3-41b3-995d-d857042b96bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:14.651606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237270c-eac3-41b3-995d-d857042b96bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:08:14.653250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8237270c-eac3-41b3-995d-d857042b96bf service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:08:14.662576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 758/1513] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:08:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:08:15.513389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db060ac7-7add-4f9e-8898-63b0857c97cb None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:15.513990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db060ac7-7add-4f9e-8898-63b0857c97cb None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:15.513990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db060ac7-7add-4f9e-8898-63b0857c97cb None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:15.515290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:08:15.520234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18f204-123f-4e45-9691-1ba283aefe0c None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:15.520630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18f204-123f-4e45-9691-1ba283aefe0c None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:15.520831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18f204-123f-4e45-9691-1ba283aefe0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:15.538854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-fb18f204-123f-4e45-9691-1ba283aefe0c None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:08:15.540106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-fb18f204-123f-4e45-9691-1ba283aefe0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:15.548801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:08:15.700200 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db060ac7-7add-4f9e-8898-63b0857c97cb None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:08:15.715216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db060ac7-7add-4f9e-8898-63b0857c97cb None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:08:15.720866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95afa47e-6041-4b0e-9ae8-a46eacf30fc6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:08:15.721503 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afa47e-6041-4b0e-9ae8-a46eacf30fc6 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:15.721783 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afa47e-6041-4b0e-9ae8-a46eacf30fc6 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:15.722060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95afa47e-6041-4b0e-9ae8-a46eacf30fc6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:15.731084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afa47e-6041-4b0e-9ae8-a46eacf30fc6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:08:15.732742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95afa47e-6041-4b0e-9ae8-a46eacf30fc6 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:08:15.742596 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 757/1516] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:08:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:08:16.272675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda0d80-8dc4-43d2-8a28-4b4ca785a7ab None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:16.272956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda0d80-8dc4-43d2-8a28-4b4ca785a7ab None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:16.273251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fda0d80-8dc4-43d2-8a28-4b4ca785a7ab None None] PATH_INFO: `/v3` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:16.274549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 760/1517] 10.222.0.23 () {54 vars in 925 bytes} [Thu Jun 23 11:08:16 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:08:16.280828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ee1a9-1363-4391-b5d0-d5449b896dd4 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:16.281121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ee1a9-1363-4391-b5d0-d5449b896dd4 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:16.281405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392ee1a9-1363-4391-b5d0-d5449b896dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:16.301415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-392ee1a9-1363-4391-b5d0-d5449b896dd4 None None] MFA Rules not processed for user `e838dd9aa24f4571b64719125610c528`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:08:16.302642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-392ee1a9-1363-4391-b5d0-d5449b896dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:16.364086 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 758/1518] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Jun 23 11:08:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:08:20.242784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577a33c-45aa-4e90-ba41-3c169bb27304 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:20.243317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577a33c-45aa-4e90-ba41-3c169bb27304 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:20.243317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f577a33c-45aa-4e90-ba41-3c169bb27304 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:20.245368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 761/1519] 10.222.0.52 () {54 vars in 960 bytes} [Thu Jun 23 11:08:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:08:20.250253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58507a0-57a3-4db9-b905-2a7abb3a2515 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:20.250697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58507a0-57a3-4db9-b905-2a7abb3a2515 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:20.250802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58507a0-57a3-4db9-b905-2a7abb3a2515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:20.269012 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-e58507a0-57a3-4db9-b905-2a7abb3a2515 None None] MFA Rules not processed for user `e838dd9aa24f4571b64719125610c528`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:08:20.270236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e58507a0-57a3-4db9-b905-2a7abb3a2515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:20.278942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 759/1520] 10.222.0.52 () {58 vars in 1057 bytes} [Thu Jun 23 11:08:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:08:20.286779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577a33c-45aa-4e90-ba41-3c169bb27304 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:08:20.300045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f577a33c-45aa-4e90-ba41-3c169bb27304 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:08:20.304868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da46cdb4-9153-4376-9598-d66f81940862 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e838dd9aa24f4571b64719125610c528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:08:20.305497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46cdb4-9153-4376-9598-d66f81940862 service placement] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:20.305776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46cdb4-9153-4376-9598-d66f81940862 service placement] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:20.306051 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da46cdb4-9153-4376-9598-d66f81940862 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:20.314765 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46cdb4-9153-4376-9598-d66f81940862 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:08:20.316380 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da46cdb4-9153-4376-9598-d66f81940862 service placement] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:08:20.326912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 762/1521] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:08:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:08:26.970899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cb026-9370-4c13-85c3-60c42240d2b3 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:26.971362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cb026-9370-4c13-85c3-60c42240d2b3 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:26.971475 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3cb026-9370-4c13-85c3-60c42240d2b3 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:26.972879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:08:26.977620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386a4da-3866-43d8-97a4-4b0963be4577 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:26.978026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386a4da-3866-43d8-97a4-4b0963be4577 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:26.978215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1386a4da-3866-43d8-97a4-4b0963be4577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:26.996451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-1386a4da-3866-43d8-97a4-4b0963be4577 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:08:26.997623 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-1386a4da-3866-43d8-97a4-4b0963be4577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:27.005394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:08:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:08:27.164075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cb026-9370-4c13-85c3-60c42240d2b3 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:08:27.178730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3cb026-9370-4c13-85c3-60c42240d2b3 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:08:27.184053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cc62e-e773-4bfa-a100-c999831cc4a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:08:27.184680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cc62e-e773-4bfa-a100-c999831cc4a0 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:27.184961 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cc62e-e773-4bfa-a100-c999831cc4a0 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:27.185235 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cc62e-e773-4bfa-a100-c999831cc4a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:27.193273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cc62e-e773-4bfa-a100-c999831cc4a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:08:27.194854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764cc62e-e773-4bfa-a100-c999831cc4a0 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:08:27.205116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 761/1524] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:08:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:08:28.027567 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301ea4f-8158-4a91-af75-87f949b54414 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:28.028139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301ea4f-8158-4a91-af75-87f949b54414 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:28.028139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301ea4f-8158-4a91-af75-87f949b54414 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:28.029537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 23 11:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:08:28.034781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b7b30-7c5a-411c-a78e-bb80b0cb883e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:28.035231 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b7b30-7c5a-411c-a78e-bb80b0cb883e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:28.035344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b7b30-7c5a-411c-a78e-bb80b0cb883e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:28.052897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-330b7b30-7c5a-411c-a78e-bb80b0cb883e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:08:28.054099 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-330b7b30-7c5a-411c-a78e-bb80b0cb883e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:28.061996 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 23 11:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:08:28.213258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301ea4f-8158-4a91-af75-87f949b54414 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:08:28.228309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301ea4f-8158-4a91-af75-87f949b54414 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:08:28.233764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edefa40f-b127-4ad1-97f7-1629bb975c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:08:28.234394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefa40f-b127-4ad1-97f7-1629bb975c46 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:28.234681 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefa40f-b127-4ad1-97f7-1629bb975c46 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:28.234966 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edefa40f-b127-4ad1-97f7-1629bb975c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:28.243120 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefa40f-b127-4ad1-97f7-1629bb975c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:08:28.244757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edefa40f-b127-4ad1-97f7-1629bb975c46 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:08:28.254326 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 765/1527] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:08:32.254851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda90be-3041-43ad-9a78-0d6ee3e088aa None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:32.255501 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda90be-3041-43ad-9a78-0d6ee3e088aa None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:32.255501 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda90be-3041-43ad-9a78-0d6ee3e088aa None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:32.256773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:08:32.262370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07c469-849b-44d3-ad8b-0d34809a36a1 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:32.264311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07c469-849b-44d3-ad8b-0d34809a36a1 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:32.264311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f07c469-849b-44d3-ad8b-0d34809a36a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:32.281611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-5f07c469-849b-44d3-ad8b-0d34809a36a1 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:08:32.282831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5f07c469-849b-44d3-ad8b-0d34809a36a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:32.290789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:08:32.327879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda90be-3041-43ad-9a78-0d6ee3e088aa None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:08:32.329688 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ecda90be-3041-43ad-9a78-0d6ee3e088aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:32.387172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda90be-3041-43ad-9a78-0d6ee3e088aa None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:08:32.390797 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20d871-b52d-4f5d-aab5-2582259b15d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:08:32.391412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20d871-b52d-4f5d-aab5-2582259b15d4 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:32.391698 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20d871-b52d-4f5d-aab5-2582259b15d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:32.392012 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20d871-b52d-4f5d-aab5-2582259b15d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:32.401030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20d871-b52d-4f5d-aab5-2582259b15d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:08:32.402997 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d20d871-b52d-4f5d-aab5-2582259b15d4 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:08:32.408169 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:32.413053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 764/1530] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:08:34.488605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94295409-5290-43e9-b0e4-d3c1266f765b None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:34.489178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94295409-5290-43e9-b0e4-d3c1266f765b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:34.489178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94295409-5290-43e9-b0e4-d3c1266f765b None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:34.490543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 23 11:08:34.496513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b771a9c-2c56-4eeb-85e0-3f78b48d2e6f None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:34.496941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b771a9c-2c56-4eeb-85e0-3f78b48d2e6f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:34.497108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b771a9c-2c56-4eeb-85e0-3f78b48d2e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:34.515921 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3b771a9c-2c56-4eeb-85e0-3f78b48d2e6f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:08:34.517131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3b771a9c-2c56-4eeb-85e0-3f78b48d2e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:34.524965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:08:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:08:34.560346 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94295409-5290-43e9-b0e4-d3c1266f765b None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:08:34.571363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94295409-5290-43e9-b0e4-d3c1266f765b None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:08:34.575597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899824d-5de9-45e3-80d4-22bbc872a2a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:08:34.578548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899824d-5de9-45e3-80d4-22bbc872a2a2 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:34.578548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899824d-5de9-45e3-80d4-22bbc872a2a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:34.578548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899824d-5de9-45e3-80d4-22bbc872a2a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:34.587834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899824d-5de9-45e3-80d4-22bbc872a2a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:08:34.589338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899824d-5de9-45e3-80d4-22bbc872a2a2 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:08:34.598841 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 768/1533] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:08:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:08:38.127055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9d401-23a1-453e-a2b0-cd4c1a87aff7 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:38.127647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9d401-23a1-453e-a2b0-cd4c1a87aff7 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:38.127647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f9d401-23a1-453e-a2b0-cd4c1a87aff7 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:38.129030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:08:38.134292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d3751-7219-4ebe-a055-12a4f9abff5d None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:38.134724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d3751-7219-4ebe-a055-12a4f9abff5d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:38.134867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542d3751-7219-4ebe-a055-12a4f9abff5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:38.141237 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=62 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:38.153564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-542d3751-7219-4ebe-a055-12a4f9abff5d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:08:38.154761 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-542d3751-7219-4ebe-a055-12a4f9abff5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:38.162902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:08:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:08:38.470254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9d401-23a1-453e-a2b0-cd4c1a87aff7 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:08:38.471967 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-35f9d401-23a1-453e-a2b0-cd4c1a87aff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:38.528323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f9d401-23a1-453e-a2b0-cd4c1a87aff7 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:08:38.531909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259fc29-f36a-40cc-bcc9-09da32c45b4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:08:38.532545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259fc29-f36a-40cc-bcc9-09da32c45b4a service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:38.532853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259fc29-f36a-40cc-bcc9-09da32c45b4a service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:38.533125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259fc29-f36a-40cc-bcc9-09da32c45b4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:38.542241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259fc29-f36a-40cc-bcc9-09da32c45b4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:08:38.543657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259fc29-f36a-40cc-bcc9-09da32c45b4a service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:08:38.552987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 767/1536] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:08:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:08:40.643589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b01ae0-64d2-4b93-9057-d9f576ef38e7 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:40.644176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b01ae0-64d2-4b93-9057-d9f576ef38e7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:40.644176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b01ae0-64d2-4b93-9057-d9f576ef38e7 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:40.645554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 23 11:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:08:40.650830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620db31-3880-4a63-8992-3ca583a422db None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:40.651270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620db31-3880-4a63-8992-3ca583a422db None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:40.651427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a620db31-3880-4a63-8992-3ca583a422db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:40.669756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-a620db31-3880-4a63-8992-3ca583a422db None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:08:40.670957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a620db31-3880-4a63-8992-3ca583a422db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:40.678714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 23 11:08:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:08:40.984147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b01ae0-64d2-4b93-9057-d9f576ef38e7 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:08:40.985882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-70b01ae0-64d2-4b93-9057-d9f576ef38e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:08:40.999920 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b01ae0-64d2-4b93-9057-d9f576ef38e7 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:08:41.003436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2624d2-a8e7-4c2f-9a83-069708ef707a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:08:41.004115 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2624d2-a8e7-4c2f-9a83-069708ef707a service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:08:41.004404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2624d2-a8e7-4c2f-9a83-069708ef707a service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:08:41.004683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2624d2-a8e7-4c2f-9a83-069708ef707a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:08:41.013830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2624d2-a8e7-4c2f-9a83-069708ef707a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:08:41.015297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2624d2-a8e7-4c2f-9a83-069708ef707a service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:08:41.024856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 771/1539] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:08:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:08:50.663975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=32 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:08:51.020660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=8 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:12.886358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514111de-cf12-4192-b488-bceff5e845da None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:12.887615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514111de-cf12-4192-b488-bceff5e845da None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:12.887615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514111de-cf12-4192-b488-bceff5e845da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:12.910224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-514111de-cf12-4192-b488-bceff5e845da None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:12.911442 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-514111de-cf12-4192-b488-bceff5e845da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:12.923533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 769/1540] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:12.941108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9bcb-af3d-406e-9dc0-214d62dda618 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:12.941715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9bcb-af3d-406e-9dc0-214d62dda618 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:12.941715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8b9bcb-af3d-406e-9dc0-214d62dda618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:12.951172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164bef9-64a4-4724-9e2b-0716fe5a720f None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:12.952126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164bef9-64a4-4724-9e2b-0716fe5a720f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:12.952661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d164bef9-64a4-4724-9e2b-0716fe5a720f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:12.965583 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-7d8b9bcb-af3d-406e-9dc0-214d62dda618 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:12.966973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7d8b9bcb-af3d-406e-9dc0-214d62dda618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:12.976465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-d164bef9-64a4-4724-9e2b-0716fe5a720f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:12.978005 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d164bef9-64a4-4724-9e2b-0716fe5a720f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:12.985618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 772/1541] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:12.987468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670643e-bb75-4e70-b382-638cd4188d4a None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:12.987962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670643e-bb75-4e70-b382-638cd4188d4a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:12.988416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8670643e-bb75-4e70-b382-638cd4188d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:12.998742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 770/1542] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:10:13.000264 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f5783-3d51-4d45-830c-12e5a736f676 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.000805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f5783-3d51-4d45-830c-12e5a736f676 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.001313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297f5783-3d51-4d45-830c-12e5a736f676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.017036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-8670643e-bb75-4e70-b382-638cd4188d4a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.018602 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8670643e-bb75-4e70-b382-638cd4188d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.030577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-297f5783-3d51-4d45-830c-12e5a736f676 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.032538 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 773/1543] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.033012 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-297f5783-3d51-4d45-830c-12e5a736f676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.033951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670643e-bb75-4e70-b382-638cd4188d4a None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.052754 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 771/1544] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.055425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8670643e-bb75-4e70-b382-638cd4188d4a None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.057022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650be0f7-16da-4797-a888-329999f62641 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.058378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650be0f7-16da-4797-a888-329999f62641 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.058900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650be0f7-16da-4797-a888-329999f62641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.066514 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a2292-eb12-4c84-9376-623413197490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.067569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a2292-eb12-4c84-9376-623413197490 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.068223 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a2292-eb12-4c84-9376-623413197490 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.068732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a2292-eb12-4c84-9376-623413197490 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.069680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a2292-eb12-4c84-9376-623413197490 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:13.070213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a2292-eb12-4c84-9376-623413197490 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.072225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: WARNING py.warnings [None req-2c4a2292-eb12-4c84-9376-623413197490 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:10:13.072225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: warnings.warn(msg) Jun 23 11:10:13.072225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: Jun 23 11:10:13.073841 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4a2292-eb12-4c84-9376-623413197490 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.081106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-650be0f7-16da-4797-a888-329999f62641 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.082343 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-650be0f7-16da-4797-a888-329999f62641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.088497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 774/1545] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:13.089985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6349-14b2-485d-a640-2b97f1088d83 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.090284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6349-14b2-485d-a640-2b97f1088d83 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.090604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e6349-14b2-485d-a640-2b97f1088d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.098653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 772/1546] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.099967 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde731a-cd73-4833-9d90-392c99e0a6f7 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.100259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde731a-cd73-4833-9d90-392c99e0a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.100535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cde731a-cd73-4833-9d90-392c99e0a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.116625 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-fb9e6349-14b2-485d-a640-2b97f1088d83 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.117846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-fb9e6349-14b2-485d-a640-2b97f1088d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.119455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5cde731a-cd73-4833-9d90-392c99e0a6f7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.120657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5cde731a-cd73-4833-9d90-392c99e0a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.126450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 775/1547] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.127802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c91a4-97cf-4469-b6ba-03993b62d8ee None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.128120 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c91a4-97cf-4469-b6ba-03993b62d8ee None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.128405 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c91a4-97cf-4469-b6ba-03993b62d8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.132491 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 773/1548] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.133883 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0583fb4-b35a-415b-a3bb-cb5a4d03a058 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.134235 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0583fb4-b35a-415b-a3bb-cb5a4d03a058 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.134878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0583fb4-b35a-415b-a3bb-cb5a4d03a058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.159508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a33c91a4-97cf-4469-b6ba-03993b62d8ee None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.159508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a33c91a4-97cf-4469-b6ba-03993b62d8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.159842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-c0583fb4-b35a-415b-a3bb-cb5a4d03a058 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.159842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c0583fb4-b35a-415b-a3bb-cb5a4d03a058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.164209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 776/1549] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.165528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87196b-ac9c-4bec-be30-bfbcb973332b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.165826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87196b-ac9c-4bec-be30-bfbcb973332b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.166093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca87196b-ac9c-4bec-be30-bfbcb973332b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.167292 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 774/1550] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.167934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0583fb4-b35a-415b-a3bb-cb5a4d03a058 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.178387 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0583fb4-b35a-415b-a3bb-cb5a4d03a058 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.183090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653feeb8-7103-4206-bc18-d8e8ebc83d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.183746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653feeb8-7103-4206-bc18-d8e8ebc83d50 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.184057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653feeb8-7103-4206-bc18-d8e8ebc83d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.184344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653feeb8-7103-4206-bc18-d8e8ebc83d50 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.185036 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653feeb8-7103-4206-bc18-d8e8ebc83d50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.186067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: WARNING py.warnings [None req-653feeb8-7103-4206-bc18-d8e8ebc83d50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:10:13.186067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: warnings.warn(msg) Jun 23 11:10:13.186067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: Jun 23 11:10:13.187271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653feeb8-7103-4206-bc18-d8e8ebc83d50 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.189194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ca87196b-ac9c-4bec-be30-bfbcb973332b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.190386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ca87196b-ac9c-4bec-be30-bfbcb973332b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.198792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 777/1551] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.205258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843579e0-db19-41aa-9449-991864fc1f0c None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.205258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843579e0-db19-41aa-9449-991864fc1f0c None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.205258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843579e0-db19-41aa-9449-991864fc1f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.223152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-843579e0-db19-41aa-9449-991864fc1f0c None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.224421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-843579e0-db19-41aa-9449-991864fc1f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.232936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 778/1552] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.233708 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843579e0-db19-41aa-9449-991864fc1f0c None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.243314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843579e0-db19-41aa-9449-991864fc1f0c None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.248234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381a3f1-b475-441d-b637-5170c2bdc708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.248888 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381a3f1-b475-441d-b637-5170c2bdc708 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.249177 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381a3f1-b475-441d-b637-5170c2bdc708 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.249458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381a3f1-b475-441d-b637-5170c2bdc708 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.250270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381a3f1-b475-441d-b637-5170c2bdc708 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:13.250572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381a3f1-b475-441d-b637-5170c2bdc708 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.252230 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381a3f1-b475-441d-b637-5170c2bdc708 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.263973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 779/1553] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:13.264762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381a3f1-b475-441d-b637-5170c2bdc708 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.274128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381a3f1-b475-441d-b637-5170c2bdc708 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.279143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0c0bc-51ce-4031-aba1-92af7112cfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.279832 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0c0bc-51ce-4031-aba1-92af7112cfef admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.280204 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0c0bc-51ce-4031-aba1-92af7112cfef admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.280485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0c0bc-51ce-4031-aba1-92af7112cfef admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.281202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0c0bc-51ce-4031-aba1-92af7112cfef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:13.281509 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0c0bc-51ce-4031-aba1-92af7112cfef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.283070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f0c0bc-51ce-4031-aba1-92af7112cfef admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.296094 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 780/1554] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:13.297219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096958c-cae9-49fb-9225-f65d1a5560f7 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.297519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096958c-cae9-49fb-9225-f65d1a5560f7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.297800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5096958c-cae9-49fb-9225-f65d1a5560f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.314950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-5096958c-cae9-49fb-9225-f65d1a5560f7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.316188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5096958c-cae9-49fb-9225-f65d1a5560f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.324505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 781/1555] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.325408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096958c-cae9-49fb-9225-f65d1a5560f7 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.334997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5096958c-cae9-49fb-9225-f65d1a5560f7 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.339590 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff08a8-70a4-438d-bacd-fdbb020f7ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.340263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff08a8-70a4-438d-bacd-fdbb020f7ef2 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.341057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff08a8-70a4-438d-bacd-fdbb020f7ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.341353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff08a8-70a4-438d-bacd-fdbb020f7ef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.342101 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff08a8-70a4-438d-bacd-fdbb020f7ef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:13.342411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff08a8-70a4-438d-bacd-fdbb020f7ef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.342848 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 775/1556] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/projects => generated 375 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:13.344067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9210e8a-ba22-4424-9008-94443fe978b5 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.344198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff08a8-70a4-438d-bacd-fdbb020f7ef2 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.344368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9210e8a-ba22-4424-9008-94443fe978b5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.344651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9210e8a-ba22-4424-9008-94443fe978b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.357952 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 782/1557] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:13.359163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d994a98-5945-4391-a55e-66b9af062f94 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.359457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d994a98-5945-4391-a55e-66b9af062f94 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.359742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d994a98-5945-4391-a55e-66b9af062f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.364792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b9210e8a-ba22-4424-9008-94443fe978b5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.366042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b9210e8a-ba22-4424-9008-94443fe978b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.377445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0d994a98-5945-4391-a55e-66b9af062f94 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.378707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0d994a98-5945-4391-a55e-66b9af062f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.428713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 776/1558] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.429939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7032a-a14e-4577-a358-8e7ea60c03b6 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.430226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7032a-a14e-4577-a358-8e7ea60c03b6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.430506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7032a-a14e-4577-a358-8e7ea60c03b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.443561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 783/1559] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.444434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d994a98-5945-4391-a55e-66b9af062f94 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.449185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-31e7032a-a14e-4577-a358-8e7ea60c03b6 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:13.450419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-31e7032a-a14e-4577-a358-8e7ea60c03b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:13.454403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d994a98-5945-4391-a55e-66b9af062f94 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.458295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 777/1560] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:13.462099 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7032a-a14e-4577-a358-8e7ea60c03b6 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.462949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f59b9-396d-4fbe-a5e5-84048bc2434a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.463611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f59b9-396d-4fbe-a5e5-84048bc2434a admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.463924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f59b9-396d-4fbe-a5e5-84048bc2434a admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.464207 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f59b9-396d-4fbe-a5e5-84048bc2434a admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.464941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f59b9-396d-4fbe-a5e5-84048bc2434a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.467659 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f59b9-396d-4fbe-a5e5-84048bc2434a admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.468851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7032a-a14e-4577-a358-8e7ea60c03b6 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.474356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b00a6-b245-4f05-a5e2-444ec73ea09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.475008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b00a6-b245-4f05-a5e2-444ec73ea09a admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.475296 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b00a6-b245-4f05-a5e2-444ec73ea09a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.475578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b00a6-b245-4f05-a5e2-444ec73ea09a admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.476300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b00a6-b245-4f05-a5e2-444ec73ea09a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.478264 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38b00a6-b245-4f05-a5e2-444ec73ea09a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.573768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 784/1561] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:13.575340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f59b9-396d-4fbe-a5e5-84048bc2434a admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.602963 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 778/1562] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:13.602963 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b00a6-b245-4f05-a5e2-444ec73ea09a admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.622113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:13.641624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f59b9-396d-4fbe-a5e5-84048bc2434a admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.664482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38b00a6-b245-4f05-a5e2-444ec73ea09a admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.669436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b2b1c-2776-4d73-b08c-5c115e160986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.670110 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b2b1c-2776-4d73-b08c-5c115e160986 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.670391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b2b1c-2776-4d73-b08c-5c115e160986 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.670661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18b2b1c-2776-4d73-b08c-5c115e160986 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.671345 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b2b1c-2776-4d73-b08c-5c115e160986 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.673345 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18b2b1c-2776-4d73-b08c-5c115e160986 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.703762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75504a0f-1695-477b-9d13-c55664a52622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.703762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75504a0f-1695-477b-9d13-c55664a52622 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.703762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75504a0f-1695-477b-9d13-c55664a52622 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.703762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75504a0f-1695-477b-9d13-c55664a52622 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.704301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75504a0f-1695-477b-9d13-c55664a52622 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:13.704301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75504a0f-1695-477b-9d13-c55664a52622 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.704301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75504a0f-1695-477b-9d13-c55664a52622 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.716327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 785/1563] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:13.717142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75504a0f-1695-477b-9d13-c55664a52622 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.726639 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75504a0f-1695-477b-9d13-c55664a52622 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.731479 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca4f83-42b9-4f87-aa90-a6ac60c95ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.732503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca4f83-42b9-4f87-aa90-a6ac60c95ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.732503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca4f83-42b9-4f87-aa90-a6ac60c95ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.732784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca4f83-42b9-4f87-aa90-a6ac60c95ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.733449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca4f83-42b9-4f87-aa90-a6ac60c95ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.735571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca4f83-42b9-4f87-aa90-a6ac60c95ea9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.783830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:13.789006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 779/1564] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/users => generated 288 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:13.789832 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b2b1c-2776-4d73-b08c-5c115e160986 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.799481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18b2b1c-2776-4d73-b08c-5c115e160986 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.804031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b509e15-b661-4e86-b9af-629cddd811c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.804655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b509e15-b661-4e86-b9af-629cddd811c5 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.804939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b509e15-b661-4e86-b9af-629cddd811c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.805211 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b509e15-b661-4e86-b9af-629cddd811c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.805919 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b509e15-b661-4e86-b9af-629cddd811c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:13.806218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b509e15-b661-4e86-b9af-629cddd811c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.807846 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b509e15-b661-4e86-b9af-629cddd811c5 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.816868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 786/1565] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:13.820783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca4f83-42b9-4f87-aa90-a6ac60c95ea9 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.823566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 780/1566] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:13.825308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b509e15-b661-4e86-b9af-629cddd811c5 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.835476 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b509e15-b661-4e86-b9af-629cddd811c5 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.884980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca4f83-42b9-4f87-aa90-a6ac60c95ea9 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.892368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74311a53-2efa-4c63-9e71-5539da56394b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.893042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74311a53-2efa-4c63-9e71-5539da56394b admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.893323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74311a53-2efa-4c63-9e71-5539da56394b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.893428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a901b-b658-40f0-ace7-9acad2462449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.893886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74311a53-2efa-4c63-9e71-5539da56394b admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.893977 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a901b-b658-40f0-ace7-9acad2462449 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.894262 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a901b-b658-40f0-ace7-9acad2462449 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.894376 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74311a53-2efa-4c63-9e71-5539da56394b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:13.894538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a901b-b658-40f0-ace7-9acad2462449 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.894644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74311a53-2efa-4c63-9e71-5539da56394b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.895295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a901b-b658-40f0-ace7-9acad2462449 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:13.895606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a901b-b658-40f0-ace7-9acad2462449 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.896286 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74311a53-2efa-4c63-9e71-5539da56394b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.897253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a901b-b658-40f0-ace7-9acad2462449 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.908909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 781/1567] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:13.909110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 787/1568] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:13.909719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a901b-b658-40f0-ace7-9acad2462449 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.909845 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74311a53-2efa-4c63-9e71-5539da56394b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:13.921692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a901b-b658-40f0-ace7-9acad2462449 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.930186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74311a53-2efa-4c63-9e71-5539da56394b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:13.930339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1583a-af21-4580-8408-3a96de28012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.930339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1583a-af21-4580-8408-3a96de28012c admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.930339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1583a-af21-4580-8408-3a96de28012c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.930339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1583a-af21-4580-8408-3a96de28012c admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.930866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1583a-af21-4580-8408-3a96de28012c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.930866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1583a-af21-4580-8408-3a96de28012c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:13.932125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5b6dd-ca4c-4484-badc-6309b76dc132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:13.932795 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5b6dd-ca4c-4484-badc-6309b76dc132 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:13.933081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5b6dd-ca4c-4484-badc-6309b76dc132 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:13.933363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5b6dd-ca4c-4484-badc-6309b76dc132 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:13.934062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5b6dd-ca4c-4484-badc-6309b76dc132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:13.935687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: WARNING py.warnings [None req-f1e5b6dd-ca4c-4484-badc-6309b76dc132 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:10:13.935687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: warnings.warn(msg) Jun 23 11:10:13.935687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: Jun 23 11:10:13.937048 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5b6dd-ca4c-4484-badc-6309b76dc132 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.020521 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 782/1569] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:14.021445 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1583a-af21-4580-8408-3a96de28012c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.031374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1583a-af21-4580-8408-3a96de28012c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.036254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b53ab-4f76-426f-8420-f2ae42070737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.036931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b53ab-4f76-426f-8420-f2ae42070737 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.037213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b53ab-4f76-426f-8420-f2ae42070737 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.037489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071b53ab-4f76-426f-8420-f2ae42070737 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.038222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b53ab-4f76-426f-8420-f2ae42070737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.040197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 788/1570] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:13 2022] POST /identity/v3/users => generated 296 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:14.044477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071b53ab-4f76-426f-8420-f2ae42070737 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.044593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5b6dd-ca4c-4484-badc-6309b76dc132 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.052093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5b6dd-ca4c-4484-badc-6309b76dc132 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.056720 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074c48c-5477-402e-9539-cb399b1eb2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.057386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074c48c-5477-402e-9539-cb399b1eb2b2 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.057674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074c48c-5477-402e-9539-cb399b1eb2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.057956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074c48c-5477-402e-9539-cb399b1eb2b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.058680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074c48c-5477-402e-9539-cb399b1eb2b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.060335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074c48c-5477-402e-9539-cb399b1eb2b2 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.072001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 789/1571] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:14.072927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074c48c-5477-402e-9539-cb399b1eb2b2 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.082823 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074c48c-5477-402e-9539-cb399b1eb2b2 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.087369 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31738fe6-3860-4ae1-a042-e8e21674f203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.088026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738fe6-3860-4ae1-a042-e8e21674f203 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.088314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738fe6-3860-4ae1-a042-e8e21674f203 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.088591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31738fe6-3860-4ae1-a042-e8e21674f203 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.089293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31738fe6-3860-4ae1-a042-e8e21674f203 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.091700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31738fe6-3860-4ae1-a042-e8e21674f203 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.121534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 783/1572] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:14 2022] POST /identity/v3/projects => generated 379 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:14.122396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b53ab-4f76-426f-8420-f2ae42070737 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.182324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071b53ab-4f76-426f-8420-f2ae42070737 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.186988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceb47b-d586-4eaf-9cd3-a63627c5c029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.187643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceb47b-d586-4eaf-9cd3-a63627c5c029 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.187958 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceb47b-d586-4eaf-9cd3-a63627c5c029 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.188239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ceb47b-d586-4eaf-9cd3-a63627c5c029 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.188925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ceb47b-d586-4eaf-9cd3-a63627c5c029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.190907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ceb47b-d586-4eaf-9cd3-a63627c5c029 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.201883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 790/1573] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:14 2022] POST /identity/v3/users => generated 286 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:14.203046 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31738fe6-3860-4ae1-a042-e8e21674f203 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.214270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31738fe6-3860-4ae1-a042-e8e21674f203 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.220688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd8c27-d513-438b-a70f-2ed0eefcc09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.221354 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd8c27-d513-438b-a70f-2ed0eefcc09e admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.221641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd8c27-d513-438b-a70f-2ed0eefcc09e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.221918 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dd8c27-d513-438b-a70f-2ed0eefcc09e admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.222695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd8c27-d513-438b-a70f-2ed0eefcc09e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.224653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dd8c27-d513-438b-a70f-2ed0eefcc09e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.228105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:14.293291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 784/1574] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:14 2022] POST /identity/v3/projects => generated 389 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:14.294619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceb47b-d586-4eaf-9cd3-a63627c5c029 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.324558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:14.329215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 791/1575] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:14 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:14.330329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd8c27-d513-438b-a70f-2ed0eefcc09e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.358378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ceb47b-d586-4eaf-9cd3-a63627c5c029 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.393009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dd8c27-d513-438b-a70f-2ed0eefcc09e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.400293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eba924-fb35-47af-bc52-d98ce57e4652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.400965 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eba924-fb35-47af-bc52-d98ce57e4652 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.401264 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eba924-fb35-47af-bc52-d98ce57e4652 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.401559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eba924-fb35-47af-bc52-d98ce57e4652 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.402288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eba924-fb35-47af-bc52-d98ce57e4652 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.406782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eba924-fb35-47af-bc52-d98ce57e4652 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.415760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 792/1576] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:14.416603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eba924-fb35-47af-bc52-d98ce57e4652 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.421964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3d9c-8314-4d49-bffe-7890378511bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.423034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3d9c-8314-4d49-bffe-7890378511bb admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.423034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3d9c-8314-4d49-bffe-7890378511bb admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.426582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da3d9c-8314-4d49-bffe-7890378511bb admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.426582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da3d9c-8314-4d49-bffe-7890378511bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.426582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da3d9c-8314-4d49-bffe-7890378511bb admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.432523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eba924-fb35-47af-bc52-d98ce57e4652 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.437626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b622b27-54ad-489a-982a-9ffa01ae46d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.438281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b622b27-54ad-489a-982a-9ffa01ae46d9 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.438766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b622b27-54ad-489a-982a-9ffa01ae46d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.438991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b622b27-54ad-489a-982a-9ffa01ae46d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.439768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b622b27-54ad-489a-982a-9ffa01ae46d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.441435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b622b27-54ad-489a-982a-9ffa01ae46d9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.452213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 793/1577] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:14.453074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b622b27-54ad-489a-982a-9ffa01ae46d9 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.462582 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b622b27-54ad-489a-982a-9ffa01ae46d9 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.467443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc18dd3-f5d3-4310-9641-80a7d4c748c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.468093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc18dd3-f5d3-4310-9641-80a7d4c748c2 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.468376 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc18dd3-f5d3-4310-9641-80a7d4c748c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.468652 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc18dd3-f5d3-4310-9641-80a7d4c748c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.469344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc18dd3-f5d3-4310-9641-80a7d4c748c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.470986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc18dd3-f5d3-4310-9641-80a7d4c748c2 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.480645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 794/1578] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:14.481964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc18dd3-f5d3-4310-9641-80a7d4c748c2 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.491193 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc18dd3-f5d3-4310-9641-80a7d4c748c2 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.495661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b093b-e498-4edb-973a-3e647dbc9b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.496323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b093b-e498-4edb-973a-3e647dbc9b06 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.496662 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b093b-e498-4edb-973a-3e647dbc9b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.497452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728b093b-e498-4edb-973a-3e647dbc9b06 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.498128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b093b-e498-4edb-973a-3e647dbc9b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.500086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728b093b-e498-4edb-973a-3e647dbc9b06 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.518385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 785/1579] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:14 2022] POST /identity/v3/projects => generated 387 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:14.519216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3d9c-8314-4d49-bffe-7890378511bb admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.579558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da3d9c-8314-4d49-bffe-7890378511bb admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.584174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f296c25-bb26-4c84-a744-16a15884ea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.584838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f296c25-bb26-4c84-a744-16a15884ea1b admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.585123 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f296c25-bb26-4c84-a744-16a15884ea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.585404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f296c25-bb26-4c84-a744-16a15884ea1b admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.586128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f296c25-bb26-4c84-a744-16a15884ea1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.587773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f296c25-bb26-4c84-a744-16a15884ea1b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.597865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 786/1580] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:14.598787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f296c25-bb26-4c84-a744-16a15884ea1b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.608675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f296c25-bb26-4c84-a744-16a15884ea1b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.613170 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f8312-66a5-497a-885e-c4e6a6fd76b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.613791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f8312-66a5-497a-885e-c4e6a6fd76b5 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.614073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f8312-66a5-497a-885e-c4e6a6fd76b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.614347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f8312-66a5-497a-885e-c4e6a6fd76b5 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.615020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f8312-66a5-497a-885e-c4e6a6fd76b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.616948 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332f8312-66a5-497a-885e-c4e6a6fd76b5 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.650060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 795/1581] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:14 2022] POST /identity/v3/users => generated 290 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:14.650872 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b093b-e498-4edb-973a-3e647dbc9b06 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.661098 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728b093b-e498-4edb-973a-3e647dbc9b06 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.665882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7409-3290-4123-9b34-10a811fb38fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.666579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7409-3290-4123-9b34-10a811fb38fa admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.666864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7409-3290-4123-9b34-10a811fb38fa admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.667141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47d7409-3290-4123-9b34-10a811fb38fa admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.667866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d7409-3290-4123-9b34-10a811fb38fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.669840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47d7409-3290-4123-9b34-10a811fb38fa admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.747504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 787/1582] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:14 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:14.748378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f8312-66a5-497a-885e-c4e6a6fd76b5 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.757891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f8312-66a5-497a-885e-c4e6a6fd76b5 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.763199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03c6dd-27ed-4415-aedf-bc27f1557e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.763927 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c6dd-27ed-4415-aedf-bc27f1557e97 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.764212 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c6dd-27ed-4415-aedf-bc27f1557e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.764493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc03c6dd-27ed-4415-aedf-bc27f1557e97 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.765209 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03c6dd-27ed-4415-aedf-bc27f1557e97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.766868 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc03c6dd-27ed-4415-aedf-bc27f1557e97 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.777773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 788/1583] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:14.778629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03c6dd-27ed-4415-aedf-bc27f1557e97 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.783403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 796/1584] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:14 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:14.783403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7409-3290-4123-9b34-10a811fb38fa admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.788856 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc03c6dd-27ed-4415-aedf-bc27f1557e97 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.790905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47d7409-3290-4123-9b34-10a811fb38fa admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.793448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe121e2d-0d9d-4c68-9220-1759ae9744e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.794162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe121e2d-0d9d-4c68-9220-1759ae9744e3 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.794450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe121e2d-0d9d-4c68-9220-1759ae9744e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.794734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe121e2d-0d9d-4c68-9220-1759ae9744e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.795485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe121e2d-0d9d-4c68-9220-1759ae9744e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.796463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84e270-ba75-46dc-b6ae-e572604a8f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.797127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe121e2d-0d9d-4c68-9220-1759ae9744e3 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.797332 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84e270-ba75-46dc-b6ae-e572604a8f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.797617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84e270-ba75-46dc-b6ae-e572604a8f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.797896 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c84e270-ba75-46dc-b6ae-e572604a8f79 admin admin] PATH_INFO: `/v3/projects/e6420da641da49f38bcc6a0fd0603767/users/f5068236cf154bd78e88cd615f94de63/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.807431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 789/1585] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:14.808259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe121e2d-0d9d-4c68-9220-1759ae9744e3 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.813365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84e270-ba75-46dc-b6ae-e572604a8f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6420da641da49f38bcc6a0fd0603767, user_id=f5068236cf154bd78e88cd615f94de63, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.816063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c84e270-ba75-46dc-b6ae-e572604a8f79 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.820767 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe121e2d-0d9d-4c68-9220-1759ae9744e3 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.826304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a406b-e725-4094-a952-9806766cb0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.826953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a406b-e725-4094-a952-9806766cb0ee admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.827241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a406b-e725-4094-a952-9806766cb0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.827514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61a406b-e725-4094-a952-9806766cb0ee admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.828233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a406b-e725-4094-a952-9806766cb0ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.830515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61a406b-e725-4094-a952-9806766cb0ee admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.895428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 797/1586] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:14 2022] PUT /identity/v3/projects/e6420da641da49f38bcc6a0fd0603767/users/f5068236cf154bd78e88cd615f94de63/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:14.896970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84e270-ba75-46dc-b6ae-e572604a8f79 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.923792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:14.930134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 790/1587] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:14 2022] POST /identity/v3/users => generated 294 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:14.931072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a406b-e725-4094-a952-9806766cb0ee admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.941456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61a406b-e725-4094-a952-9806766cb0ee admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.960769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c84e270-ba75-46dc-b6ae-e572604a8f79 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.965442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ef6b-bbae-478c-8b4f-82523de60c48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.966473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ef6b-bbae-478c-8b4f-82523de60c48 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.966473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ef6b-bbae-478c-8b4f-82523de60c48 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.966668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8ef6b-bbae-478c-8b4f-82523de60c48 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.967365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8ef6b-bbae-478c-8b4f-82523de60c48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.969047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a8ef6b-bbae-478c-8b4f-82523de60c48 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:14.970550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:14.980555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 798/1588] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:14.982254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ef6b-bbae-478c-8b4f-82523de60c48 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:14.991841 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8ef6b-bbae-478c-8b4f-82523de60c48 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:14.996384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41e24c-1b5f-4cdf-bb63-0422a708e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.997549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41e24c-1b5f-4cdf-bb63-0422a708e36e admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.997829 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41e24c-1b5f-4cdf-bb63-0422a708e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.998104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce41e24c-1b5f-4cdf-bb63-0422a708e36e admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:14.998477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac35e3-d391-4dee-adb4-abf424492896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:14.998823 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41e24c-1b5f-4cdf-bb63-0422a708e36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:14.999152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac35e3-d391-4dee-adb4-abf424492896 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:14.999438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac35e3-d391-4dee-adb4-abf424492896 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:14.999720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac35e3-d391-4dee-adb4-abf424492896 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.000471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce41e24c-1b5f-4cdf-bb63-0422a708e36e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.000578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac35e3-d391-4dee-adb4-abf424492896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.002056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac35e3-d391-4dee-adb4-abf424492896 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.010610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 799/1589] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:15.011232 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41e24c-1b5f-4cdf-bb63-0422a708e36e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.013381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 791/1590] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:15.014476 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac35e3-d391-4dee-adb4-abf424492896 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.022307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce41e24c-1b5f-4cdf-bb63-0422a708e36e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.029808 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac35e3-d391-4dee-adb4-abf424492896 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.030009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f03bd-9532-424e-9017-60d3a6d62549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.030009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f03bd-9532-424e-9017-60d3a6d62549 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.030009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f03bd-9532-424e-9017-60d3a6d62549 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.030009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f03bd-9532-424e-9017-60d3a6d62549 admin admin] PATH_INFO: `/v3/projects/9a78c13b4d9f4b43a1d239673fc9cc91/users/6617f968cd214435a1efcb401ba33e38/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.031917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac6433-6186-4333-a3c0-9989aa964023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.031917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac6433-6186-4333-a3c0-9989aa964023 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.031917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac6433-6186-4333-a3c0-9989aa964023 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.032909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac6433-6186-4333-a3c0-9989aa964023 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.033659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac6433-6186-4333-a3c0-9989aa964023 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.035388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac6433-6186-4333-a3c0-9989aa964023 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.045349 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f03bd-9532-424e-9017-60d3a6d62549 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a78c13b4d9f4b43a1d239673fc9cc91, user_id=6617f968cd214435a1efcb401ba33e38, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.046947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 792/1591] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:15.048164 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac6433-6186-4333-a3c0-9989aa964023 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.048290 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f03bd-9532-424e-9017-60d3a6d62549 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.057855 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac6433-6186-4333-a3c0-9989aa964023 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.063100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e3369-c7c0-4ae0-9a30-96c075de3b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.064004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e3369-c7c0-4ae0-9a30-96c075de3b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.064318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e3369-c7c0-4ae0-9a30-96c075de3b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.064595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e3369-c7c0-4ae0-9a30-96c075de3b34 admin admin] PATH_INFO: `/v3/projects/2774759dc4b741518d5bbb7a50e1e50d/users/1d6b0c12ebad40eaafec09b662e228c4/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.079482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e3369-c7c0-4ae0-9a30-96c075de3b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2774759dc4b741518d5bbb7a50e1e50d, user_id=1d6b0c12ebad40eaafec09b662e228c4, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.081070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: WARNING py.warnings [None req-241e3369-c7c0-4ae0-9a30-96c075de3b34 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:10:15.081070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: warnings.warn(msg) Jun 23 11:10:15.081070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: Jun 23 11:10:15.082519 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-241e3369-c7c0-4ae0-9a30-96c075de3b34 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.174814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 800/1592] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:15 2022] PUT /identity/v3/projects/9a78c13b4d9f4b43a1d239673fc9cc91/users/6617f968cd214435a1efcb401ba33e38/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:15.176215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06bcb0-f19b-4f05-a11c-4fc163e065f2 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.178731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06bcb0-f19b-4f05-a11c-4fc163e065f2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.178731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06bcb0-f19b-4f05-a11c-4fc163e065f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.204118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-da06bcb0-f19b-4f05-a11c-4fc163e065f2 None None] MFA Rules not processed for user `f5068236cf154bd78e88cd615f94de63`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:15.205345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-da06bcb0-f19b-4f05-a11c-4fc163e065f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:15.207105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 793/1593] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:15 2022] PUT /identity/v3/projects/2774759dc4b741518d5bbb7a50e1e50d/users/1d6b0c12ebad40eaafec09b662e228c4/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:15.208145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e3369-c7c0-4ae0-9a30-96c075de3b34 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.270385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 801/1594] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:15.271465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06bcb0-f19b-4f05-a11c-4fc163e065f2 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.277596 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241e3369-c7c0-4ae0-9a30-96c075de3b34 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.282404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06bcb0-f19b-4f05-a11c-4fc163e065f2 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.282549 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49821d-0f4b-4a61-a794-247abb36e53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.283214 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49821d-0f4b-4a61-a794-247abb36e53b admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.283500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49821d-0f4b-4a61-a794-247abb36e53b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.283780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a49821d-0f4b-4a61-a794-247abb36e53b admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.284582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49821d-0f4b-4a61-a794-247abb36e53b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.286202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a49821d-0f4b-4a61-a794-247abb36e53b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.289424 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcef411-d742-448c-9f9b-13440eb3bde5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.290379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcef411-d742-448c-9f9b-13440eb3bde5 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.290731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcef411-d742-448c-9f9b-13440eb3bde5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.291013 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcef411-d742-448c-9f9b-13440eb3bde5 admin admin] PATH_INFO: `/v3/projects/c661f89e029843d187b5021013e297fa/users/d003e00278d04d9b886650b303c643ec/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.298129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 794/1595] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:15.299114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49821d-0f4b-4a61-a794-247abb36e53b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.308436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcef411-d742-448c-9f9b-13440eb3bde5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c661f89e029843d187b5021013e297fa, user_id=d003e00278d04d9b886650b303c643ec, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.309055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a49821d-0f4b-4a61-a794-247abb36e53b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.311712 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcef411-d742-448c-9f9b-13440eb3bde5 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.315284 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409930fc-7791-430a-81ec-2866de14d9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.316081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409930fc-7791-430a-81ec-2866de14d9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.316628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409930fc-7791-430a-81ec-2866de14d9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.316911 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409930fc-7791-430a-81ec-2866de14d9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.317636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409930fc-7791-430a-81ec-2866de14d9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.319239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409930fc-7791-430a-81ec-2866de14d9b5 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.329836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 795/1596] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:15.330646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409930fc-7791-430a-81ec-2866de14d9b5 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.340248 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409930fc-7791-430a-81ec-2866de14d9b5 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.344878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c112d-bc83-43d8-8b7f-ed0331e977d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.345510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c112d-bc83-43d8-8b7f-ed0331e977d6 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.345795 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c112d-bc83-43d8-8b7f-ed0331e977d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.346073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c112d-bc83-43d8-8b7f-ed0331e977d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.346785 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c112d-bc83-43d8-8b7f-ed0331e977d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.348389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c112d-bc83-43d8-8b7f-ed0331e977d6 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.359508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 796/1597] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:15.360323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c112d-bc83-43d8-8b7f-ed0331e977d6 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.369714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c112d-bc83-43d8-8b7f-ed0331e977d6 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.374908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bae28-b523-4ef1-986e-8fad938e3c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.375558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bae28-b523-4ef1-986e-8fad938e3c33 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.375982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bae28-b523-4ef1-986e-8fad938e3c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.376150 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bae28-b523-4ef1-986e-8fad938e3c33 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.376856 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bae28-b523-4ef1-986e-8fad938e3c33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.378427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bae28-b523-4ef1-986e-8fad938e3c33 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.383631 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 802/1598] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:15 2022] PUT /identity/v3/projects/c661f89e029843d187b5021013e297fa/users/d003e00278d04d9b886650b303c643ec/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:15.384915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fd779-bf16-40e0-8d22-c05cfde52991 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.386535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fd779-bf16-40e0-8d22-c05cfde52991 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.386535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fd779-bf16-40e0-8d22-c05cfde52991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.391204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 797/1599] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:15.394526 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a6123-4d05-445a-b34a-fb9068f49ab5 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.395047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a6123-4d05-445a-b34a-fb9068f49ab5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.395327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150a6123-4d05-445a-b34a-fb9068f49ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.407989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-3d4fd779-bf16-40e0-8d22-c05cfde52991 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:15.409588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3d4fd779-bf16-40e0-8d22-c05cfde52991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:15.416694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-150a6123-4d05-445a-b34a-fb9068f49ab5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:15.417918 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-150a6123-4d05-445a-b34a-fb9068f49ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:15.436470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:15.471657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 803/1600] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:15.473105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07690e-0f79-46f4-96d6-852015144530 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.473397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07690e-0f79-46f4-96d6-852015144530 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.473677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d07690e-0f79-46f4-96d6-852015144530 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.475205 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 804/1601] 10.222.0.52 () {54 vars in 961 bytes} [Thu Jun 23 11:10:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:10:15.475925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07690e-0f79-46f4-96d6-852015144530 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.487787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 798/1602] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:15.489606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d07690e-0f79-46f4-96d6-852015144530 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.489976 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a6123-4d05-445a-b34a-fb9068f49ab5 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.494636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b88ab9-78dd-4277-bdbe-6ea4843182f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.495323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b88ab9-78dd-4277-bdbe-6ea4843182f7 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.495605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b88ab9-78dd-4277-bdbe-6ea4843182f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.495903 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b88ab9-78dd-4277-bdbe-6ea4843182f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.496842 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b88ab9-78dd-4277-bdbe-6ea4843182f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.498273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b88ab9-78dd-4277-bdbe-6ea4843182f7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.504717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150a6123-4d05-445a-b34a-fb9068f49ab5 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.511709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 805/1603] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:15.511709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b88ab9-78dd-4277-bdbe-6ea4843182f7 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.512008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ccc6f-fd82-45a3-897f-6a0a44d54559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.512008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ccc6f-fd82-45a3-897f-6a0a44d54559 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.512008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ccc6f-fd82-45a3-897f-6a0a44d54559 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.512008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ccc6f-fd82-45a3-897f-6a0a44d54559 admin admin] PATH_INFO: `/v3/projects/4a29063e00c940209cc2c923de7424af/users/54404c13a1cf4d4eab0082fbfdd2bc58/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.522006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b88ab9-78dd-4277-bdbe-6ea4843182f7 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.526464 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ccc6f-fd82-45a3-897f-6a0a44d54559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a29063e00c940209cc2c923de7424af, user_id=54404c13a1cf4d4eab0082fbfdd2bc58, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.528678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e3a0a-4cae-470c-bb07-0a32d7606f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.528678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e3a0a-4cae-470c-bb07-0a32d7606f2c admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.528897 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e3a0a-4cae-470c-bb07-0a32d7606f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.529173 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e3a0a-4cae-470c-bb07-0a32d7606f2c admin admin] PATH_INFO: `/v3/projects/c5df3f0dc5e549b1a3c97b1ce2e59912/users/9b9874ab7e7443db81dfde42b37d363f/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.529703 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ccc6f-fd82-45a3-897f-6a0a44d54559 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.542085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:15.545890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e3a0a-4cae-470c-bb07-0a32d7606f2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5df3f0dc5e549b1a3c97b1ce2e59912, user_id=9b9874ab7e7443db81dfde42b37d363f, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.548671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e3a0a-4cae-470c-bb07-0a32d7606f2c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.621728 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 799/1604] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:15 2022] PUT /identity/v3/projects/4a29063e00c940209cc2c923de7424af/users/54404c13a1cf4d4eab0082fbfdd2bc58/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:15.622619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ccc6f-fd82-45a3-897f-6a0a44d54559 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.656559 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 806/1605] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:15 2022] PUT /identity/v3/projects/c5df3f0dc5e549b1a3c97b1ce2e59912/users/9b9874ab7e7443db81dfde42b37d363f/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:15.656766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e99b6-a878-4fc5-bafb-ab8fa02944d2 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.659067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e99b6-a878-4fc5-bafb-ab8fa02944d2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.659067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64e99b6-a878-4fc5-bafb-ab8fa02944d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.685819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-c64e99b6-a878-4fc5-bafb-ab8fa02944d2 None None] MFA Rules not processed for user `d003e00278d04d9b886650b303c643ec`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:15.686317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ccc6f-fd82-45a3-897f-6a0a44d54559 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.687097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c64e99b6-a878-4fc5-bafb-ab8fa02944d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:15.741966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c11ddb-60ee-4623-b976-0daf92b7ed37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.742887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c11ddb-60ee-4623-b976-0daf92b7ed37 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.743166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c11ddb-60ee-4623-b976-0daf92b7ed37 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.743438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c11ddb-60ee-4623-b976-0daf92b7ed37 admin admin] PATH_INFO: `/v3/projects/ee913c76f7b64e3492cc3ccae2400916/users/f6c07330d4184f8bb675abc1746b4dc8/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.751480 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 807/1606] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:15.753025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bdb79-6fbd-4cab-9519-6f6ed8d8e82b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.753329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bdb79-6fbd-4cab-9519-6f6ed8d8e82b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.753663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019bdb79-6fbd-4cab-9519-6f6ed8d8e82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.758937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c11ddb-60ee-4623-b976-0daf92b7ed37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee913c76f7b64e3492cc3ccae2400916, user_id=f6c07330d4184f8bb675abc1746b4dc8, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.761645 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c11ddb-60ee-4623-b976-0daf92b7ed37 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.771557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-019bdb79-6fbd-4cab-9519-6f6ed8d8e82b None None] MFA Rules not processed for user `a020e7fe06574a108b46f9f48bddc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:15.772829 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-019bdb79-6fbd-4cab-9519-6f6ed8d8e82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:15.843074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 808/1607] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Jun 23 11:10:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:15.843937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bdb79-6fbd-4cab-9519-6f6ed8d8e82b None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.854674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 800/1608] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:15 2022] PUT /identity/v3/projects/ee913c76f7b64e3492cc3ccae2400916/users/f6c07330d4184f8bb675abc1746b4dc8/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:15.855634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c11ddb-60ee-4623-b976-0daf92b7ed37 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:15.900959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019bdb79-6fbd-4cab-9519-6f6ed8d8e82b None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.916827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c11ddb-60ee-4623-b976-0daf92b7ed37 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:15.920586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a05fc-1dab-49ad-a4b5-758c45ff052e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.921271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a05fc-1dab-49ad-a4b5-758c45ff052e service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.921556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a05fc-1dab-49ad-a4b5-758c45ff052e service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.921835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a05fc-1dab-49ad-a4b5-758c45ff052e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.950977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e517e7-dfd0-4993-9351-5b651e9565b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:15.951659 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e517e7-dfd0-4993-9351-5b651e9565b6 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:15.951994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e517e7-dfd0-4993-9351-5b651e9565b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:15.952277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e517e7-dfd0-4993-9351-5b651e9565b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:15.983533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a05fc-1dab-49ad-a4b5-758c45ff052e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:15.985039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39a05fc-1dab-49ad-a4b5-758c45ff052e service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:15.992659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:15.996474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 801/1609] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:15.997283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a05fc-1dab-49ad-a4b5-758c45ff052e service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:16.006930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39a05fc-1dab-49ad-a4b5-758c45ff052e service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:16.011953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc5dc58-b4fc-417b-94ee-669aec6a1324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:16.013481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5dc58-b4fc-417b-94ee-669aec6a1324 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.013766 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5dc58-b4fc-417b-94ee-669aec6a1324 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.014044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc5dc58-b4fc-417b-94ee-669aec6a1324 admin admin] PATH_INFO: `/v3/projects/1673d6cc4cda4b62864d970e8f832ac1/users/18a7f1cc11864ac1b77dcb771e51c479/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.015273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e517e7-dfd0-4993-9351-5b651e9565b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:16.016969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e517e7-dfd0-4993-9351-5b651e9565b6 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:16.027978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 809/1610] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:16.029511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166743e-ac39-4d71-9d23-920edae9c7a8 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.029885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166743e-ac39-4d71-9d23-920edae9c7a8 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.030217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5dc58-b4fc-417b-94ee-669aec6a1324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1673d6cc4cda4b62864d970e8f832ac1, user_id=18a7f1cc11864ac1b77dcb771e51c479, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:16.030352 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c166743e-ac39-4d71-9d23-920edae9c7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.033023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc5dc58-b4fc-417b-94ee-669aec6a1324 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:16.046621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:16.048558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-c166743e-ac39-4d71-9d23-920edae9c7a8 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:16.061828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c166743e-ac39-4d71-9d23-920edae9c7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:16.061828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 810/1611] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:16.061828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec829-c42d-457e-8546-0753783ae71f None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.061828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec829-c42d-457e-8546-0753783ae71f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.061828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80ec829-c42d-457e-8546-0753783ae71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.077715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-e80ec829-c42d-457e-8546-0753783ae71f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:16.078987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e80ec829-c42d-457e-8546-0753783ae71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:16.086728 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 811/1612] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:16.087603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ec829-c42d-457e-8546-0753783ae71f None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:16.101612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80ec829-c42d-457e-8546-0753783ae71f None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:16.101981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8455967-5340-4bce-ac27-460e9c2e323b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:16.102643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8455967-5340-4bce-ac27-460e9c2e323b admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.102925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8455967-5340-4bce-ac27-460e9c2e323b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.103203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8455967-5340-4bce-ac27-460e9c2e323b admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.103936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8455967-5340-4bce-ac27-460e9c2e323b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:16.105849 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8455967-5340-4bce-ac27-460e9c2e323b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:16.227754 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 812/1614] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:16 2022] POST /identity/v3/projects => generated 373 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:16.227754 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8455967-5340-4bce-ac27-460e9c2e323b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:16.232184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 802/1614] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:15 2022] PUT /identity/v3/projects/1673d6cc4cda4b62864d970e8f832ac1/users/18a7f1cc11864ac1b77dcb771e51c479/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:16.233747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8f87c-e60d-4cac-85f7-e0c29c48460d None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.234045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8f87c-e60d-4cac-85f7-e0c29c48460d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.234331 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8f87c-e60d-4cac-85f7-e0c29c48460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.269713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-15c8f87c-e60d-4cac-85f7-e0c29c48460d None None] MFA Rules not processed for user `f6c07330d4184f8bb675abc1746b4dc8`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:16.273156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-15c8f87c-e60d-4cac-85f7-e0c29c48460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:16.314551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8455967-5340-4bce-ac27-460e9c2e323b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:16.320854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb2832-079f-432a-b01b-f348a3c8e3af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:16.321606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb2832-079f-432a-b01b-f348a3c8e3af service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.321971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb2832-079f-432a-b01b-f348a3c8e3af service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.322315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb2832-079f-432a-b01b-f348a3c8e3af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.359715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 803/1615] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:16.363589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8f87c-e60d-4cac-85f7-e0c29c48460d None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:16.394673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb2832-079f-432a-b01b-f348a3c8e3af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:16.396483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfb2832-079f-432a-b01b-f348a3c8e3af service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:16.408901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 813/1616] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:16.409813 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb2832-079f-432a-b01b-f348a3c8e3af service nova] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:16.411195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3cfb2832-079f-432a-b01b-f348a3c8e3af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:16.422583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8f87c-e60d-4cac-85f7-e0c29c48460d None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:16.426299 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863a482-c1c4-4aa6-89c4-b5194d7a3461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:16.427025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863a482-c1c4-4aa6-89c4-b5194d7a3461 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.427366 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863a482-c1c4-4aa6-89c4-b5194d7a3461 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.427701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4863a482-c1c4-4aa6-89c4-b5194d7a3461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.478704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:16.480277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfb2832-079f-432a-b01b-f348a3c8e3af service nova] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:16.490197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb91144-a4ed-4ded-86f8-fd6f91111fab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:16.490991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb91144-a4ed-4ded-86f8-fd6f91111fab service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.491381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb91144-a4ed-4ded-86f8-fd6f91111fab service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.491818 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb91144-a4ed-4ded-86f8-fd6f91111fab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.518572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863a482-c1c4-4aa6-89c4-b5194d7a3461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:16.520607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4863a482-c1c4-4aa6-89c4-b5194d7a3461 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:16.535565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 804/1617] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:16.539739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863a482-c1c4-4aa6-89c4-b5194d7a3461 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:16.552966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4863a482-c1c4-4aa6-89c4-b5194d7a3461 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:16.557486 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bc8680-982d-4bf7-8945-5a7706761bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:16.558411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8680-982d-4bf7-8945-5a7706761bda admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.558820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8680-982d-4bf7-8945-5a7706761bda admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.559540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bc8680-982d-4bf7-8945-5a7706761bda admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.560523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc8680-982d-4bf7-8945-5a7706761bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:16.567413 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bc8680-982d-4bf7-8945-5a7706761bda admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:16.599090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb91144-a4ed-4ded-86f8-fd6f91111fab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:16.600640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb91144-a4ed-4ded-86f8-fd6f91111fab service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:16.611651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 814/1618] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:16.622564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1331b9-b85e-4810-b7dd-ce445f8d6bbe None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.623277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1331b9-b85e-4810-b7dd-ce445f8d6bbe None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.623762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1331b9-b85e-4810-b7dd-ce445f8d6bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.663727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-6f1331b9-b85e-4810-b7dd-ce445f8d6bbe None None] MFA Rules not processed for user `18a7f1cc11864ac1b77dcb771e51c479`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:16.667230 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-6f1331b9-b85e-4810-b7dd-ce445f8d6bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:16.707441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:16.750552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 815/1619] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:16.752063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e350b-624c-45d6-852e-6a8604ce1aa2 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.752384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e350b-624c-45d6-852e-6a8604ce1aa2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.752676 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6e350b-624c-45d6-852e-6a8604ce1aa2 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.754441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 816/1620] 10.222.0.52 () {54 vars in 961 bytes} [Thu Jun 23 11:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:10:16.755527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1120-5bbc-4d5e-adad-8f2dbbbc7889 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.755527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1120-5bbc-4d5e-adad-8f2dbbbc7889 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.755726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e1120-5bbc-4d5e-adad-8f2dbbbc7889 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.759580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 817/1621] 10.222.0.52 () {54 vars in 912 bytes} [Thu Jun 23 11:10:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:10:16.760830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1120-5bbc-4d5e-adad-8f2dbbbc7889 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:16.774056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e1120-5bbc-4d5e-adad-8f2dbbbc7889 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:16.779502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b581-7edc-4e8b-ab8c-f72631a353bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:16.779934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b581-7edc-4e8b-ab8c-f72631a353bb admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.780224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b581-7edc-4e8b-ab8c-f72631a353bb admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.780503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d431b581-7edc-4e8b-ab8c-f72631a353bb admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.781224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431b581-7edc-4e8b-ab8c-f72631a353bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:16.783165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d431b581-7edc-4e8b-ab8c-f72631a353bb admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:16.794607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 805/1622] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:16 2022] POST /identity/v3/users => generated 293 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:16.796199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116b5b1-998c-4bfe-b108-d11f3599a2ba None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.799275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116b5b1-998c-4bfe-b108-d11f3599a2ba None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.799275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116b5b1-998c-4bfe-b108-d11f3599a2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.815248 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3116b5b1-998c-4bfe-b108-d11f3599a2ba None None] MFA Rules not processed for user `a020e7fe06574a108b46f9f48bddc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:16.816623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3116b5b1-998c-4bfe-b108-d11f3599a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:16.827214 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 806/1623] 10.222.0.52 () {58 vars in 1058 bytes} [Thu Jun 23 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:16.828761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8c3ab-d641-4048-9c2e-528a72097637 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.829049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8c3ab-d641-4048-9c2e-528a72097637 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.829429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf8c3ab-d641-4048-9c2e-528a72097637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.848678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4bf8c3ab-d641-4048-9c2e-528a72097637 None None] MFA Rules not processed for user `a020e7fe06574a108b46f9f48bddc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:16.849940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4bf8c3ab-d641-4048-9c2e-528a72097637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:16.859542 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 807/1624] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:10:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:16.861621 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8c3ab-d641-4048-9c2e-528a72097637 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:16.875256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf8c3ab-d641-4048-9c2e-528a72097637 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:16.880799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eccea-e749-4263-b174-9b0aa675cc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:16.881609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eccea-e749-4263-b174-9b0aa675cc49 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.881895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eccea-e749-4263-b174-9b0aa675cc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.882173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499eccea-e749-4263-b174-9b0aa675cc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.882911 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499eccea-e749-4263-b174-9b0aa675cc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:16.885183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499eccea-e749-4263-b174-9b0aa675cc49 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:16.896638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 808/1625] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:16.897419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eccea-e749-4263-b174-9b0aa675cc49 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:16.911548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499eccea-e749-4263-b174-9b0aa675cc49 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:16.917106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b140976-0c3d-405d-94a7-a84186e6c613 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:16.917744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b140976-0c3d-405d-94a7-a84186e6c613 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:16.918028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b140976-0c3d-405d-94a7-a84186e6c613 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:16.918336 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b140976-0c3d-405d-94a7-a84186e6c613 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:16.926555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b140976-0c3d-405d-94a7-a84186e6c613 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:16.928109 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b140976-0c3d-405d-94a7-a84186e6c613 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:16.945995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 818/1626] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:16 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:16.945995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b581-7edc-4e8b-ab8c-f72631a353bb admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:16.956585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 809/1627] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:16.957638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b140976-0c3d-405d-94a7-a84186e6c613 service nova] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:17.007715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b140976-0c3d-405d-94a7-a84186e6c613 service nova] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:17.069170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d431b581-7edc-4e8b-ab8c-f72631a353bb admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:17.079625 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c576c-865f-45ae-9e1a-be87a9e02d14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:17.088506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c576c-865f-45ae-9e1a-be87a9e02d14 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:17.088506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c576c-865f-45ae-9e1a-be87a9e02d14 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:17.088506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c576c-865f-45ae-9e1a-be87a9e02d14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:17.100105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93f1fbd-717a-4a24-9ed2-ae8f53ffd8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:17.101101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f1fbd-717a-4a24-9ed2-ae8f53ffd8fd admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:17.101388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f1fbd-717a-4a24-9ed2-ae8f53ffd8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:17.101671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93f1fbd-717a-4a24-9ed2-ae8f53ffd8fd admin admin] PATH_INFO: `/v3/projects/2d4e8ed6d5cf47ed95bede72b9772e4c/users/23e8612c507746529518df29f0ab751c/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:17.143467 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f1fbd-717a-4a24-9ed2-ae8f53ffd8fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4e8ed6d5cf47ed95bede72b9772e4c, user_id=23e8612c507746529518df29f0ab751c, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:17.151165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93f1fbd-717a-4a24-9ed2-ae8f53ffd8fd admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:17.164858 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c576c-865f-45ae-9e1a-be87a9e02d14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:17.166511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c576c-865f-45ae-9e1a-be87a9e02d14 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:17.189038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 819/1628] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:17.190073 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c576c-865f-45ae-9e1a-be87a9e02d14 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:17.214707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c576c-865f-45ae-9e1a-be87a9e02d14 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:17.227118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5bf98-915a-4c5e-b2e7-55c0d4c4612b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:17.227834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5bf98-915a-4c5e-b2e7-55c0d4c4612b admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:17.228129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5bf98-915a-4c5e-b2e7-55c0d4c4612b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:17.228395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5bf98-915a-4c5e-b2e7-55c0d4c4612b admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:17.230524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5bf98-915a-4c5e-b2e7-55c0d4c4612b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:17.235409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5bf98-915a-4c5e-b2e7-55c0d4c4612b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:17.344166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 810/1629] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:16 2022] PUT /identity/v3/projects/2d4e8ed6d5cf47ed95bede72b9772e4c/users/23e8612c507746529518df29f0ab751c/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:17.348863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabecfa4-b8c7-43c6-8c45-19b37268c86a None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:17.348863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabecfa4-b8c7-43c6-8c45-19b37268c86a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:17.348863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabecfa4-b8c7-43c6-8c45-19b37268c86a None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:17.348863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 811/1630] 10.222.0.52 () {54 vars in 912 bytes} [Thu Jun 23 11:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:10:17.349735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabecfa4-b8c7-43c6-8c45-19b37268c86a None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:17.380473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 820/1631] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:17 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:17.380473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53963778-2436-4e52-b3fd-06c5c054ddcb None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:17.380473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53963778-2436-4e52-b3fd-06c5c054ddcb None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:17.380473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53963778-2436-4e52-b3fd-06c5c054ddcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:17.416112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-53963778-2436-4e52-b3fd-06c5c054ddcb None None] MFA Rules not processed for user `a020e7fe06574a108b46f9f48bddc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:17.422653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-53963778-2436-4e52-b3fd-06c5c054ddcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:17.445251 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabecfa4-b8c7-43c6-8c45-19b37268c86a None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:17.447544 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03232d6e-c3a9-42fd-8951-6f42cbf48358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:17.448777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03232d6e-c3a9-42fd-8951-6f42cbf48358 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:17.449581 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03232d6e-c3a9-42fd-8951-6f42cbf48358 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:17.450764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03232d6e-c3a9-42fd-8951-6f42cbf48358 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:17.454895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03232d6e-c3a9-42fd-8951-6f42cbf48358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:17.457662 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03232d6e-c3a9-42fd-8951-6f42cbf48358 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:17.468426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 812/1632] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:10:17.469480 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03232d6e-c3a9-42fd-8951-6f42cbf48358 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:17.485148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03232d6e-c3a9-42fd-8951-6f42cbf48358 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:17.489912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dd7c4-68c8-425d-9f42-09365b81f7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:17.491031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dd7c4-68c8-425d-9f42-09365b81f7de admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:17.491291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dd7c4-68c8-425d-9f42-09365b81f7de admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:17.491571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dd7c4-68c8-425d-9f42-09365b81f7de admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:17.492562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dd7c4-68c8-425d-9f42-09365b81f7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:17.494702 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57dd7c4-68c8-425d-9f42-09365b81f7de admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:17.509892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 813/1633] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:17.511009 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dd7c4-68c8-425d-9f42-09365b81f7de admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:17.524602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dd7c4-68c8-425d-9f42-09365b81f7de admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:17.535873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc2c9f-d2ce-44fd-99bc-186bbf4c5fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:17.535873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc2c9f-d2ce-44fd-99bc-186bbf4c5fda admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:17.538234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc2c9f-d2ce-44fd-99bc-186bbf4c5fda admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:17.538234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc2c9f-d2ce-44fd-99bc-186bbf4c5fda admin admin] PATH_INFO: `/v3/projects/2d4e8ed6d5cf47ed95bede72b9772e4c/users/23e8612c507746529518df29f0ab751c/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:17.542019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc2c9f-d2ce-44fd-99bc-186bbf4c5fda admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d4e8ed6d5cf47ed95bede72b9772e4c, user_id=23e8612c507746529518df29f0ab751c, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:17.552761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dc2c9f-d2ce-44fd-99bc-186bbf4c5fda admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:17.563864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 814/1634] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:17 2022] PUT /identity/v3/projects/2d4e8ed6d5cf47ed95bede72b9772e4c/users/23e8612c507746529518df29f0ab751c/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:17.563864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc2c9f-d2ce-44fd-99bc-186bbf4c5fda admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:17.641550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 821/1635] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:10:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:17.643111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53963778-2436-4e52-b3fd-06c5c054ddcb None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:17.665154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53963778-2436-4e52-b3fd-06c5c054ddcb None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:17.702226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc2c9f-d2ce-44fd-99bc-186bbf4c5fda admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:17.711768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547078f-5257-4a8f-95fa-cfa26a58ddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:17.715979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547078f-5257-4a8f-95fa-cfa26a58ddfb admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:17.715979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547078f-5257-4a8f-95fa-cfa26a58ddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:17.715979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547078f-5257-4a8f-95fa-cfa26a58ddfb admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:17.715979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547078f-5257-4a8f-95fa-cfa26a58ddfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:17.716755 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547078f-5257-4a8f-95fa-cfa26a58ddfb admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:17.735283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 815/1636] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:17.735283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c587c5-29bf-4fca-89c3-abf1fbad937f None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:17.735283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c587c5-29bf-4fca-89c3-abf1fbad937f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:17.735283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c587c5-29bf-4fca-89c3-abf1fbad937f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:17.747623 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:17.755292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:17.755292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:17.755292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] PATH_INFO: `/v3/users/f5068236cf154bd78e88cd615f94de63` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:17.755292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5068236cf154bd78e88cd615f94de63)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:17.755292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:17.766483 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-23c587c5-29bf-4fca-89c3-abf1fbad937f None None] MFA Rules not processed for user `23e8612c507746529518df29f0ab751c`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:17.768258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-23c587c5-29bf-4fca-89c3-abf1fbad937f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:17.841913 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:17.864164 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 816/1637] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:17.864837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c587c5-29bf-4fca-89c3-abf1fbad937f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:17.928714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c587c5-29bf-4fca-89c3-abf1fbad937f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:17.932625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b739d61-3b28-4805-8101-482be0efc002 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:17.933287 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b739d61-3b28-4805-8101-482be0efc002 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:17.933572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b739d61-3b28-4805-8101-482be0efc002 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:17.933911 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b739d61-3b28-4805-8101-482be0efc002 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:17.989438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:18.040401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b739d61-3b28-4805-8101-482be0efc002 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:18.041957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b739d61-3b28-4805-8101-482be0efc002 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:18.055243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 817/1638] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:18.056486 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b739d61-3b28-4805-8101-482be0efc002 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:18.057309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5068236cf154bd78e88cd615f94de63'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:18.057990 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5068236cf154bd78e88cd615f94de63'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:18.058600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5068236cf154bd78e88cd615f94de63'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:18.068619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b739d61-3b28-4805-8101-482be0efc002 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:18.074495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fe2797-170a-475a-839d-3d8fe99a4d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:18.076103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2797-170a-475a-839d-3d8fe99a4d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:18.076819 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2797-170a-475a-839d-3d8fe99a4d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:18.076819 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fe2797-170a-475a-839d-3d8fe99a4d83 admin admin] PATH_INFO: `/v3/projects/09dc610744e845be831743907cf473ac/users/01a99ae8335746039a97d4d55e5b7952/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:18.093952 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe2797-170a-475a-839d-3d8fe99a4d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09dc610744e845be831743907cf473ac, user_id=01a99ae8335746039a97d4d55e5b7952, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:18.096904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fe2797-170a-475a-839d-3d8fe99a4d83 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:18.346392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5068236cf154bd78e88cd615f94de63'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:18.354485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5068236cf154bd78e88cd615f94de63'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:18.372828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 822/1639] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:17 2022] DELETE /identity/v3/users/f5068236cf154bd78e88cd615f94de63 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:18.374537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:18.375464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:18.384568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 818/1640] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:18 2022] PUT /identity/v3/projects/09dc610744e845be831743907cf473ac/users/01a99ae8335746039a97d4d55e5b7952/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:18.391649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dfd5a-fe97-47be-8c48-78e6c366168e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:18.391649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dfd5a-fe97-47be-8c48-78e6c366168e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:18.391649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91dfd5a-fe97-47be-8c48-78e6c366168e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:18.405463 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-e91dfd5a-fe97-47be-8c48-78e6c366168e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:18.407221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e91dfd5a-fe97-47be-8c48-78e6c366168e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:18.467200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d221ede-336a-4e72-a129-dbc9ed9e1ad1 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:18.500519 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 819/1641] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:18.502225 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37a08a-92dc-4d8e-81c7-dab599904931 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:18.502646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37a08a-92dc-4d8e-81c7-dab599904931 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:18.503035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37a08a-92dc-4d8e-81c7-dab599904931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:18.532582 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c9ea3-3b69-41fd-93ef-d0b0324bc0d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:18.533443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c9ea3-3b69-41fd-93ef-d0b0324bc0d8 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:18.547038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c9ea3-3b69-41fd-93ef-d0b0324bc0d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:18.547281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760c9ea3-3b69-41fd-93ef-d0b0324bc0d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:18.556486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-760c9ea3-3b69-41fd-93ef-d0b0324bc0d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:18.595356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-ca37a08a-92dc-4d8e-81c7-dab599904931 None None] MFA Rules not processed for user `01a99ae8335746039a97d4d55e5b7952`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:18.598989 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ca37a08a-92dc-4d8e-81c7-dab599904931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:18.692822 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c9ea3-3b69-41fd-93ef-d0b0324bc0d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:18.692822 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760c9ea3-3b69-41fd-93ef-d0b0324bc0d8 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:18.693005 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 820/1642] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:18.693005 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37a08a-92dc-4d8e-81c7-dab599904931 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:18.694599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ca37a08a-92dc-4d8e-81c7-dab599904931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:18.699623 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 823/1643] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:18 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:18.700593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c9ea3-3b69-41fd-93ef-d0b0324bc0d8 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:18.702019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-760c9ea3-3b69-41fd-93ef-d0b0324bc0d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:18.718602 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760c9ea3-3b69-41fd-93ef-d0b0324bc0d8 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:18.724167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abe021-79c7-4f9e-b9a5-674d1fe388ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:18.725012 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe021-79c7-4f9e-b9a5-674d1fe388ae admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:18.725365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe021-79c7-4f9e-b9a5-674d1fe388ae admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:18.725735 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5abe021-79c7-4f9e-b9a5-674d1fe388ae admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:18.726694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abe021-79c7-4f9e-b9a5-674d1fe388ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:18.728766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5abe021-79c7-4f9e-b9a5-674d1fe388ae admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:18.789691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca37a08a-92dc-4d8e-81c7-dab599904931 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:18.794937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0a807-8ebf-4982-97eb-e2336edb6573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:18.796729 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0a807-8ebf-4982-97eb-e2336edb6573 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:18.797020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0a807-8ebf-4982-97eb-e2336edb6573 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:18.797304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce0a807-8ebf-4982-97eb-e2336edb6573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:18.808667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0a807-8ebf-4982-97eb-e2336edb6573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:18.810571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce0a807-8ebf-4982-97eb-e2336edb6573 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:18.821842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 821/1644] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:18.930575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 824/1645] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:18 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:18.933658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0a807-8ebf-4982-97eb-e2336edb6573 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:18.947593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce0a807-8ebf-4982-97eb-e2336edb6573 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:19.245457 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e8883-0fc1-465f-a1dc-0235157653b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:19.245457 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e8883-0fc1-465f-a1dc-0235157653b4 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:19.245457 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e8883-0fc1-465f-a1dc-0235157653b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:19.245457 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e8883-0fc1-465f-a1dc-0235157653b4 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:19.248595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e8883-0fc1-465f-a1dc-0235157653b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:19.248595 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40e8883-0fc1-465f-a1dc-0235157653b4 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:19.249232 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abe021-79c7-4f9e-b9a5-674d1fe388ae admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:19.249676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 822/1646] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:18 2022] POST /identity/v3/users => generated 300 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:19.250660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5abe021-79c7-4f9e-b9a5-674d1fe388ae admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:19.250660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c18e1-04c5-419d-9517-be82f985816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:19.250660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c18e1-04c5-419d-9517-be82f985816a admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:19.250660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c18e1-04c5-419d-9517-be82f985816a admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:19.251495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c18e1-04c5-419d-9517-be82f985816a admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:19.251495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c18e1-04c5-419d-9517-be82f985816a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:19.251495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91c18e1-04c5-419d-9517-be82f985816a admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:19.251841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e8883-0fc1-465f-a1dc-0235157653b4 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:19.251994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 825/1647] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:19.267670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e8883-0fc1-465f-a1dc-0235157653b4 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:19.273214 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242f76e-9d3a-4052-b5cb-89746b5e21d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:19.274442 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242f76e-9d3a-4052-b5cb-89746b5e21d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:19.274969 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242f76e-9d3a-4052-b5cb-89746b5e21d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:19.275326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242f76e-9d3a-4052-b5cb-89746b5e21d1 admin admin] PATH_INFO: `/v3/projects/5090da7b66dc4a189a36e2ae4060d146/users/56564359ef794e699cc48352c4c7c6fa/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:19.293822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242f76e-9d3a-4052-b5cb-89746b5e21d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5090da7b66dc4a189a36e2ae4060d146, user_id=56564359ef794e699cc48352c4c7c6fa, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:19.296877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242f76e-9d3a-4052-b5cb-89746b5e21d1 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:19.570372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 823/1648] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:19 2022] PUT /identity/v3/projects/5090da7b66dc4a189a36e2ae4060d146/users/56564359ef794e699cc48352c4c7c6fa/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:19.582317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c18e1-04c5-419d-9517-be82f985816a admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:19.595475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c18e1-04c5-419d-9517-be82f985816a admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:19.638554 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:19.726348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05a98e5-c2d7-4567-861c-61c88640f13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:19.726348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a98e5-c2d7-4567-861c-61c88640f13c admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:19.726727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a98e5-c2d7-4567-861c-61c88640f13c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:19.727013 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05a98e5-c2d7-4567-861c-61c88640f13c admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:19.728677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a98e5-c2d7-4567-861c-61c88640f13c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:19.730436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05a98e5-c2d7-4567-861c-61c88640f13c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:19.743106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 826/1649] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:19.748088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242f76e-9d3a-4052-b5cb-89746b5e21d1 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:19.760566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242f76e-9d3a-4052-b5cb-89746b5e21d1 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:19.766774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0a5cc-cb52-4252-ab9e-c131d28838a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:19.767535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0a5cc-cb52-4252-ab9e-c131d28838a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:19.767935 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0a5cc-cb52-4252-ab9e-c131d28838a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:19.768286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0a5cc-cb52-4252-ab9e-c131d28838a7 admin admin] PATH_INFO: `/v3/projects/5090da7b66dc4a189a36e2ae4060d146/users/56564359ef794e699cc48352c4c7c6fa/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:19.770869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0a5cc-cb52-4252-ab9e-c131d28838a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5090da7b66dc4a189a36e2ae4060d146, user_id=56564359ef794e699cc48352c4c7c6fa, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:19.776181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0a5cc-cb52-4252-ab9e-c131d28838a7 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:19.791656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 824/1650] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:19 2022] PUT /identity/v3/projects/5090da7b66dc4a189a36e2ae4060d146/users/56564359ef794e699cc48352c4c7c6fa/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:10:19.792214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:19.803061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cd975-364b-4b2f-9130-225cca283058 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:19.806430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cd975-364b-4b2f-9130-225cca283058 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:19.806430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0cd975-364b-4b2f-9130-225cca283058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:19.892677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-8b0cd975-364b-4b2f-9130-225cca283058 None None] MFA Rules not processed for user `56564359ef794e699cc48352c4c7c6fa`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:19.892677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8b0cd975-364b-4b2f-9130-225cca283058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:19.990617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 827/1651] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:19 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:20.003922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0a5cc-cb52-4252-ab9e-c131d28838a7 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:20.070126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0a5cc-cb52-4252-ab9e-c131d28838a7 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:20.075751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b6388-f84f-4cf0-9758-2f72f0ccf972 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:20.076601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b6388-f84f-4cf0-9758-2f72f0ccf972 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:20.076951 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b6388-f84f-4cf0-9758-2f72f0ccf972 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:20.077299 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b6388-f84f-4cf0-9758-2f72f0ccf972 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:20.087725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cd975-364b-4b2f-9130-225cca283058 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:20.089330 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8b0cd975-364b-4b2f-9130-225cca283058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:20.107455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b6388-f84f-4cf0-9758-2f72f0ccf972 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:20.110756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b6388-f84f-4cf0-9758-2f72f0ccf972 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:20.157984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 825/1652] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:20.279865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0cd975-364b-4b2f-9130-225cca283058 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:20.301551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:20.302833 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:20.305226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:20.306685 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] PATH_INFO: `/v3/projects/e6420da641da49f38bcc6a0fd0603767` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:20.326260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6420da641da49f38bcc6a0fd0603767)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:20.326260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: WARNING py.warnings [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:10:20.326260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: warnings.warn(msg) Jun 23 11:10:20.326260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: Jun 23 11:10:20.326260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:20.527939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6420da641da49f38bcc6a0fd0603767', 'request_id': 'req-c7b290f5-f5db-4b13-a518-428fa2e9e714'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:20.537882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6420da641da49f38bcc6a0fd0603767', 'request_id': 'req-c7b290f5-f5db-4b13-a518-428fa2e9e714'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:20.553911 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6420da641da49f38bcc6a0fd0603767', 'request_id': 'req-c7b290f5-f5db-4b13-a518-428fa2e9e714'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:20.708774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] The token cache is being invalidate because project e6420da641da49f38bcc6a0fd0603767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:20.709828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:20.713690 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:20.717001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 828/1653] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:20 2022] DELETE /identity/v3/projects/e6420da641da49f38bcc6a0fd0603767 => generated 0 bytes in 630 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:20.722476 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca68f42-f783-47bf-8803-fb3517857f79 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:20.723916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca68f42-f783-47bf-8803-fb3517857f79 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:20.724484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca68f42-f783-47bf-8803-fb3517857f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:20.755282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-8ca68f42-f783-47bf-8803-fb3517857f79 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:20.757143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8ca68f42-f783-47bf-8803-fb3517857f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:20.811151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:20.812996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:20.913719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 826/1654] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:20.922182 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e9070-3616-4955-a522-d328e4ff76e5 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:20.922580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e9070-3616-4955-a522-d328e4ff76e5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:20.922976 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2e9070-3616-4955-a522-d328e4ff76e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:20.946226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-1b2e9070-3616-4955-a522-d328e4ff76e5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:20.947667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1b2e9070-3616-4955-a522-d328e4ff76e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:20.964077 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 827/1655] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:20.966840 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e9070-3616-4955-a522-d328e4ff76e5 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:20.976227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2e9070-3616-4955-a522-d328e4ff76e5 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:20.987594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ff0ba-6810-45e0-8cca-cf6ba25ebc38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:20.995094 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ff0ba-6810-45e0-8cca-cf6ba25ebc38 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:20.995094 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ff0ba-6810-45e0-8cca-cf6ba25ebc38 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:20.995094 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ff0ba-6810-45e0-8cca-cf6ba25ebc38 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:20.995377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b290f5-f5db-4b13-a518-428fa2e9e714 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:20.996309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ff0ba-6810-45e0-8cca-cf6ba25ebc38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:20.998020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ff0ba-6810-45e0-8cca-cf6ba25ebc38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:21.014032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9ff0ba-6810-45e0-8cca-cf6ba25ebc38 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:21.020272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b49881-a9e2-4c37-808f-ff9aa3cc06cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:21.025881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b49881-a9e2-4c37-808f-ff9aa3cc06cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:21.026176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b49881-a9e2-4c37-808f-ff9aa3cc06cf admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:21.029087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b49881-a9e2-4c37-808f-ff9aa3cc06cf admin admin] PATH_INFO: `/v3/users/d003e00278d04d9b886650b303c643ec` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:21.042675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b49881-a9e2-4c37-808f-ff9aa3cc06cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d003e00278d04d9b886650b303c643ec)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:21.045706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b49881-a9e2-4c37-808f-ff9aa3cc06cf admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:21.055313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 828/1656] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:21.060466 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ff0ba-6810-45e0-8cca-cf6ba25ebc38 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:21.070659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ff0ba-6810-45e0-8cca-cf6ba25ebc38 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:21.080814 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dede8b-8b80-4740-8af5-8b8ab520424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:21.081498 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dede8b-8b80-4740-8af5-8b8ab520424a admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:21.082165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dede8b-8b80-4740-8af5-8b8ab520424a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:21.082460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dede8b-8b80-4740-8af5-8b8ab520424a admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:21.083178 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dede8b-8b80-4740-8af5-8b8ab520424a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:21.085679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dede8b-8b80-4740-8af5-8b8ab520424a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:21.258914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:21.272418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 829/1657] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:21 2022] POST /identity/v3/projects => generated 363 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:10:21.274425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dede8b-8b80-4740-8af5-8b8ab520424a admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:21.346094 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dede8b-8b80-4740-8af5-8b8ab520424a admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:21.351412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e54848-c835-4fc8-bdd3-529e93cb3329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:21.352238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e54848-c835-4fc8-bdd3-529e93cb3329 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:21.352600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e54848-c835-4fc8-bdd3-529e93cb3329 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:21.353066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e54848-c835-4fc8-bdd3-529e93cb3329 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:21.354002 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e54848-c835-4fc8-bdd3-529e93cb3329 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:21.356635 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e54848-c835-4fc8-bdd3-529e93cb3329 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:21.417961 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-51b49881-a9e2-4c37-808f-ff9aa3cc06cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd003e00278d04d9b886650b303c643ec'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:21.418774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-51b49881-a9e2-4c37-808f-ff9aa3cc06cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd003e00278d04d9b886650b303c643ec'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:21.419503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-51b49881-a9e2-4c37-808f-ff9aa3cc06cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd003e00278d04d9b886650b303c643ec'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:21.429099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:21.526647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-51b49881-a9e2-4c37-808f-ff9aa3cc06cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd003e00278d04d9b886650b303c643ec'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:21.543484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 830/1658] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:21 2022] POST /identity/v3/users => generated 282 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:10:21.547652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e54848-c835-4fc8-bdd3-529e93cb3329 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:21.552001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-14e54848-c835-4fc8-bdd3-529e93cb3329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:21.552336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-51b49881-a9e2-4c37-808f-ff9aa3cc06cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd003e00278d04d9b886650b303c643ec'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:21.607508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e54848-c835-4fc8-bdd3-529e93cb3329 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:21.625689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8591f-2604-4c5c-86eb-a2f79eb41bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:21.630181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8591f-2604-4c5c-86eb-a2f79eb41bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:21.630569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8591f-2604-4c5c-86eb-a2f79eb41bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:21.631053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a8591f-2604-4c5c-86eb-a2f79eb41bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:21.634033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8591f-2604-4c5c-86eb-a2f79eb41bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:21.636768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a8591f-2604-4c5c-86eb-a2f79eb41bb2 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:21.654553 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 829/1659] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:20 2022] DELETE /identity/v3/users/d003e00278d04d9b886650b303c643ec => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:10:21.663983 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 831/1660] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:21.672781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a841f-324e-4401-a031-d5761486c318 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:21.673227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a841f-324e-4401-a031-d5761486c318 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:21.673645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a841f-324e-4401-a031-d5761486c318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:21.676550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8591f-2604-4c5c-86eb-a2f79eb41bb2 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:21.691889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a8591f-2604-4c5c-86eb-a2f79eb41bb2 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:21.736439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-4c2a841f-324e-4401-a031-d5761486c318 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:21.739768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-4c2a841f-324e-4401-a031-d5761486c318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:21.809501 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52512f8e-20fa-4706-baba-b7187aa4dc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:21.815920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52512f8e-20fa-4706-baba-b7187aa4dc08 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:21.815920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52512f8e-20fa-4706-baba-b7187aa4dc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:21.815920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52512f8e-20fa-4706-baba-b7187aa4dc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:21.815920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52512f8e-20fa-4706-baba-b7187aa4dc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:21.826946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52512f8e-20fa-4706-baba-b7187aa4dc08 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:21.852464 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 832/1661] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:21 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:21.854720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52512f8e-20fa-4706-baba-b7187aa4dc08 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:21.891593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 830/1662] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:21.909226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52512f8e-20fa-4706-baba-b7187aa4dc08 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:21.916869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a841f-324e-4401-a031-d5761486c318 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:21.929464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-4c2a841f-324e-4401-a031-d5761486c318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:21.964369 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809af82f-5338-49e2-aecb-b3148a87cd41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:21.973556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af82f-5338-49e2-aecb-b3148a87cd41 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:21.974114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af82f-5338-49e2-aecb-b3148a87cd41 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:21.974459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809af82f-5338-49e2-aecb-b3148a87cd41 admin admin] PATH_INFO: `/v3/projects/8cf2a3ba25734ce6bd05cd236fc39f29/users/58b38c9f5b624b02a81eb4fe881b31e6/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:22.084815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809af82f-5338-49e2-aecb-b3148a87cd41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8cf2a3ba25734ce6bd05cd236fc39f29, user_id=58b38c9f5b624b02a81eb4fe881b31e6, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:22.089765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809af82f-5338-49e2-aecb-b3148a87cd41 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:22.096850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a841f-324e-4401-a031-d5761486c318 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:22.109971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6ed15-fe31-415b-8e33-69c88fccbf8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:22.110654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6ed15-fe31-415b-8e33-69c88fccbf8b service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:22.111381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6ed15-fe31-415b-8e33-69c88fccbf8b service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:22.111771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6ed15-fe31-415b-8e33-69c88fccbf8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:22.161716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6ed15-fe31-415b-8e33-69c88fccbf8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:22.163210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6ed15-fe31-415b-8e33-69c88fccbf8b service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:22.196394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 831/1663] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:22.238103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 833/1664] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:21 2022] PUT /identity/v3/projects/8cf2a3ba25734ce6bd05cd236fc39f29/users/58b38c9f5b624b02a81eb4fe881b31e6/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:22.252680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74667ce8-b971-40f0-b88c-250900007a29 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:22.252972 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74667ce8-b971-40f0-b88c-250900007a29 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:22.253260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74667ce8-b971-40f0-b88c-250900007a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:22.320056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-74667ce8-b971-40f0-b88c-250900007a29 None None] MFA Rules not processed for user `58b38c9f5b624b02a81eb4fe881b31e6`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:22.320252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809af82f-5338-49e2-aecb-b3148a87cd41 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:22.320495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-74667ce8-b971-40f0-b88c-250900007a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:22.320597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-809af82f-5338-49e2-aecb-b3148a87cd41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:22.470100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809af82f-5338-49e2-aecb-b3148a87cd41 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:22.479978 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ed8b2-4481-4b3b-b612-6fd00baf0602 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:22.481046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ed8b2-4481-4b3b-b612-6fd00baf0602 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:22.482818 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ed8b2-4481-4b3b-b612-6fd00baf0602 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:22.483728 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ed8b2-4481-4b3b-b612-6fd00baf0602 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:22.488120 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-7a7ed8b2-4481-4b3b-b612-6fd00baf0602 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:22.634552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 832/1665] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:22 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 383 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:22.640322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74667ce8-b971-40f0-b88c-250900007a29 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:22.814586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ed8b2-4481-4b3b-b612-6fd00baf0602 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:22.820288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7ed8b2-4481-4b3b-b612-6fd00baf0602 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:22.826618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74667ce8-b971-40f0-b88c-250900007a29 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:22.853490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 834/1666] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:10:22.894784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdbe9b-9de3-476a-ab43-59e1e2b25a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:22.895024 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdbe9b-9de3-476a-ab43-59e1e2b25a68 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:22.895258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdbe9b-9de3-476a-ab43-59e1e2b25a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:22.895533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfdbe9b-9de3-476a-ab43-59e1e2b25a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:22.908783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdbe9b-9de3-476a-ab43-59e1e2b25a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:22.916058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfdbe9b-9de3-476a-ab43-59e1e2b25a68 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:23.601162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 833/1667] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:22 2022] POST /identity/v3/projects => generated 365 bytes in 962 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:23.605519 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ed8b2-4481-4b3b-b612-6fd00baf0602 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:23.624143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7ed8b2-4481-4b3b-b612-6fd00baf0602 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:23.798048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410703-b0e1-44e9-a158-b8c99a97b4eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:23.798048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410703-b0e1-44e9-a158-b8c99a97b4eb admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:23.798048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410703-b0e1-44e9-a158-b8c99a97b4eb admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:23.798516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdbe9b-9de3-476a-ab43-59e1e2b25a68 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:23.798699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05410703-b0e1-44e9-a158-b8c99a97b4eb admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:23.798699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410703-b0e1-44e9-a158-b8c99a97b4eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:23.799073 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2bfdbe9b-9de3-476a-ab43-59e1e2b25a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:23.801507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05410703-b0e1-44e9-a158-b8c99a97b4eb admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:23.834005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfdbe9b-9de3-476a-ab43-59e1e2b25a68 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:23.848803 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:23.849801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:23.850203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:23.850586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] PATH_INFO: `/v3/users/f6c07330d4184f8bb675abc1746b4dc8` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:23.853427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6c07330d4184f8bb675abc1746b4dc8)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:23.855881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:23.860621 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:23.935529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 835/1668] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:23 2022] POST /identity/v3/users => generated 289 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:23.940192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410703-b0e1-44e9-a158-b8c99a97b4eb admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:23.960991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05410703-b0e1-44e9-a158-b8c99a97b4eb admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:23.989087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aa099-70e8-41a6-8e02-6476f80394bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:23.990570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aa099-70e8-41a6-8e02-6476f80394bb admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:23.990870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aa099-70e8-41a6-8e02-6476f80394bb admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:23.992356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5aa099-70e8-41a6-8e02-6476f80394bb admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:23.993412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5aa099-70e8-41a6-8e02-6476f80394bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:24.009016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5aa099-70e8-41a6-8e02-6476f80394bb admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:24.046837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 836/1669] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:23 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:10:24.065994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aa099-70e8-41a6-8e02-6476f80394bb admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:24.118003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5aa099-70e8-41a6-8e02-6476f80394bb admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:24.118820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaac1b9-e36e-4daf-a50e-05c00ea74baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:24.120352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaac1b9-e36e-4daf-a50e-05c00ea74baa admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:24.120352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaac1b9-e36e-4daf-a50e-05c00ea74baa admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:24.120817 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaac1b9-e36e-4daf-a50e-05c00ea74baa admin admin] PATH_INFO: `/v3/projects/1988264328454af19a93597004d0c403/users/38a9ae890e804e3690c7ad9340f23b2e/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:24.158920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaac1b9-e36e-4daf-a50e-05c00ea74baa admin admin] RBAC: Authorizing `identity:create_grant(project_id=1988264328454af19a93597004d0c403, user_id=38a9ae890e804e3690c7ad9340f23b2e, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:24.162082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaac1b9-e36e-4daf-a50e-05c00ea74baa admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:24.340661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6c07330d4184f8bb675abc1746b4dc8'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:24.349145 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6c07330d4184f8bb675abc1746b4dc8'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:24.351897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 837/1670] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:24 2022] PUT /identity/v3/projects/1988264328454af19a93597004d0c403/users/38a9ae890e804e3690c7ad9340f23b2e/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:24.353114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaac1b9-e36e-4daf-a50e-05c00ea74baa admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:24.354601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6c07330d4184f8bb675abc1746b4dc8'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:24.356505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0aaac1b9-e36e-4daf-a50e-05c00ea74baa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:24.459332 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6c07330d4184f8bb675abc1746b4dc8'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:24.470619 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6c07330d4184f8bb675abc1746b4dc8'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:24.514130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 834/1671] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:23 2022] DELETE /identity/v3/users/f6c07330d4184f8bb675abc1746b4dc8 => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:24.515304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:24.517121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:24.581613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaac1b9-e36e-4daf-a50e-05c00ea74baa admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:24.720659 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49371a-b52c-4f89-8367-2c65f4b1461c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:24.729093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:24.729984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:24.730266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:24.730545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120 admin admin] PATH_INFO: `/v3/projects/c661f89e029843d187b5021013e297fa` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:24.731970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c661f89e029843d187b5021013e297fa)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:24.733914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:24.744935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c1ac3a-7025-4f1b-b296-b3aa60f94f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:24.745959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ac3a-7025-4f1b-b296-b3aa60f94f9a admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:24.746838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ac3a-7025-4f1b-b296-b3aa60f94f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:24.747180 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c1ac3a-7025-4f1b-b296-b3aa60f94f9a admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:24.752834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1ac3a-7025-4f1b-b296-b3aa60f94f9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:24.752834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c1ac3a-7025-4f1b-b296-b3aa60f94f9a admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:24.781246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 835/1672] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:24 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:24.783648 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea179e-dd3a-413d-a6c0-805c5588e8ef None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:24.790675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea179e-dd3a-413d-a6c0-805c5588e8ef None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:24.791458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ea179e-dd3a-413d-a6c0-805c5588e8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:24.843114 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-57ea179e-dd3a-413d-a6c0-805c5588e8ef None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:24.845758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-57ea179e-dd3a-413d-a6c0-805c5588e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:24.868808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 836/1673] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:24.870052 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea179e-dd3a-413d-a6c0-805c5588e8ef None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:24.895215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ea179e-dd3a-413d-a6c0-805c5588e8ef None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:24.909928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae731-121d-417a-b9ff-3505cf366d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:24.911033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae731-121d-417a-b9ff-3505cf366d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:24.911416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae731-121d-417a-b9ff-3505cf366d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:24.911795 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415ae731-121d-417a-b9ff-3505cf366d28 admin admin] PATH_INFO: `/v3/projects/1988264328454af19a93597004d0c403/users/38a9ae890e804e3690c7ad9340f23b2e/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:24.915051 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ae731-121d-417a-b9ff-3505cf366d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1988264328454af19a93597004d0c403, user_id=38a9ae890e804e3690c7ad9340f23b2e, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:24.918405 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415ae731-121d-417a-b9ff-3505cf366d28 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:24.953261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 837/1674] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:24 2022] PUT /identity/v3/projects/1988264328454af19a93597004d0c403/users/38a9ae890e804e3690c7ad9340f23b2e/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:24.958289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae731-121d-417a-b9ff-3505cf366d28 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:24.959082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-415ae731-121d-417a-b9ff-3505cf366d28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:24.991004 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:24.998293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c661f89e029843d187b5021013e297fa', 'request_id': 'req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:25.005881 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c661f89e029843d187b5021013e297fa', 'request_id': 'req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:25.024306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c661f89e029843d187b5021013e297fa', 'request_id': 'req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:25.133647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415ae731-121d-417a-b9ff-3505cf366d28 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:25.209217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120 admin admin] The token cache is being invalidate because project c661f89e029843d187b5021013e297fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:25.209518 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:25.216381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d629ca6c-8491-4fb5-a09d-5cdd1cb78120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:25.216381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 838/1675] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:24 2022] DELETE /identity/v3/projects/c661f89e029843d187b5021013e297fa => generated 0 bytes in 862 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:25.223220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ef8ac-f410-4191-8796-f7e5ea87e462 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:25.223542 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ef8ac-f410-4191-8796-f7e5ea87e462 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:25.223844 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ef8ac-f410-4191-8796-f7e5ea87e462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:25.242091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c389-0b1b-421e-ac9d-4d414f63a140 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:25.243445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c389-0b1b-421e-ac9d-4d414f63a140 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:25.244042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c389-0b1b-421e-ac9d-4d414f63a140 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:25.244958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb7c389-0b1b-421e-ac9d-4d414f63a140 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:25.248574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0eb7c389-0b1b-421e-ac9d-4d414f63a140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:25.295574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-094ef8ac-f410-4191-8796-f7e5ea87e462 None None] MFA Rules not processed for user `38a9ae890e804e3690c7ad9340f23b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:25.302128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-094ef8ac-f410-4191-8796-f7e5ea87e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:25.440038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7c389-0b1b-421e-ac9d-4d414f63a140 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:25.440869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb7c389-0b1b-421e-ac9d-4d414f63a140 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:25.470615 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 838/1676] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:25.472068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c389-0b1b-421e-ac9d-4d414f63a140 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:25.474073 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0eb7c389-0b1b-421e-ac9d-4d414f63a140 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:25.493490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 839/1677] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:25 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:25.502304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ef8ac-f410-4191-8796-f7e5ea87e462 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:25.503737 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-094ef8ac-f410-4191-8796-f7e5ea87e462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:25.504421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb7c389-0b1b-421e-ac9d-4d414f63a140 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:25.511430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:25.513072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:25.513584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:25.514070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] PATH_INFO: `/v3/users/23e8612c507746529518df29f0ab751c` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:25.515862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e8612c507746529518df29f0ab751c)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:25.520871 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:25.625485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ef8ac-f410-4191-8796-f7e5ea87e462 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:25.638782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17905b83-fe95-420c-82a1-ccc33d9ec534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:25.639720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17905b83-fe95-420c-82a1-ccc33d9ec534 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:25.640176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17905b83-fe95-420c-82a1-ccc33d9ec534 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:25.640746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17905b83-fe95-420c-82a1-ccc33d9ec534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:25.660646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17905b83-fe95-420c-82a1-ccc33d9ec534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:25.662321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17905b83-fe95-420c-82a1-ccc33d9ec534 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:25.689266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 840/1678] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:25 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:25.811329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e8612c507746529518df29f0ab751c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:25.812451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e8612c507746529518df29f0ab751c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:25.813555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e8612c507746529518df29f0ab751c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:25.906159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e8612c507746529518df29f0ab751c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:25.923671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e8612c507746529518df29f0ab751c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:25.952018 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:25.958414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 839/1679] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:25 2022] DELETE /identity/v3/users/23e8612c507746529518df29f0ab751c => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:26.846287 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17905b83-fe95-420c-82a1-ccc33d9ec534 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:26.849157 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-17905b83-fe95-420c-82a1-ccc33d9ec534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:26.874957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17905b83-fe95-420c-82a1-ccc33d9ec534 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:26.973278 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:26.976204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:26.976669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:26.978245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a admin admin] PATH_INFO: `/v3/projects/ee913c76f7b64e3492cc3ccae2400916` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:26.980674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee913c76f7b64e3492cc3ccae2400916)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:26.985947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:27.106513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:27.223256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee913c76f7b64e3492cc3ccae2400916', 'request_id': 'req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:27.242576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee913c76f7b64e3492cc3ccae2400916', 'request_id': 'req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:27.247989 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee913c76f7b64e3492cc3ccae2400916', 'request_id': 'req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:27.430221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:27.432671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:27.441913 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a admin admin] The token cache is being invalidate because project ee913c76f7b64e3492cc3ccae2400916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:27.442608 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:27.445560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b1bc9c2-fb78-4584-93e9-288d00e9b10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:27.452828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 841/1680] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:26 2022] DELETE /identity/v3/projects/ee913c76f7b64e3492cc3ccae2400916 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:27.469197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb579fe-5802-419e-980c-e9db26d6d116 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:27.470494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb579fe-5802-419e-980c-e9db26d6d116 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:27.471282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb579fe-5802-419e-980c-e9db26d6d116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:27.499113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c1de8-b4b1-418b-9c0b-b3de072c71f9 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:27.567482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-0cb579fe-5802-419e-980c-e9db26d6d116 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:27.584878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0cb579fe-5802-419e-980c-e9db26d6d116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:27.813763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004bc296-6c1b-4953-b27b-441f6532e795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:27.815833 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bc296-6c1b-4953-b27b-441f6532e795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:27.816602 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bc296-6c1b-4953-b27b-441f6532e795 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:27.817096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004bc296-6c1b-4953-b27b-441f6532e795 admin admin] PATH_INFO: `/v3/users/58b38c9f5b624b02a81eb4fe881b31e6` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:27.818641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bc296-6c1b-4953-b27b-441f6532e795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58b38c9f5b624b02a81eb4fe881b31e6)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:27.825236 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004bc296-6c1b-4953-b27b-441f6532e795 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:27.835504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:27.963258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 842/1681] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 498 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:27.967603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b1a63-1ef4-4f27-84c1-3e29ae90b9a7 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:27.968430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b1a63-1ef4-4f27-84c1-3e29ae90b9a7 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:27.970220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b1a63-1ef4-4f27-84c1-3e29ae90b9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:28.079187 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-c91b1a63-1ef4-4f27-84c1-3e29ae90b9a7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:28.080546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c91b1a63-1ef4-4f27-84c1-3e29ae90b9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:28.082910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-004bc296-6c1b-4953-b27b-441f6532e795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58b38c9f5b624b02a81eb4fe881b31e6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:28.084847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-004bc296-6c1b-4953-b27b-441f6532e795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58b38c9f5b624b02a81eb4fe881b31e6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:28.088420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-004bc296-6c1b-4953-b27b-441f6532e795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58b38c9f5b624b02a81eb4fe881b31e6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:28.115691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 843/1682] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:28.116516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b1a63-1ef4-4f27-84c1-3e29ae90b9a7 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:28.138345 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b1a63-1ef4-4f27-84c1-3e29ae90b9a7 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:28.158088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bd6eb-ce70-43b8-b76c-a3bb01c2b503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:28.158740 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bd6eb-ce70-43b8-b76c-a3bb01c2b503 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:28.159024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bd6eb-ce70-43b8-b76c-a3bb01c2b503 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:28.159301 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84bd6eb-ce70-43b8-b76c-a3bb01c2b503 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:28.160156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bd6eb-ce70-43b8-b76c-a3bb01c2b503 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:28.160471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bd6eb-ce70-43b8-b76c-a3bb01c2b503 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:28.162292 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84bd6eb-ce70-43b8-b76c-a3bb01c2b503 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:28.196018 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 844/1683] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:28.197257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bd6eb-ce70-43b8-b76c-a3bb01c2b503 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:28.218315 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84bd6eb-ce70-43b8-b76c-a3bb01c2b503 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:28.223305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-004bc296-6c1b-4953-b27b-441f6532e795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58b38c9f5b624b02a81eb4fe881b31e6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:28.232975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8a4a8-e8e4-4d59-9844-f1f56c278cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:28.233797 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8a4a8-e8e4-4d59-9844-f1f56c278cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:28.241087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8a4a8-e8e4-4d59-9844-f1f56c278cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:28.241087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a8a4a8-e8e4-4d59-9844-f1f56c278cf3 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:28.241087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8a4a8-e8e4-4d59-9844-f1f56c278cf3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:28.241087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a8a4a8-e8e4-4d59-9844-f1f56c278cf3 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:28.241414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-004bc296-6c1b-4953-b27b-441f6532e795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58b38c9f5b624b02a81eb4fe881b31e6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:28.296862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 840/1684] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:27 2022] DELETE /identity/v3/users/58b38c9f5b624b02a81eb4fe881b31e6 => generated 0 bytes in 864 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:28.298253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94867d22-0b82-4c77-a596-649da7a30618 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:28.298365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94867d22-0b82-4c77-a596-649da7a30618 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:28.298586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94867d22-0b82-4c77-a596-649da7a30618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:28.343756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-94867d22-0b82-4c77-a596-649da7a30618 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:28.345071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-94867d22-0b82-4c77-a596-649da7a30618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:28.390988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 845/1685] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:28 2022] POST /identity/v3/projects => generated 399 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:28.395045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8a4a8-e8e4-4d59-9844-f1f56c278cf3 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:28.518320 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 841/1686] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:28.519349 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94867d22-0b82-4c77-a596-649da7a30618 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:28.521747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-94867d22-0b82-4c77-a596-649da7a30618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:28.535654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94867d22-0b82-4c77-a596-649da7a30618 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:28.571402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a8a4a8-e8e4-4d59-9844-f1f56c278cf3 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:28.599381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de497e-3317-4a19-949a-cc005612ae1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:28.600249 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de497e-3317-4a19-949a-cc005612ae1c admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:28.606233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de497e-3317-4a19-949a-cc005612ae1c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:28.606233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de497e-3317-4a19-949a-cc005612ae1c admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:28.606233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de497e-3317-4a19-949a-cc005612ae1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:28.606233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de497e-3317-4a19-949a-cc005612ae1c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:28.703296 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:28.705113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:28.705606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:28.706049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb admin admin] PATH_INFO: `/v3/projects/2d4e8ed6d5cf47ed95bede72b9772e4c` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:28.709346 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d4e8ed6d5cf47ed95bede72b9772e4c)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:28.719866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:28.722124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 846/1687] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:28 2022] POST /identity/v3/users => generated 300 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:10:28.723340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de497e-3317-4a19-949a-cc005612ae1c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:28.727501 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f1de497e-3317-4a19-949a-cc005612ae1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:28.907701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de497e-3317-4a19-949a-cc005612ae1c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:28.923087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1565b9-d9be-462e-9cc2-037483f42005 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:28.923757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1565b9-d9be-462e-9cc2-037483f42005 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:28.924064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1565b9-d9be-462e-9cc2-037483f42005 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:28.924527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1565b9-d9be-462e-9cc2-037483f42005 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:28.963712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1565b9-d9be-462e-9cc2-037483f42005 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:28.965685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1565b9-d9be-462e-9cc2-037483f42005 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:28.986032 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d4e8ed6d5cf47ed95bede72b9772e4c', 'request_id': 'req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:29.008400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 847/1688] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:29.009278 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1565b9-d9be-462e-9cc2-037483f42005 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:29.011938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d4e8ed6d5cf47ed95bede72b9772e4c', 'request_id': 'req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:29.036164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d4e8ed6d5cf47ed95bede72b9772e4c', 'request_id': 'req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:29.047309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1565b9-d9be-462e-9cc2-037483f42005 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:29.180581 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcdd04-d777-4cd6-ad36-ce862ff0757c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:29.181352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcdd04-d777-4cd6-ad36-ce862ff0757c admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:29.181640 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcdd04-d777-4cd6-ad36-ce862ff0757c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:29.181914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcdd04-d777-4cd6-ad36-ce862ff0757c admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:29.182653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcdd04-d777-4cd6-ad36-ce862ff0757c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:29.184880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcdd04-d777-4cd6-ad36-ce862ff0757c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:29.213600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 848/1689] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:29.214603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcdd04-d777-4cd6-ad36-ce862ff0757c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:29.225839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcdd04-d777-4cd6-ad36-ce862ff0757c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:29.231181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a296-2bfb-41d7-b38e-3f25e1019608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:29.232361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a296-2bfb-41d7-b38e-3f25e1019608 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:29.232361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a296-2bfb-41d7-b38e-3f25e1019608 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:29.232554 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357a296-2bfb-41d7-b38e-3f25e1019608 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:29.233294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357a296-2bfb-41d7-b38e-3f25e1019608 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:29.234955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357a296-2bfb-41d7-b38e-3f25e1019608 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:29.251941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 849/1690] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:29.252927 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a296-2bfb-41d7-b38e-3f25e1019608 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:29.264549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb admin admin] The token cache is being invalidate because project 2d4e8ed6d5cf47ed95bede72b9772e4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:29.265070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:29.266812 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c8e7364b-e857-470d-8b6e-242f8c2d9aeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:29.273690 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 842/1691] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:28 2022] DELETE /identity/v3/projects/2d4e8ed6d5cf47ed95bede72b9772e4c => generated 0 bytes in 751 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:29.275309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3e330-d00b-4f64-b184-0269958e5a56 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:29.276964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3e330-d00b-4f64-b184-0269958e5a56 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:29.277476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e3e330-d00b-4f64-b184-0269958e5a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:29.282684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357a296-2bfb-41d7-b38e-3f25e1019608 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:29.295870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd4450-40ab-4ac1-9364-4c1e5fec5709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:29.297278 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd4450-40ab-4ac1-9364-4c1e5fec5709 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:29.297278 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd4450-40ab-4ac1-9364-4c1e5fec5709 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:29.297440 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd4450-40ab-4ac1-9364-4c1e5fec5709 admin admin] PATH_INFO: `/v3/projects/dfacdd797d3144958a8523da1d5d716e/users/4876bcdd2d414d01a88c3ce3f43e0faa/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:29.317219 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd4450-40ab-4ac1-9364-4c1e5fec5709 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfacdd797d3144958a8523da1d5d716e, user_id=4876bcdd2d414d01a88c3ce3f43e0faa, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:29.322668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd4450-40ab-4ac1-9364-4c1e5fec5709 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:29.350873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-28e3e330-d00b-4f64-b184-0269958e5a56 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:29.353235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-28e3e330-d00b-4f64-b184-0269958e5a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:29.379731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 843/1692] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:29.390037 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6961ec2-b18e-497f-b03f-3c4809b32e48 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:29.390331 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6961ec2-b18e-497f-b03f-3c4809b32e48 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:29.390611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6961ec2-b18e-497f-b03f-3c4809b32e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:29.448580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-c6961ec2-b18e-497f-b03f-3c4809b32e48 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:29.450329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c6961ec2-b18e-497f-b03f-3c4809b32e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:29.478837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 844/1693] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:29.481426 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6961ec2-b18e-497f-b03f-3c4809b32e48 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:29.483232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 850/1694] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:29 2022] PUT /identity/v3/projects/dfacdd797d3144958a8523da1d5d716e/users/4876bcdd2d414d01a88c3ce3f43e0faa/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:29.497644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6961ec2-b18e-497f-b03f-3c4809b32e48 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:29.498060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cfc0c-b4dd-404a-9800-e92689e6ee41 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:29.498534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cfc0c-b4dd-404a-9800-e92689e6ee41 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:29.499007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424cfc0c-b4dd-404a-9800-e92689e6ee41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:29.567772 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d52a72-7b44-4c69-b374-0f4ea4e6c9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:29.568749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-424cfc0c-b4dd-404a-9800-e92689e6ee41 None None] MFA Rules not processed for user `4876bcdd2d414d01a88c3ce3f43e0faa`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:29.569169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d52a72-7b44-4c69-b374-0f4ea4e6c9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:29.569649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d52a72-7b44-4c69-b374-0f4ea4e6c9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:29.570157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d52a72-7b44-4c69-b374-0f4ea4e6c9d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:29.571114 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d52a72-7b44-4c69-b374-0f4ea4e6c9d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:29.571631 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d52a72-7b44-4c69-b374-0f4ea4e6c9d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:29.574889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-424cfc0c-b4dd-404a-9800-e92689e6ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:29.575482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d52a72-7b44-4c69-b374-0f4ea4e6c9d0 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:29.603466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 845/1695] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:10:29.604868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d52a72-7b44-4c69-b374-0f4ea4e6c9d0 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:29.618303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d52a72-7b44-4c69-b374-0f4ea4e6c9d0 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:29.625754 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74726a0b-ba39-4094-ba83-a8027df3fef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:29.626445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74726a0b-ba39-4094-ba83-a8027df3fef7 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:29.626792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74726a0b-ba39-4094-ba83-a8027df3fef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:29.627075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74726a0b-ba39-4094-ba83-a8027df3fef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:29.627773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74726a0b-ba39-4094-ba83-a8027df3fef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:29.630774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74726a0b-ba39-4094-ba83-a8027df3fef7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:29.723384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 851/1696] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:29 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:29.725493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cfc0c-b4dd-404a-9800-e92689e6ee41 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:29.732233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-424cfc0c-b4dd-404a-9800-e92689e6ee41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:29.772203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 846/1697] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:29 2022] POST /identity/v3/projects => generated 355 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:10:29.775416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74726a0b-ba39-4094-ba83-a8027df3fef7 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:29.806679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424cfc0c-b4dd-404a-9800-e92689e6ee41 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:29.979184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74726a0b-ba39-4094-ba83-a8027df3fef7 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:29.988033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b294f-5f03-4e51-9b2f-8c8bce2676ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:29.988958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b294f-5f03-4e51-9b2f-8c8bce2676ba admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:29.992222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b294f-5f03-4e51-9b2f-8c8bce2676ba admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:29.992655 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b294f-5f03-4e51-9b2f-8c8bce2676ba admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:29.993657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b294f-5f03-4e51-9b2f-8c8bce2676ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:29.999336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b294f-5f03-4e51-9b2f-8c8bce2676ba admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:30.042946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8ea4a-036e-42db-9333-7222742f6149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:30.043718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8ea4a-036e-42db-9333-7222742f6149 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:30.044108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8ea4a-036e-42db-9333-7222742f6149 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:30.044390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8ea4a-036e-42db-9333-7222742f6149 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:30.045158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8ea4a-036e-42db-9333-7222742f6149 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:30.049523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a8ea4a-036e-42db-9333-7222742f6149 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:30.108622 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:30.119669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 847/1698] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:29 2022] POST /identity/v3/users => generated 278 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:30.122413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b294f-5f03-4e51-9b2f-8c8bce2676ba admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:30.157354 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b294f-5f03-4e51-9b2f-8c8bce2676ba admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:30.175561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51870deb-edd8-41bc-ae75-32ae65b10fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:30.178014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51870deb-edd8-41bc-ae75-32ae65b10fee admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:30.178488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51870deb-edd8-41bc-ae75-32ae65b10fee admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:30.178913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51870deb-edd8-41bc-ae75-32ae65b10fee admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:30.180097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51870deb-edd8-41bc-ae75-32ae65b10fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:30.188846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51870deb-edd8-41bc-ae75-32ae65b10fee admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:30.221681 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 848/1699] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:30.224599 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51870deb-edd8-41bc-ae75-32ae65b10fee admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:30.226596 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 852/1700] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:29 2022] POST /identity/v3/projects => generated 405 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:30.232822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8ea4a-036e-42db-9333-7222742f6149 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:30.244534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51870deb-edd8-41bc-ae75-32ae65b10fee admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:30.342664 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8ea4a-036e-42db-9333-7222742f6149 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:30.350592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc293932-8875-494f-bc50-39b67e04f38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:30.351655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc293932-8875-494f-bc50-39b67e04f38f admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:30.352422 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc293932-8875-494f-bc50-39b67e04f38f admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:30.358720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc293932-8875-494f-bc50-39b67e04f38f admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:30.358720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc293932-8875-494f-bc50-39b67e04f38f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:30.358720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc293932-8875-494f-bc50-39b67e04f38f admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:30.390493 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f932ea-0796-40b5-b9b6-3497d66b8af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:30.391317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f932ea-0796-40b5-b9b6-3497d66b8af7 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:30.391929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f932ea-0796-40b5-b9b6-3497d66b8af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:30.392321 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f932ea-0796-40b5-b9b6-3497d66b8af7 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:30.393267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f932ea-0796-40b5-b9b6-3497d66b8af7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:30.395052 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f932ea-0796-40b5-b9b6-3497d66b8af7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:30.411897 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 849/1701] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:30.420924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f932ea-0796-40b5-b9b6-3497d66b8af7 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:30.444429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:30.466747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f932ea-0796-40b5-b9b6-3497d66b8af7 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:30.482024 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afabae5-aa83-4cbb-8fde-c885b81aa540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:30.482254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 853/1702] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:30 2022] POST /identity/v3/users => generated 309 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:30.482347 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afabae5-aa83-4cbb-8fde-c885b81aa540 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:30.482347 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afabae5-aa83-4cbb-8fde-c885b81aa540 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:30.482347 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afabae5-aa83-4cbb-8fde-c885b81aa540 admin admin] PATH_INFO: `/v3/projects/d60215e6349a42639c092279ed73c2f2/users/3dc798b6d32147da958e9bfba8b222d4/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:30.482544 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df30c3-944f-4c95-8b21-a0e59d400588 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:30.482834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df30c3-944f-4c95-8b21-a0e59d400588 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:30.483033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46df30c3-944f-4c95-8b21-a0e59d400588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:30.528447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afabae5-aa83-4cbb-8fde-c885b81aa540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60215e6349a42639c092279ed73c2f2, user_id=3dc798b6d32147da958e9bfba8b222d4, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:30.535474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afabae5-aa83-4cbb-8fde-c885b81aa540 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:30.573922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-46df30c3-944f-4c95-8b21-a0e59d400588 None None] MFA Rules not processed for user `1d6b0c12ebad40eaafec09b662e228c4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:30.577704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-46df30c3-944f-4c95-8b21-a0e59d400588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:30.633699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 850/1703] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:30 2022] PUT /identity/v3/projects/d60215e6349a42639c092279ed73c2f2/users/3dc798b6d32147da958e9bfba8b222d4/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:30.633699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afabae5-aa83-4cbb-8fde-c885b81aa540 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:30.726334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 854/1704] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:30.727752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc15541-6372-45c6-9688-60f2a1f303b9 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:30.736119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc15541-6372-45c6-9688-60f2a1f303b9 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:30.736119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc15541-6372-45c6-9688-60f2a1f303b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:30.805636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-fcc15541-6372-45c6-9688-60f2a1f303b9 None None] MFA Rules not processed for user `3dc798b6d32147da958e9bfba8b222d4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:30.807126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-fcc15541-6372-45c6-9688-60f2a1f303b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:30.834786 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afabae5-aa83-4cbb-8fde-c885b81aa540 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:30.845382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd28e131-de45-4c95-a861-c0991281c8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:30.846082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28e131-de45-4c95-a861-c0991281c8f4 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:30.848546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28e131-de45-4c95-a861-c0991281c8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:30.850268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd28e131-de45-4c95-a861-c0991281c8f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:30.851098 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28e131-de45-4c95-a861-c0991281c8f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:30.855570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd28e131-de45-4c95-a861-c0991281c8f4 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:30.888862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 851/1705] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:30.890705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402210e8-464f-47e4-bc67-772a9f14c264 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:30.891042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402210e8-464f-47e4-bc67-772a9f14c264 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:30.891327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402210e8-464f-47e4-bc67-772a9f14c264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:30.957697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-402210e8-464f-47e4-bc67-772a9f14c264 None None] MFA Rules not processed for user `1d6b0c12ebad40eaafec09b662e228c4`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:30.959285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-402210e8-464f-47e4-bc67-772a9f14c264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:30.989128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 855/1706] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:30.998188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc15541-6372-45c6-9688-60f2a1f303b9 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:31.015383 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc15541-6372-45c6-9688-60f2a1f303b9 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:31.024135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe264e-7e30-4230-be41-93075dbc2f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:31.026465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe264e-7e30-4230-be41-93075dbc2f5b admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:31.027019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe264e-7e30-4230-be41-93075dbc2f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:31.027559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe264e-7e30-4230-be41-93075dbc2f5b admin admin] PATH_INFO: `/v3/projects/4da17e3b6e774672b649a1ce0bad8f52/users/37b9dc9efcf54e27b822462f04e4816b/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:31.082486 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe264e-7e30-4230-be41-93075dbc2f5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da17e3b6e774672b649a1ce0bad8f52, user_id=37b9dc9efcf54e27b822462f04e4816b, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:31.092899 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 852/1707] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:31.092899 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402210e8-464f-47e4-bc67-772a9f14c264 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:31.098932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe264e-7e30-4230-be41-93075dbc2f5b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:31.116447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402210e8-464f-47e4-bc67-772a9f14c264 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:31.123281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f505d-ddca-47f1-9b50-ce3d66a7c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:31.124175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f505d-ddca-47f1-9b50-ce3d66a7c318 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:31.124607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f505d-ddca-47f1-9b50-ce3d66a7c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:31.125032 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f505d-ddca-47f1-9b50-ce3d66a7c318 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:31.125965 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f505d-ddca-47f1-9b50-ce3d66a7c318 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:31.129226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f505d-ddca-47f1-9b50-ce3d66a7c318 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:31.185438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 856/1708] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:30 2022] PUT /identity/v3/projects/4da17e3b6e774672b649a1ce0bad8f52/users/37b9dc9efcf54e27b822462f04e4816b/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:31.186572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe264e-7e30-4230-be41-93075dbc2f5b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:31.190987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-94fe264e-7e30-4230-be41-93075dbc2f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:31.259262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 853/1709] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:31 2022] POST /identity/v3/projects => generated 355 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:31.260306 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f505d-ddca-47f1-9b50-ce3d66a7c318 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:31.265169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f27f505d-ddca-47f1-9b50-ce3d66a7c318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:31.366768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe264e-7e30-4230-be41-93075dbc2f5b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:31.491722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f505d-ddca-47f1-9b50-ce3d66a7c318 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:31.494026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21318-78f9-441a-95bb-6bbc6fa9fdad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:31.494941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21318-78f9-441a-95bb-6bbc6fa9fdad service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:31.495362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21318-78f9-441a-95bb-6bbc6fa9fdad service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:31.495743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad21318-78f9-441a-95bb-6bbc6fa9fdad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:31.501263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-7ad21318-78f9-441a-95bb-6bbc6fa9fdad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:31.509807 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf901fe5-5c9b-4def-9624-13f75aea4800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:31.510491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf901fe5-5c9b-4def-9624-13f75aea4800 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:31.510995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf901fe5-5c9b-4def-9624-13f75aea4800 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:31.511281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf901fe5-5c9b-4def-9624-13f75aea4800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:31.802313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21318-78f9-441a-95bb-6bbc6fa9fdad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:31.803906 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad21318-78f9-441a-95bb-6bbc6fa9fdad service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:31.808461 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf901fe5-5c9b-4def-9624-13f75aea4800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:31.810825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf901fe5-5c9b-4def-9624-13f75aea4800 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:31.833747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 854/1710] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:31.834434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf901fe5-5c9b-4def-9624-13f75aea4800 service nova] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:31.848435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 857/1711] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 662 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:31.861995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21318-78f9-441a-95bb-6bbc6fa9fdad service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:31.865609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-7ad21318-78f9-441a-95bb-6bbc6fa9fdad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:32.110483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf901fe5-5c9b-4def-9624-13f75aea4800 service nova] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:32.113244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad21318-78f9-441a-95bb-6bbc6fa9fdad service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:32.130968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:32.135590 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e6eca-7ac9-4253-90cf-e5adaac4073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:32.138011 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:32.144458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:32.144458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:32.144458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] PATH_INFO: `/v3/projects/8cf2a3ba25734ce6bd05cd236fc39f29` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:32.145222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e6eca-7ac9-4253-90cf-e5adaac4073e admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:32.145222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e6eca-7ac9-4253-90cf-e5adaac4073e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:32.145222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e6eca-7ac9-4253-90cf-e5adaac4073e admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:32.145222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e6eca-7ac9-4253-90cf-e5adaac4073e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:32.145548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8cf2a3ba25734ce6bd05cd236fc39f29)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:32.145636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e6eca-7ac9-4253-90cf-e5adaac4073e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:32.145718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:32.187020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 855/1712] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:32.188903 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e6eca-7ac9-4253-90cf-e5adaac4073e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:32.226742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e6eca-7ac9-4253-90cf-e5adaac4073e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:32.249547 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053d24-c03d-4f4e-826a-a188fee1ab18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:32.250643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053d24-c03d-4f4e-826a-a188fee1ab18 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:32.251985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053d24-c03d-4f4e-826a-a188fee1ab18 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:32.252280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39053d24-c03d-4f4e-826a-a188fee1ab18 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:32.253071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39053d24-c03d-4f4e-826a-a188fee1ab18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:32.255288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39053d24-c03d-4f4e-826a-a188fee1ab18 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:32.378727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8cf2a3ba25734ce6bd05cd236fc39f29', 'request_id': 'req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:32.400268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8cf2a3ba25734ce6bd05cd236fc39f29', 'request_id': 'req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:32.425096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8cf2a3ba25734ce6bd05cd236fc39f29', 'request_id': 'req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:32.471386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 856/1713] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:32 2022] POST /identity/v3/users => generated 284 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:32.474819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053d24-c03d-4f4e-826a-a188fee1ab18 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:32.503586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39053d24-c03d-4f4e-826a-a188fee1ab18 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:32.559646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] The token cache is being invalidate because project 8cf2a3ba25734ce6bd05cd236fc39f29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:32.559646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:32.559646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:32.559646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 858/1714] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:31 2022] DELETE /identity/v3/projects/8cf2a3ba25734ce6bd05cd236fc39f29 => generated 0 bytes in 708 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:32.559646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:32.565106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:32.587333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:32.722674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aebe6a-189e-41ec-9869-5fcb1060e559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:32.724297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aebe6a-189e-41ec-9869-5fcb1060e559 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:32.724739 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aebe6a-189e-41ec-9869-5fcb1060e559 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:32.725162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aebe6a-189e-41ec-9869-5fcb1060e559 admin admin] PATH_INFO: `/v3/projects/4da17e3b6e774672b649a1ce0bad8f52/users/37b9dc9efcf54e27b822462f04e4816b/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:32.727724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aebe6a-189e-41ec-9869-5fcb1060e559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4da17e3b6e774672b649a1ce0bad8f52, user_id=37b9dc9efcf54e27b822462f04e4816b, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:32.731417 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5aebe6a-189e-41ec-9869-5fcb1060e559 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:32.747149 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 857/1715] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:32 2022] PUT /identity/v3/projects/4da17e3b6e774672b649a1ce0bad8f52/users/37b9dc9efcf54e27b822462f04e4816b/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:32.748402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aebe6a-189e-41ec-9869-5fcb1060e559 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:32.750695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b5aebe6a-189e-41ec-9869-5fcb1060e559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:32.827900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b96ca9a-2e6b-408a-ba0d-1a70ff3e359f admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:32.967433 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aebe6a-189e-41ec-9869-5fcb1060e559 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:32.980434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b90ffc6-b266-4c21-a793-4ca05ac55432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:32.982260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90ffc6-b266-4c21-a793-4ca05ac55432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:32.982656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90ffc6-b266-4c21-a793-4ca05ac55432 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:32.983052 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b90ffc6-b266-4c21-a793-4ca05ac55432 admin admin] PATH_INFO: `/v3/users/38a9ae890e804e3690c7ad9340f23b2e` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:32.989370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90ffc6-b266-4c21-a793-4ca05ac55432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38a9ae890e804e3690c7ad9340f23b2e)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:33.000607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b90ffc6-b266-4c21-a793-4ca05ac55432 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:33.030962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b8b975-6070-448d-b63f-35e4041fb734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:33.032898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8b975-6070-448d-b63f-35e4041fb734 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:33.038251 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8b975-6070-448d-b63f-35e4041fb734 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:33.039761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b8b975-6070-448d-b63f-35e4041fb734 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:33.040714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8b975-6070-448d-b63f-35e4041fb734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:33.042753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b8b975-6070-448d-b63f-35e4041fb734 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:33.068106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 859/1716] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:32 2022] GET /identity/v3/roles => generated 1420 bytes in 509 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:33.069685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967c4ea-2608-449b-8b97-10ab0731e1ba None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:33.070220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967c4ea-2608-449b-8b97-10ab0731e1ba None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:33.070607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967c4ea-2608-449b-8b97-10ab0731e1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:33.104271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-c967c4ea-2608-449b-8b97-10ab0731e1ba None None] MFA Rules not processed for user `6617f968cd214435a1efcb401ba33e38`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:33.106270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c967c4ea-2608-449b-8b97-10ab0731e1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:33.244382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 860/1717] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:33.247223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611222f-a3d2-4c2a-964e-96d42225a514 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:33.247561 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611222f-a3d2-4c2a-964e-96d42225a514 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:33.247908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611222f-a3d2-4c2a-964e-96d42225a514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:33.289536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-3b90ffc6-b266-4c21-a793-4ca05ac55432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38a9ae890e804e3690c7ad9340f23b2e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:33.291394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-3b90ffc6-b266-4c21-a793-4ca05ac55432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38a9ae890e804e3690c7ad9340f23b2e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:33.292438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-3b90ffc6-b266-4c21-a793-4ca05ac55432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38a9ae890e804e3690c7ad9340f23b2e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:33.295207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-d611222f-a3d2-4c2a-964e-96d42225a514 None None] MFA Rules not processed for user `37b9dc9efcf54e27b822462f04e4816b`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:33.296677 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d611222f-a3d2-4c2a-964e-96d42225a514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:33.427124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 861/1718] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:33.428776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611222f-a3d2-4c2a-964e-96d42225a514 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:33.447039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-3b90ffc6-b266-4c21-a793-4ca05ac55432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38a9ae890e804e3690c7ad9340f23b2e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:33.454100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d611222f-a3d2-4c2a-964e-96d42225a514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:33.461430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-3b90ffc6-b266-4c21-a793-4ca05ac55432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38a9ae890e804e3690c7ad9340f23b2e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:33.504859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611222f-a3d2-4c2a-964e-96d42225a514 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:33.510798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 858/1719] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:32 2022] DELETE /identity/v3/users/38a9ae890e804e3690c7ad9340f23b2e => generated 0 bytes in 763 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:33.524542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d07f20-b334-446c-b7f2-f3fb6263ec49 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:33.539990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a88c6d-1f4f-4f8c-9937-e47fc0ab9188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:33.540602 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d07f20-b334-446c-b7f2-f3fb6263ec49 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:33.548176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a88c6d-1f4f-4f8c-9937-e47fc0ab9188 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:33.549251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d07f20-b334-446c-b7f2-f3fb6263ec49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:33.552316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a88c6d-1f4f-4f8c-9937-e47fc0ab9188 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:33.552527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a88c6d-1f4f-4f8c-9937-e47fc0ab9188 admin admin] PATH_INFO: `/v3/projects/588b97e95f684291905e08895ddb6236/users/2d78300e59a6445097f8dded37326bee/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:33.616821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a88c6d-1f4f-4f8c-9937-e47fc0ab9188 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588b97e95f684291905e08895ddb6236, user_id=2d78300e59a6445097f8dded37326bee, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:33.626618 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a88c6d-1f4f-4f8c-9937-e47fc0ab9188 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:33.642626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-66d07f20-b334-446c-b7f2-f3fb6263ec49 None None] MFA Rules not processed for user `54404c13a1cf4d4eab0082fbfdd2bc58`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:33.644129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-66d07f20-b334-446c-b7f2-f3fb6263ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:33.754229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 862/1720] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:33 2022] PUT /identity/v3/projects/588b97e95f684291905e08895ddb6236/users/2d78300e59a6445097f8dded37326bee/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:33.755443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a88c6d-1f4f-4f8c-9937-e47fc0ab9188 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:33.762219 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-15a88c6d-1f4f-4f8c-9937-e47fc0ab9188 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:33.840548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 859/1721] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:33.842681 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d07f20-b334-446c-b7f2-f3fb6263ec49 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:33.844355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-66d07f20-b334-446c-b7f2-f3fb6263ec49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:33.977722 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a88c6d-1f4f-4f8c-9937-e47fc0ab9188 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:34.004651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d344287-0f2f-40d3-8e9a-e34c1d46579f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:34.005253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d344287-0f2f-40d3-8e9a-e34c1d46579f service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:34.005537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d344287-0f2f-40d3-8e9a-e34c1d46579f service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:34.006879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d344287-0f2f-40d3-8e9a-e34c1d46579f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:34.010724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6d344287-0f2f-40d3-8e9a-e34c1d46579f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:34.013694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d07f20-b334-446c-b7f2-f3fb6263ec49 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:34.115118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e62be7-6d4e-4fb9-a323-f6350b1f57d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:34.117577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e62be7-6d4e-4fb9-a323-f6350b1f57d9 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:34.118081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e62be7-6d4e-4fb9-a323-f6350b1f57d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:34.118556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e62be7-6d4e-4fb9-a323-f6350b1f57d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:34.189819 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d344287-0f2f-40d3-8e9a-e34c1d46579f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:34.196555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d344287-0f2f-40d3-8e9a-e34c1d46579f service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:34.219423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 863/1722] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:34.222841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d344287-0f2f-40d3-8e9a-e34c1d46579f service nova] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:34.310321 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e62be7-6d4e-4fb9-a323-f6350b1f57d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:34.311875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e62be7-6d4e-4fb9-a323-f6350b1f57d9 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:34.345731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 860/1723] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:33 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:34.348003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4606f-52ad-478d-b89b-e5e726dd977c None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:34.348295 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4606f-52ad-478d-b89b-e5e726dd977c None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:34.348565 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b4606f-52ad-478d-b89b-e5e726dd977c None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:34.355244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 861/1724] 10.222.0.52 () {54 vars in 912 bytes} [Thu Jun 23 11:10:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:10:34.357893 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63f755-9e8b-4956-a0f1-af582f5349d9 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:34.359850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63f755-9e8b-4956-a0f1-af582f5349d9 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:34.360184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63f755-9e8b-4956-a0f1-af582f5349d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:34.390258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d344287-0f2f-40d3-8e9a-e34c1d46579f service nova] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:34.397689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9bb386-c0cb-4f01-bf4f-c24aa7d4af11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:34.398433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bb386-c0cb-4f01-bf4f-c24aa7d4af11 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:34.398717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bb386-c0cb-4f01-bf4f-c24aa7d4af11 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:34.398990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9bb386-c0cb-4f01-bf4f-c24aa7d4af11 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:34.399843 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bb386-c0cb-4f01-bf4f-c24aa7d4af11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:34.402710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9bb386-c0cb-4f01-bf4f-c24aa7d4af11 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:34.417553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 864/1725] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:34.419577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e3aa0-6c47-4402-bd60-fbca5088cde0 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:34.419909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e3aa0-6c47-4402-bd60-fbca5088cde0 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:34.421383 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e3aa0-6c47-4402-bd60-fbca5088cde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:34.426460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:34.481168 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-3f63f755-9e8b-4956-a0f1-af582f5349d9 None None] MFA Rules not processed for user `9b9874ab7e7443db81dfde42b37d363f`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:34.482711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3f63f755-9e8b-4956-a0f1-af582f5349d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:34.541884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-9d2e3aa0-6c47-4402-bd60-fbca5088cde0 None None] MFA Rules not processed for user `2d903a8e2ce4489fa7f5b7479ff0b7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:34.548060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-9d2e3aa0-6c47-4402-bd60-fbca5088cde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:34.685138 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 862/1726] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:34.688015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63f755-9e8b-4956-a0f1-af582f5349d9 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:34.709484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 865/1727] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:10:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:34.709484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e3aa0-6c47-4402-bd60-fbca5088cde0 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:34.710808 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-9d2e3aa0-6c47-4402-bd60-fbca5088cde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:34.721232 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63f755-9e8b-4956-a0f1-af582f5349d9 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:34.727053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e3aa0-6c47-4402-bd60-fbca5088cde0 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:34.732737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc293-1a1c-423f-bb35-18779acbb068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:34.732895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:34.733717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:34.734013 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:34.734171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc293-1a1c-423f-bb35-18779acbb068 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:34.734286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] PATH_INFO: `/v3/projects/1988264328454af19a93597004d0c403` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:34.734703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc293-1a1c-423f-bb35-18779acbb068 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:34.735582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1988264328454af19a93597004d0c403)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:34.735969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc293-1a1c-423f-bb35-18779acbb068 admin admin] PATH_INFO: `/v3/projects/588b97e95f684291905e08895ddb6236/users/2d78300e59a6445097f8dded37326bee/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:34.737792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:34.740594 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fc293-1a1c-423f-bb35-18779acbb068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588b97e95f684291905e08895ddb6236, user_id=2d78300e59a6445097f8dded37326bee, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:34.744525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fc293-1a1c-423f-bb35-18779acbb068 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:34.781508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 863/1728] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:34 2022] PUT /identity/v3/projects/588b97e95f684291905e08895ddb6236/users/2d78300e59a6445097f8dded37326bee/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:34.798171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:34.798171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc293-1a1c-423f-bb35-18779acbb068 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:34.798171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-4b6fc293-1a1c-423f-bb35-18779acbb068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:34.909498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc293-1a1c-423f-bb35-18779acbb068 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:34.934512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:34.935411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:34.935696 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:34.936000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] PATH_INFO: `/v3/users/4876bcdd2d414d01a88c3ce3f43e0faa` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:34.940617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4876bcdd2d414d01a88c3ce3f43e0faa)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:34.942572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:34.952103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1988264328454af19a93597004d0c403', 'request_id': 'req-55abb7c5-b4a4-4495-b729-2c6890a62b51'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:34.971002 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1988264328454af19a93597004d0c403', 'request_id': 'req-55abb7c5-b4a4-4495-b729-2c6890a62b51'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:34.985710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1988264328454af19a93597004d0c403', 'request_id': 'req-55abb7c5-b4a4-4495-b729-2c6890a62b51'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:35.092844 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] The token cache is being invalidate because project 1988264328454af19a93597004d0c403 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:35.093577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:35.094756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:35.097347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 866/1729] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:34 2022] DELETE /identity/v3/projects/1988264328454af19a93597004d0c403 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:35.098414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:35.100372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:35.264054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55abb7c5-b4a4-4495-b729-2c6890a62b51 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:35.266164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4876bcdd2d414d01a88c3ce3f43e0faa'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:35.267030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4876bcdd2d414d01a88c3ce3f43e0faa'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:35.268684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4876bcdd2d414d01a88c3ce3f43e0faa'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:35.273192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78a163f-7fa0-4982-907c-073319cc6caa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:35.276087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a163f-7fa0-4982-907c-073319cc6caa service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:35.276087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a163f-7fa0-4982-907c-073319cc6caa service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:35.276087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78a163f-7fa0-4982-907c-073319cc6caa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:35.278944 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b78a163f-7fa0-4982-907c-073319cc6caa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:35.376213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a163f-7fa0-4982-907c-073319cc6caa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:35.376919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4876bcdd2d414d01a88c3ce3f43e0faa'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:35.378669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78a163f-7fa0-4982-907c-073319cc6caa service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:35.391202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4876bcdd2d414d01a88c3ce3f43e0faa'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:35.392202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 867/1730] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:35 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:35.393538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b14653-910a-453a-be9b-f017096728f0 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:35.393821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b14653-910a-453a-be9b-f017096728f0 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:35.394096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b14653-910a-453a-be9b-f017096728f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:35.414427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-48b14653-910a-453a-be9b-f017096728f0 None None] MFA Rules not processed for user `9b9874ab7e7443db81dfde42b37d363f`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:35.415701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-48b14653-910a-453a-be9b-f017096728f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:35.447389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 864/1731] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:34 2022] DELETE /identity/v3/users/4876bcdd2d414d01a88c3ce3f43e0faa => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:35.448872 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:35.464708 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:35.587888 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0fa305-be80-4122-8c34-8937e755f304 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:35.599629 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438e490-39b0-4ece-a61e-fcb2d389cacb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:35.600438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e490-39b0-4ece-a61e-fcb2d389cacb service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:35.600838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e490-39b0-4ece-a61e-fcb2d389cacb service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:35.602016 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438e490-39b0-4ece-a61e-fcb2d389cacb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:35.604819 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 868/1732] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:35.610601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-6438e490-39b0-4ece-a61e-fcb2d389cacb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:35.615407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bb4dd-7193-4768-87b5-8368293682f4 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:35.615407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bb4dd-7193-4768-87b5-8368293682f4 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:35.615407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5bb4dd-7193-4768-87b5-8368293682f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:35.627102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438e490-39b0-4ece-a61e-fcb2d389cacb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:35.628612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438e490-39b0-4ece-a61e-fcb2d389cacb service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:35.641254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 865/1733] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:35.644182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6903c-069c-40d6-9223-70182fa835a0 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:35.644840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6903c-069c-40d6-9223-70182fa835a0 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:35.645341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b6903c-069c-40d6-9223-70182fa835a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:35.673820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4e5bb4dd-7193-4768-87b5-8368293682f4 None None] MFA Rules not processed for user `2d78300e59a6445097f8dded37326bee`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:35.674930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4e5bb4dd-7193-4768-87b5-8368293682f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:35.723130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-27b6903c-069c-40d6-9223-70182fa835a0 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:35.729661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-27b6903c-069c-40d6-9223-70182fa835a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:35.817731 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 869/1734] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:35 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:35.820916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32977a-3bbe-4f01-a400-6ca31809deb3 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:35.821271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32977a-3bbe-4f01-a400-6ca31809deb3 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:35.821560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e32977a-3bbe-4f01-a400-6ca31809deb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:35.850266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-0e32977a-3bbe-4f01-a400-6ca31809deb3 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:35.850789 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0e32977a-3bbe-4f01-a400-6ca31809deb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:35.883536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 866/1735] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:35.886384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6903c-069c-40d6-9223-70182fa835a0 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:35.889129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-27b6903c-069c-40d6-9223-70182fa835a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:35.972688 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 870/1736] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:35.974169 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32977a-3bbe-4f01-a400-6ca31809deb3 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:35.975960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0e32977a-3bbe-4f01-a400-6ca31809deb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:36.029228 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b6903c-069c-40d6-9223-70182fa835a0 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:36.037396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ef6a8-fe13-4273-b189-75d9ad0b3edf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:36.052268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef6a8-fe13-4273-b189-75d9ad0b3edf service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:36.052638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef6a8-fe13-4273-b189-75d9ad0b3edf service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:36.053187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ef6a8-fe13-4273-b189-75d9ad0b3edf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:36.055957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-209ef6a8-fe13-4273-b189-75d9ad0b3edf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:36.080681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e32977a-3bbe-4f01-a400-6ca31809deb3 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:36.091771 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538a61b-2c5b-44f9-bab8-2b2d1c53dfdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:36.092679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538a61b-2c5b-44f9-bab8-2b2d1c53dfdd service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:36.092965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538a61b-2c5b-44f9-bab8-2b2d1c53dfdd service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:36.093270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538a61b-2c5b-44f9-bab8-2b2d1c53dfdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:36.116566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538a61b-2c5b-44f9-bab8-2b2d1c53dfdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:36.122306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538a61b-2c5b-44f9-bab8-2b2d1c53dfdd service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:36.170444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 871/1737] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:35 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:36.178984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d32b2a-941d-401d-b5f1-73b65dd1bd05 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:36.181523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d32b2a-941d-401d-b5f1-73b65dd1bd05 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:36.182034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d32b2a-941d-401d-b5f1-73b65dd1bd05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:36.259392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-d5d32b2a-941d-401d-b5f1-73b65dd1bd05 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:36.260935 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d5d32b2a-941d-401d-b5f1-73b65dd1bd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:36.289899 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ef6a8-fe13-4273-b189-75d9ad0b3edf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:36.295202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ef6a8-fe13-4273-b189-75d9ad0b3edf service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:36.310094 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 872/1738] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:36.310812 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d32b2a-941d-401d-b5f1-73b65dd1bd05 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:36.316319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d5d32b2a-941d-401d-b5f1-73b65dd1bd05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:36.378960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d32b2a-941d-401d-b5f1-73b65dd1bd05 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:36.379384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 867/1739] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:36.383519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ef6a8-fe13-4273-b189-75d9ad0b3edf service nova] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:36.397414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f5e83-56f8-48dc-a39b-0d8e1f7de81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:36.397414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f5e83-56f8-48dc-a39b-0d8e1f7de81d service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:36.397414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f5e83-56f8-48dc-a39b-0d8e1f7de81d service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:36.397414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8f5e83-56f8-48dc-a39b-0d8e1f7de81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:36.420411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ef6a8-fe13-4273-b189-75d9ad0b3edf service nova] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:36.449214 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f5e83-56f8-48dc-a39b-0d8e1f7de81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:36.450270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be0bbb-3dce-464d-aac7-b11586c233f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:36.455500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8f5e83-56f8-48dc-a39b-0d8e1f7de81d service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:36.455790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be0bbb-3dce-464d-aac7-b11586c233f6 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:36.457260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be0bbb-3dce-464d-aac7-b11586c233f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:36.458644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be0bbb-3dce-464d-aac7-b11586c233f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:36.462937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be0bbb-3dce-464d-aac7-b11586c233f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:36.463484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be0bbb-3dce-464d-aac7-b11586c233f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:36.473254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be0bbb-3dce-464d-aac7-b11586c233f6 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:36.499670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 873/1740] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:36.540800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 868/1741] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:36.545713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f5e83-56f8-48dc-a39b-0d8e1f7de81d service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:36.569424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8f5e83-56f8-48dc-a39b-0d8e1f7de81d service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:36.605535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be0bbb-3dce-464d-aac7-b11586c233f6 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:36.615002 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42865398-53b9-450b-8ffd-9b3cf3bc0483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:36.615773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42865398-53b9-450b-8ffd-9b3cf3bc0483 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:36.616096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42865398-53b9-450b-8ffd-9b3cf3bc0483 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:36.616370 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42865398-53b9-450b-8ffd-9b3cf3bc0483 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:36.617600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be0bbb-3dce-464d-aac7-b11586c233f6 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:36.618792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42865398-53b9-450b-8ffd-9b3cf3bc0483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:36.621408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42865398-53b9-450b-8ffd-9b3cf3bc0483 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:36.623568 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b62654-32ef-496f-a2d6-362e0f2b46b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:36.624457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b62654-32ef-496f-a2d6-362e0f2b46b8 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:36.624973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b62654-32ef-496f-a2d6-362e0f2b46b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:36.626460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b62654-32ef-496f-a2d6-362e0f2b46b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:36.629914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-27b62654-32ef-496f-a2d6-362e0f2b46b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:36.746899 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b62654-32ef-496f-a2d6-362e0f2b46b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:36.749303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b62654-32ef-496f-a2d6-362e0f2b46b8 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:36.779520 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 869/1742] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:36 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:36.799067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 874/1743] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:36 2022] POST /identity/v3/projects => generated 375 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:36.803006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b62654-32ef-496f-a2d6-362e0f2b46b8 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:36.844758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b62654-32ef-496f-a2d6-362e0f2b46b8 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:36.867006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:37.003529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddaeb3-0c6f-4525-8629-c45470a11574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:37.005321 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddaeb3-0c6f-4525-8629-c45470a11574 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:37.005922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddaeb3-0c6f-4525-8629-c45470a11574 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:37.006496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ddaeb3-0c6f-4525-8629-c45470a11574 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:37.007572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddaeb3-0c6f-4525-8629-c45470a11574 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:37.009922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ddaeb3-0c6f-4525-8629-c45470a11574 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:37.022872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633d18-49d3-4c79-b5f8-969762dba085 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:37.023165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633d18-49d3-4c79-b5f8-969762dba085 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:37.023471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e633d18-49d3-4c79-b5f8-969762dba085 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:37.026498 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 875/1744] 10.222.0.52 () {54 vars in 912 bytes} [Thu Jun 23 11:10:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:10:37.031641 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0973a86-42f6-4e1c-8e59-b53a2ae58bd7 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:37.031962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0973a86-42f6-4e1c-8e59-b53a2ae58bd7 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:37.034006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0973a86-42f6-4e1c-8e59-b53a2ae58bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:37.111930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-a0973a86-42f6-4e1c-8e59-b53a2ae58bd7 None None] MFA Rules not processed for user `2d903a8e2ce4489fa7f5b7479ff0b7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:37.113887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a0973a86-42f6-4e1c-8e59-b53a2ae58bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:37.229072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 870/1745] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:36 2022] POST /identity/v3/users => generated 288 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:37.230566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddaeb3-0c6f-4525-8629-c45470a11574 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:37.242162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ddaeb3-0c6f-4525-8629-c45470a11574 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:37.249464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cd3dd-21b3-47e1-92be-a91679769b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:37.251501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cd3dd-21b3-47e1-92be-a91679769b6f admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:37.251501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cd3dd-21b3-47e1-92be-a91679769b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:37.251501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cd3dd-21b3-47e1-92be-a91679769b6f admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:37.252070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cd3dd-21b3-47e1-92be-a91679769b6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:37.254096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cd3dd-21b3-47e1-92be-a91679769b6f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:37.267833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 876/1746] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 23 11:10:37.277995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 871/1747] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:37.283953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0973a86-42f6-4e1c-8e59-b53a2ae58bd7 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:37.314666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cd3dd-21b3-47e1-92be-a91679769b6f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:37.333282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cd3dd-21b3-47e1-92be-a91679769b6f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:37.341009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e08925-3388-4795-aa87-31f083902eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:37.345408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08925-3388-4795-aa87-31f083902eac service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:37.345780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08925-3388-4795-aa87-31f083902eac service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:37.346133 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e08925-3388-4795-aa87-31f083902eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:37.346262 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0973a86-42f6-4e1c-8e59-b53a2ae58bd7 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:37.370508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e08925-3388-4795-aa87-31f083902eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:37.376490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e08925-3388-4795-aa87-31f083902eac service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:37.378098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435ae6e-243a-418c-ae87-36d557689a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:37.378798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435ae6e-243a-418c-ae87-36d557689a9b admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:37.379082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435ae6e-243a-418c-ae87-36d557689a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:37.379601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7435ae6e-243a-418c-ae87-36d557689a9b admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:37.380138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435ae6e-243a-418c-ae87-36d557689a9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:37.381814 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7435ae6e-243a-418c-ae87-36d557689a9b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:37.414482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 872/1748] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:10:37.423001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430fcf7-b8f6-42b9-8bd0-892dd2f64203 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:37.424525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430fcf7-b8f6-42b9-8bd0-892dd2f64203 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:37.425905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e430fcf7-b8f6-42b9-8bd0-892dd2f64203 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:37.430868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 873/1749] 10.222.0.52 () {54 vars in 960 bytes} [Thu Jun 23 11:10:37 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:10:37.436014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7784a9b-dd09-421a-9dcc-1d2030eea116 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:37.436315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7784a9b-dd09-421a-9dcc-1d2030eea116 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:37.436602 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7784a9b-dd09-421a-9dcc-1d2030eea116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:37.445548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 877/1750] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:37 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:10:37.457343 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435ae6e-243a-418c-ae87-36d557689a9b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:37.470105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-f7784a9b-dd09-421a-9dcc-1d2030eea116 None None] MFA Rules not processed for user `e838dd9aa24f4571b64719125610c528`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:37.471674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f7784a9b-dd09-421a-9dcc-1d2030eea116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:37.474177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7435ae6e-243a-418c-ae87-36d557689a9b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:37.492059 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa808c-b80a-497e-8c54-a31a22e73e41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:37.492972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa808c-b80a-497e-8c54-a31a22e73e41 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:37.493259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa808c-b80a-497e-8c54-a31a22e73e41 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:37.493540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa808c-b80a-497e-8c54-a31a22e73e41 admin admin] PATH_INFO: `/v3/projects/6294c1793dcc46418a8d08ef77862cb7/users/63443afbae8e4d4c9e9187ef17bd6591/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:37.518278 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa808c-b80a-497e-8c54-a31a22e73e41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6294c1793dcc46418a8d08ef77862cb7, user_id=63443afbae8e4d4c9e9187ef17bd6591, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:37.521375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77aa808c-b80a-497e-8c54-a31a22e73e41 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:37.606103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 874/1751] 10.222.0.52 () {58 vars in 1057 bytes} [Thu Jun 23 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:10:37.624671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7784a9b-dd09-421a-9dcc-1d2030eea116 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:37.638878 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7784a9b-dd09-421a-9dcc-1d2030eea116 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:37.653994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032a163-8399-4450-81e9-c03b8a7ba66b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e838dd9aa24f4571b64719125610c528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:37.654664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032a163-8399-4450-81e9-c03b8a7ba66b service placement] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:37.654953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032a163-8399-4450-81e9-c03b8a7ba66b service placement] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:37.655236 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032a163-8399-4450-81e9-c03b8a7ba66b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:37.665634 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a032a163-8399-4450-81e9-c03b8a7ba66b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:37.666778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:37.672655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 878/1752] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:37 2022] PUT /identity/v3/projects/6294c1793dcc46418a8d08ef77862cb7/users/63443afbae8e4d4c9e9187ef17bd6591/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:37.684613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298aa68-cb4f-49c1-a7c9-8db466cd30a6 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:37.685676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298aa68-cb4f-49c1-a7c9-8db466cd30a6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:37.686775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298aa68-cb4f-49c1-a7c9-8db466cd30a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:37.710262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032a163-8399-4450-81e9-c03b8a7ba66b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:37.711938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032a163-8399-4450-81e9-c03b8a7ba66b service placement] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:37.765886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-0298aa68-cb4f-49c1-a7c9-8db466cd30a6 None None] MFA Rules not processed for user `63443afbae8e4d4c9e9187ef17bd6591`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:37.766525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 875/1753] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:37.770087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0298aa68-cb4f-49c1-a7c9-8db466cd30a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:37.773809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611a42-9067-4ab0-8da1-8d368f5ad486 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:37.774109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611a42-9067-4ab0-8da1-8d368f5ad486 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:37.774399 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01611a42-9067-4ab0-8da1-8d368f5ad486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:37.844219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-01611a42-9067-4ab0-8da1-8d368f5ad486 None None] MFA Rules not processed for user `1d6b0c12ebad40eaafec09b662e228c4`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:37.845533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-01611a42-9067-4ab0-8da1-8d368f5ad486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:37.920450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 879/1754] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:37.924659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298aa68-cb4f-49c1-a7c9-8db466cd30a6 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:38.023943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 876/1755] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:38.086230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298aa68-cb4f-49c1-a7c9-8db466cd30a6 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:38.095403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34212c99-3cb6-4d5a-beac-f9c0938ed9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:38.096598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212c99-3cb6-4d5a-beac-f9c0938ed9d6 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:38.096922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212c99-3cb6-4d5a-beac-f9c0938ed9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:38.097204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34212c99-3cb6-4d5a-beac-f9c0938ed9d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:38.098013 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34212c99-3cb6-4d5a-beac-f9c0938ed9d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:38.100056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34212c99-3cb6-4d5a-beac-f9c0938ed9d6 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:38.309530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 880/1756] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:37 2022] POST /identity/v3/projects => generated 377 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:10:38.314006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611a42-9067-4ab0-8da1-8d368f5ad486 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:38.340392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01611a42-9067-4ab0-8da1-8d368f5ad486 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:38.543445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca0ecd-5782-4b7e-8bad-db5ecb3f2a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:38.544159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca0ecd-5782-4b7e-8bad-db5ecb3f2a00 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:38.544449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca0ecd-5782-4b7e-8bad-db5ecb3f2a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:38.544731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca0ecd-5782-4b7e-8bad-db5ecb3f2a00 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:38.550373 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca0ecd-5782-4b7e-8bad-db5ecb3f2a00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:38.552439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca0ecd-5782-4b7e-8bad-db5ecb3f2a00 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:38.673084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34212c99-3cb6-4d5a-beac-f9c0938ed9d6 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:38.675712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-34212c99-3cb6-4d5a-beac-f9c0938ed9d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:38.693121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 877/1757] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:38 2022] POST /identity/v3/users => generated 295 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:38.696829 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca0ecd-5782-4b7e-8bad-db5ecb3f2a00 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:38.699067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34212c99-3cb6-4d5a-beac-f9c0938ed9d6 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:38.705399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55179e92-a73f-4746-b816-2abce47ceab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:38.706545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55179e92-a73f-4746-b816-2abce47ceab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:38.707049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55179e92-a73f-4746-b816-2abce47ceab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:38.707488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55179e92-a73f-4746-b816-2abce47ceab6 admin admin] PATH_INFO: `/v3/users/18a7f1cc11864ac1b77dcb771e51c479` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:38.709079 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55179e92-a73f-4746-b816-2abce47ceab6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18a7f1cc11864ac1b77dcb771e51c479)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:38.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: WARNING py.warnings [None req-55179e92-a73f-4746-b816-2abce47ceab6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:10:38.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: warnings.warn(msg) Jun 23 11:10:38.710607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: Jun 23 11:10:38.712356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55179e92-a73f-4746-b816-2abce47ceab6 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:38.734618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca0ecd-5782-4b7e-8bad-db5ecb3f2a00 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:38.753314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5111e1-c376-4dff-b54b-a6ca00e9df87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:38.754194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5111e1-c376-4dff-b54b-a6ca00e9df87 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:38.754523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5111e1-c376-4dff-b54b-a6ca00e9df87 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:38.754881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5111e1-c376-4dff-b54b-a6ca00e9df87 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:38.755785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5111e1-c376-4dff-b54b-a6ca00e9df87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:38.757736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5111e1-c376-4dff-b54b-a6ca00e9df87 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:38.794522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 878/1758] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:38.802642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5111e1-c376-4dff-b54b-a6ca00e9df87 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:38.874495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5111e1-c376-4dff-b54b-a6ca00e9df87 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:38.912814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661143a6-d2ec-48ec-9d8f-47531af3ea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:38.913753 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661143a6-d2ec-48ec-9d8f-47531af3ea2e admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:38.914036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661143a6-d2ec-48ec-9d8f-47531af3ea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:38.914317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661143a6-d2ec-48ec-9d8f-47531af3ea2e admin admin] PATH_INFO: `/v3/projects/0e63d8b6d8a4424cb5b669a0fa3798f0/users/f344ee0f477f4e56b4fdf1974540c36e/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:38.969148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661143a6-d2ec-48ec-9d8f-47531af3ea2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e63d8b6d8a4424cb5b669a0fa3798f0, user_id=f344ee0f477f4e56b4fdf1974540c36e, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:38.972065 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661143a6-d2ec-48ec-9d8f-47531af3ea2e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:39.026368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-55179e92-a73f-4746-b816-2abce47ceab6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18a7f1cc11864ac1b77dcb771e51c479'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:39.102102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-55179e92-a73f-4746-b816-2abce47ceab6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18a7f1cc11864ac1b77dcb771e51c479'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:39.105023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-55179e92-a73f-4746-b816-2abce47ceab6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18a7f1cc11864ac1b77dcb771e51c479'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:39.105023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-55179e92-a73f-4746-b816-2abce47ceab6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18a7f1cc11864ac1b77dcb771e51c479'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:39.121707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 879/1759] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:38 2022] PUT /identity/v3/projects/0e63d8b6d8a4424cb5b669a0fa3798f0/users/f344ee0f477f4e56b4fdf1974540c36e/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:39.124601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661143a6-d2ec-48ec-9d8f-47531af3ea2e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:39.129400 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-661143a6-d2ec-48ec-9d8f-47531af3ea2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:39.280726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661143a6-d2ec-48ec-9d8f-47531af3ea2e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:39.288305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed9b79-f648-45a2-beb6-dbe47d69de94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:39.289228 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed9b79-f648-45a2-beb6-dbe47d69de94 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:39.289512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed9b79-f648-45a2-beb6-dbe47d69de94 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:39.289799 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aed9b79-f648-45a2-beb6-dbe47d69de94 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:39.290601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed9b79-f648-45a2-beb6-dbe47d69de94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:39.292464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aed9b79-f648-45a2-beb6-dbe47d69de94 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:39.306654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-55179e92-a73f-4746-b816-2abce47ceab6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18a7f1cc11864ac1b77dcb771e51c479'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:39.313765 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 880/1760] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:39.319202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed9b79-f648-45a2-beb6-dbe47d69de94 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:39.330900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aed9b79-f648-45a2-beb6-dbe47d69de94 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:39.337312 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caca205-73c0-46ae-adb7-134791db979e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:39.346655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 881/1761] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:38 2022] DELETE /identity/v3/users/18a7f1cc11864ac1b77dcb771e51c479 => generated 0 bytes in 674 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:39.348129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caca205-73c0-46ae-adb7-134791db979e admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:39.348422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caca205-73c0-46ae-adb7-134791db979e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:39.348932 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caca205-73c0-46ae-adb7-134791db979e admin admin] PATH_INFO: `/v3/projects/0e63d8b6d8a4424cb5b669a0fa3798f0/users/f344ee0f477f4e56b4fdf1974540c36e/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:39.355762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caca205-73c0-46ae-adb7-134791db979e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e63d8b6d8a4424cb5b669a0fa3798f0, user_id=f344ee0f477f4e56b4fdf1974540c36e, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:39.356523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d54c-fc58-4a06-bea9-7c5a1f22d77a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:39.357500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d54c-fc58-4a06-bea9-7c5a1f22d77a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:39.358255 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a5d54c-fc58-4a06-bea9-7c5a1f22d77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:39.359006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caca205-73c0-46ae-adb7-134791db979e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:39.411977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 881/1762] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:39 2022] PUT /identity/v3/projects/0e63d8b6d8a4424cb5b669a0fa3798f0/users/f344ee0f477f4e56b4fdf1974540c36e/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:39.413950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15667cca-91f8-4c82-a552-1fb2ea66dca0 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:39.414095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-f2a5d54c-fc58-4a06-bea9-7c5a1f22d77a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:39.414376 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15667cca-91f8-4c82-a552-1fb2ea66dca0 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:39.414723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15667cca-91f8-4c82-a552-1fb2ea66dca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:39.415341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f2a5d54c-fc58-4a06-bea9-7c5a1f22d77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:39.504472 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-15667cca-91f8-4c82-a552-1fb2ea66dca0 None None] MFA Rules not processed for user `f344ee0f477f4e56b4fdf1974540c36e`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:39.517070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-15667cca-91f8-4c82-a552-1fb2ea66dca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:39.705410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 882/1763] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:39.710535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5d54c-fc58-4a06-bea9-7c5a1f22d77a None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:39.720857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:39.728300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f2a5d54c-fc58-4a06-bea9-7c5a1f22d77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:39.758714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a5d54c-fc58-4a06-bea9-7c5a1f22d77a None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:39.772231 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:39.777039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:39.777039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:39.777039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] PATH_INFO: `/v3/projects/dfacdd797d3144958a8523da1d5d716e` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:39.779335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 882/1764] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:39 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:39.799560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15667cca-91f8-4c82-a552-1fb2ea66dca0 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:39.800625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfacdd797d3144958a8523da1d5d716e)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:39.803878 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-15667cca-91f8-4c82-a552-1fb2ea66dca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:39.817136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:39.876790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:39.997369 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15667cca-91f8-4c82-a552-1fb2ea66dca0 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:40.004320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfacdd797d3144958a8523da1d5d716e', 'request_id': 'req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:40.020139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfacdd797d3144958a8523da1d5d716e', 'request_id': 'req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:40.038243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfacdd797d3144958a8523da1d5d716e', 'request_id': 'req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:40.119101 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf14c5f-3a5d-4ecd-86ec-452a3ab0ac73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:40.120014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf14c5f-3a5d-4ecd-86ec-452a3ab0ac73 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:40.120125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf14c5f-3a5d-4ecd-86ec-452a3ab0ac73 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:40.120353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf14c5f-3a5d-4ecd-86ec-452a3ab0ac73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:40.174452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] The token cache is being invalidate because project dfacdd797d3144958a8523da1d5d716e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:40.174733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:40.177593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:40.182822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 883/1765] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:39 2022] DELETE /identity/v3/projects/dfacdd797d3144958a8523da1d5d716e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:40.184456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:40.186046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:40.257305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf14c5f-3a5d-4ecd-86ec-452a3ab0ac73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:40.259242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf14c5f-3a5d-4ecd-86ec-452a3ab0ac73 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:40.274688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 883/1766] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:40.276250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf14c5f-3a5d-4ecd-86ec-452a3ab0ac73 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:40.288174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf14c5f-3a5d-4ecd-86ec-452a3ab0ac73 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:40.294869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5ea43-99dc-4466-8236-746653e0cd85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:40.296041 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5ea43-99dc-4466-8236-746653e0cd85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:40.296787 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5ea43-99dc-4466-8236-746653e0cd85 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:40.297253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5ea43-99dc-4466-8236-746653e0cd85 admin admin] PATH_INFO: `/v3/users/37b9dc9efcf54e27b822462f04e4816b` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:40.298748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5ea43-99dc-4466-8236-746653e0cd85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37b9dc9efcf54e27b822462f04e4816b)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:40.301201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5ea43-99dc-4466-8236-746653e0cd85 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:40.311352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff87e5c-0bf5-4901-8313-3bd6a12b7bff admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:40.315920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0443f-83f1-4855-9b92-1f69fbecca1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:40.316822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0443f-83f1-4855-9b92-1f69fbecca1a service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:40.317275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0443f-83f1-4855-9b92-1f69fbecca1a service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:40.317748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd0443f-83f1-4855-9b92-1f69fbecca1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:40.320124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-cbd0443f-83f1-4855-9b92-1f69fbecca1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:40.550363 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0443f-83f1-4855-9b92-1f69fbecca1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:40.552482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd0443f-83f1-4855-9b92-1f69fbecca1a service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:40.604506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-83b5ea43-99dc-4466-8236-746653e0cd85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37b9dc9efcf54e27b822462f04e4816b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:40.604506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-83b5ea43-99dc-4466-8236-746653e0cd85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37b9dc9efcf54e27b822462f04e4816b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:40.604506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-83b5ea43-99dc-4466-8236-746653e0cd85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37b9dc9efcf54e27b822462f04e4816b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:40.605323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 884/1767] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:40.694242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-83b5ea43-99dc-4466-8236-746653e0cd85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37b9dc9efcf54e27b822462f04e4816b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:40.708918 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-83b5ea43-99dc-4466-8236-746653e0cd85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37b9dc9efcf54e27b822462f04e4816b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:40.823159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 884/1768] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:40 2022] DELETE /identity/v3/users/37b9dc9efcf54e27b822462f04e4816b => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:41.521590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0443f-83f1-4855-9b92-1f69fbecca1a service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:41.535033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-cbd0443f-83f1-4855-9b92-1f69fbecca1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:41.566047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd0443f-83f1-4855-9b92-1f69fbecca1a service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:41.626066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38822f3d-c232-43d0-8f59-ef1b51be2a79 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:41.626367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38822f3d-c232-43d0-8f59-ef1b51be2a79 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:41.626658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38822f3d-c232-43d0-8f59-ef1b51be2a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:41.669731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-38822f3d-c232-43d0-8f59-ef1b51be2a79 None None] MFA Rules not processed for user `54404c13a1cf4d4eab0082fbfdd2bc58`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:41.671599 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-38822f3d-c232-43d0-8f59-ef1b51be2a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:41.750984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:41.755259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:41.755665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:41.757056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] PATH_INFO: `/v3/projects/1673d6cc4cda4b62864d970e8f832ac1` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:41.760659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1673d6cc4cda4b62864d970e8f832ac1)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:41.768956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:41.863802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 885/1769] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:42.101940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38822f3d-c232-43d0-8f59-ef1b51be2a79 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:42.103661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-38822f3d-c232-43d0-8f59-ef1b51be2a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:42.113361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1673d6cc4cda4b62864d970e8f832ac1', 'request_id': 'req-586a409d-ee61-432e-a2ed-19559752f869'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:42.132858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1673d6cc4cda4b62864d970e8f832ac1', 'request_id': 'req-586a409d-ee61-432e-a2ed-19559752f869'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:42.138993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38822f3d-c232-43d0-8f59-ef1b51be2a79 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:42.148309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1673d6cc4cda4b62864d970e8f832ac1', 'request_id': 'req-586a409d-ee61-432e-a2ed-19559752f869'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:42.262020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] The token cache is being invalidate because project 1673d6cc4cda4b62864d970e8f832ac1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:42.262739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:42.263484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:42.265460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 885/1770] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:41 2022] DELETE /identity/v3/projects/1673d6cc4cda4b62864d970e8f832ac1 => generated 0 bytes in 745 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:42.269849 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:42.272086 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:42.335858 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5f0d5-6722-4db5-9563-37b79dd97e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:42.336962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f0d5-6722-4db5-9563-37b79dd97e05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:42.337351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f0d5-6722-4db5-9563-37b79dd97e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:42.337730 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5f0d5-6722-4db5-9563-37b79dd97e05 admin admin] PATH_INFO: `/v3/projects/4da17e3b6e774672b649a1ce0bad8f52` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:42.342085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5f0d5-6722-4db5-9563-37b79dd97e05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4da17e3b6e774672b649a1ce0bad8f52)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:42.344289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5f0d5-6722-4db5-9563-37b79dd97e05 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:42.627233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-08a5f0d5-6722-4db5-9563-37b79dd97e05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4da17e3b6e774672b649a1ce0bad8f52', 'request_id': 'req-08a5f0d5-6722-4db5-9563-37b79dd97e05'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:42.648877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-08a5f0d5-6722-4db5-9563-37b79dd97e05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4da17e3b6e774672b649a1ce0bad8f52', 'request_id': 'req-08a5f0d5-6722-4db5-9563-37b79dd97e05'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:42.676757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-08a5f0d5-6722-4db5-9563-37b79dd97e05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4da17e3b6e774672b649a1ce0bad8f52', 'request_id': 'req-08a5f0d5-6722-4db5-9563-37b79dd97e05'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:42.797240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586a409d-ee61-432e-a2ed-19559752f869 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:42.808430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-08a5f0d5-6722-4db5-9563-37b79dd97e05 admin admin] The token cache is being invalidate because project 4da17e3b6e774672b649a1ce0bad8f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:42.808430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-08a5f0d5-6722-4db5-9563-37b79dd97e05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:42.808430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-08a5f0d5-6722-4db5-9563-37b79dd97e05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:42.808430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 886/1771] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:42 2022] DELETE /identity/v3/projects/4da17e3b6e774672b649a1ce0bad8f52 => generated 0 bytes in 703 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:10:42.810354 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2bbd-8b69-49d0-b8d7-2392985fd7d2 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:42.810713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2bbd-8b69-49d0-b8d7-2392985fd7d2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:42.811059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ff2bbd-8b69-49d0-b8d7-2392985fd7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:42.867220 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a3ff2bbd-8b69-49d0-b8d7-2392985fd7d2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:42.871590 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a3ff2bbd-8b69-49d0-b8d7-2392985fd7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:42.951758 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638af26-7ea9-4e76-8b3a-158b6bfce319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:42.951758 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638af26-7ea9-4e76-8b3a-158b6bfce319 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:42.951758 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638af26-7ea9-4e76-8b3a-158b6bfce319 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:42.951758 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638af26-7ea9-4e76-8b3a-158b6bfce319 admin admin] PATH_INFO: `/v3/users/01a99ae8335746039a97d4d55e5b7952` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:42.952203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638af26-7ea9-4e76-8b3a-158b6bfce319 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01a99ae8335746039a97d4d55e5b7952)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:42.952645 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638af26-7ea9-4e76-8b3a-158b6bfce319 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:43.059210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 887/1772] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:43.070907 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc9bf0-d7a6-4ed1-ac5e-262b8f574f96 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:43.071458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc9bf0-d7a6-4ed1-ac5e-262b8f574f96 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:43.071949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdc9bf0-d7a6-4ed1-ac5e-262b8f574f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:43.119754 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ffdc9bf0-d7a6-4ed1-ac5e-262b8f574f96 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:43.124575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ffdc9bf0-d7a6-4ed1-ac5e-262b8f574f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:43.157442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 888/1773] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:10:43.159072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc9bf0-d7a6-4ed1-ac5e-262b8f574f96 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:43.189828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdc9bf0-d7a6-4ed1-ac5e-262b8f574f96 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:43.199226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341eff-7207-410d-b410-656c1e7ccee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:43.202058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341eff-7207-410d-b410-656c1e7ccee9 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:43.202473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341eff-7207-410d-b410-656c1e7ccee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:43.203613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341eff-7207-410d-b410-656c1e7ccee9 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:43.205512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49341eff-7207-410d-b410-656c1e7ccee9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:43.205961 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49341eff-7207-410d-b410-656c1e7ccee9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:43.208699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49341eff-7207-410d-b410-656c1e7ccee9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:43.234306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:43.251149 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 889/1774] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:43.252182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341eff-7207-410d-b410-656c1e7ccee9 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:43.278576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341eff-7207-410d-b410-656c1e7ccee9 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:43.299934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b400e2-a1a2-4d93-8130-99cd3130dfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:43.299934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b400e2-a1a2-4d93-8130-99cd3130dfbf admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:43.299934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b400e2-a1a2-4d93-8130-99cd3130dfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:43.300363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b400e2-a1a2-4d93-8130-99cd3130dfbf admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:43.301660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b400e2-a1a2-4d93-8130-99cd3130dfbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:43.304818 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b400e2-a1a2-4d93-8130-99cd3130dfbf admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:43.427032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1638af26-7ea9-4e76-8b3a-158b6bfce319 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01a99ae8335746039a97d4d55e5b7952'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:43.441962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 890/1775] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:43 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:43.445225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b400e2-a1a2-4d93-8130-99cd3130dfbf admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:43.472514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1638af26-7ea9-4e76-8b3a-158b6bfce319 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01a99ae8335746039a97d4d55e5b7952'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:43.483434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1638af26-7ea9-4e76-8b3a-158b6bfce319 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01a99ae8335746039a97d4d55e5b7952'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:43.485594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1638af26-7ea9-4e76-8b3a-158b6bfce319 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01a99ae8335746039a97d4d55e5b7952'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:43.570308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1638af26-7ea9-4e76-8b3a-158b6bfce319 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01a99ae8335746039a97d4d55e5b7952'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:43.606193 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 886/1776] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:42 2022] DELETE /identity/v3/users/01a99ae8335746039a97d4d55e5b7952 => generated 0 bytes in 1337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:43.607954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26050afd-5869-4b9b-9436-3fa07e899ad6 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:43.608439 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26050afd-5869-4b9b-9436-3fa07e899ad6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:43.610576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26050afd-5869-4b9b-9436-3fa07e899ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:43.648469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-26050afd-5869-4b9b-9436-3fa07e899ad6 None None] MFA Rules not processed for user `6617f968cd214435a1efcb401ba33e38`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:43.650143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-26050afd-5869-4b9b-9436-3fa07e899ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:43.670243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b400e2-a1a2-4d93-8130-99cd3130dfbf admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:43.815056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 887/1777] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:43.924993 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a057f6-1bea-4e96-8b3b-f77740b115ad None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:43.925282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a057f6-1bea-4e96-8b3b-f77740b115ad None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:43.925757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a057f6-1bea-4e96-8b3b-f77740b115ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:43.980969 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-32a057f6-1bea-4e96-8b3b-f77740b115ad None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:43.982782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-32a057f6-1bea-4e96-8b3b-f77740b115ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:44.060121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 888/1778] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:10:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:44.239183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a9590-b8fb-4465-8420-9e4bf1a0e968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:44.239965 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a9590-b8fb-4465-8420-9e4bf1a0e968 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:44.247344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a9590-b8fb-4465-8420-9e4bf1a0e968 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:44.247946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a9590-b8fb-4465-8420-9e4bf1a0e968 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:44.249530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a9590-b8fb-4465-8420-9e4bf1a0e968 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:44.251616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22a9590-b8fb-4465-8420-9e4bf1a0e968 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:44.449650 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 891/1779] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:43 2022] POST /identity/v3/users => generated 293 bytes in 1007 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:44.449854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a057f6-1bea-4e96-8b3b-f77740b115ad None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:44.452789 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-32a057f6-1bea-4e96-8b3b-f77740b115ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:44.494963 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a057f6-1bea-4e96-8b3b-f77740b115ad None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:44.521463 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce768ff1-df59-44c2-a975-8ff2cf5fb26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:44.525162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce768ff1-df59-44c2-a975-8ff2cf5fb26b admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:44.528988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce768ff1-df59-44c2-a975-8ff2cf5fb26b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:44.529858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce768ff1-df59-44c2-a975-8ff2cf5fb26b admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:44.535323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:44.536568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce768ff1-df59-44c2-a975-8ff2cf5fb26b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:44.543111 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce768ff1-df59-44c2-a975-8ff2cf5fb26b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:44.602876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 889/1780] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:10:44.605414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a9590-b8fb-4465-8420-9e4bf1a0e968 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:44.622673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a9590-b8fb-4465-8420-9e4bf1a0e968 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:44.629461 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ecb6f-60ae-4fec-a5e8-a5679bd4daf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:44.630209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ecb6f-60ae-4fec-a5e8-a5679bd4daf6 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:44.630497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ecb6f-60ae-4fec-a5e8-a5679bd4daf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:44.630781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ecb6f-60ae-4fec-a5e8-a5679bd4daf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:44.631522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ecb6f-60ae-4fec-a5e8-a5679bd4daf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:44.633204 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ecb6f-60ae-4fec-a5e8-a5679bd4daf6 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:44.647529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 892/1781] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:44.652735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce768ff1-df59-44c2-a975-8ff2cf5fb26b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:44.689319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce768ff1-df59-44c2-a975-8ff2cf5fb26b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:44.705624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02073dfc-41e1-427f-b73d-cf0838105e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:44.706794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02073dfc-41e1-427f-b73d-cf0838105e8a admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:44.708304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02073dfc-41e1-427f-b73d-cf0838105e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:44.708737 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02073dfc-41e1-427f-b73d-cf0838105e8a admin admin] PATH_INFO: `/v3/projects/2cb9d31525834823aaaee67f45a43958/users/25ad9297d86e48789a6bf5a3e624b45b/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:44.736947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02073dfc-41e1-427f-b73d-cf0838105e8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb9d31525834823aaaee67f45a43958, user_id=25ad9297d86e48789a6bf5a3e624b45b, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:44.740423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02073dfc-41e1-427f-b73d-cf0838105e8a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:44.806874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ecb6f-60ae-4fec-a5e8-a5679bd4daf6 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:44.809627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-984ecb6f-60ae-4fec-a5e8-a5679bd4daf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:44.918353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 890/1782] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:44 2022] PUT /identity/v3/projects/2cb9d31525834823aaaee67f45a43958/users/25ad9297d86e48789a6bf5a3e624b45b/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:44.935192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd90600-3159-4d58-abea-5f7e21a0f620 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:44.935794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd90600-3159-4d58-abea-5f7e21a0f620 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:44.936231 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd90600-3159-4d58-abea-5f7e21a0f620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:44.948182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ecb6f-60ae-4fec-a5e8-a5679bd4daf6 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:45.027459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-1cd90600-3159-4d58-abea-5f7e21a0f620 None None] MFA Rules not processed for user `25ad9297d86e48789a6bf5a3e624b45b`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:45.030493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1cd90600-3159-4d58-abea-5f7e21a0f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:45.162581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cb32a-c89f-4f44-82c8-8a7d93894152 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:45.164988 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cb32a-c89f-4f44-82c8-8a7d93894152 service swift] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:45.167156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cb32a-c89f-4f44-82c8-8a7d93894152 service swift] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:45.168302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94cb32a-c89f-4f44-82c8-8a7d93894152 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:45.240656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 891/1783] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:45.241897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd90600-3159-4d58-abea-5f7e21a0f620 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:45.248869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1cd90600-3159-4d58-abea-5f7e21a0f620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:45.396163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd90600-3159-4d58-abea-5f7e21a0f620 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:45.405118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cb32a-c89f-4f44-82c8-8a7d93894152 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:45.407920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0b5ada-f164-4e98-a11f-9be47234362e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:45.408944 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b5ada-f164-4e98-a11f-9be47234362e service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:45.409674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b5ada-f164-4e98-a11f-9be47234362e service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:45.409955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0b5ada-f164-4e98-a11f-9be47234362e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:45.413974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94cb32a-c89f-4f44-82c8-8a7d93894152 service swift] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:45.416644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-7b0b5ada-f164-4e98-a11f-9be47234362e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:45.450075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 893/1784] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:10:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 11:10:45.451105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cb32a-c89f-4f44-82c8-8a7d93894152 service swift] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:45.665974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b5ada-f164-4e98-a11f-9be47234362e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:45.674281 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0b5ada-f164-4e98-a11f-9be47234362e service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:45.707545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 892/1785] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:45.729698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94cb32a-c89f-4f44-82c8-8a7d93894152 service swift] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:45.736984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2ac3c-bbfb-47a5-b68f-06de4026d46c None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:45.737268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2ac3c-bbfb-47a5-b68f-06de4026d46c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:45.737796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf2ac3c-bbfb-47a5-b68f-06de4026d46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:45.757327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04a1d-d69a-4abe-a8f8-2d6243d485a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:45.760388 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04a1d-d69a-4abe-a8f8-2d6243d485a9 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:45.760714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04a1d-d69a-4abe-a8f8-2d6243d485a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:45.760992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c04a1d-d69a-4abe-a8f8-2d6243d485a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:45.771367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c04a1d-d69a-4abe-a8f8-2d6243d485a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:45.775687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c04a1d-d69a-4abe-a8f8-2d6243d485a9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:45.800979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:45.834721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-cbf2ac3c-bbfb-47a5-b68f-06de4026d46c None None] MFA Rules not processed for user `2d903a8e2ce4489fa7f5b7479ff0b7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:45.838682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-cbf2ac3c-bbfb-47a5-b68f-06de4026d46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:45.954459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 894/1786] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:45 2022] POST /identity/v3/projects => generated 387 bytes in 504 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:45.958036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04a1d-d69a-4abe-a8f8-2d6243d485a9 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:45.985997 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 893/1787] 10.222.0.23 () {58 vars in 1015 bytes} [Thu Jun 23 11:10:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:10:46.066614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2ac3c-bbfb-47a5-b68f-06de4026d46c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:46.066614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-cbf2ac3c-bbfb-47a5-b68f-06de4026d46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:46.091596 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf2ac3c-bbfb-47a5-b68f-06de4026d46c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:46.210841 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c04a1d-d69a-4abe-a8f8-2d6243d485a9 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:46.212729 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405f38d-c07e-4edd-97db-f69efbae7d38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:46.215398 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405f38d-c07e-4edd-97db-f69efbae7d38 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:46.216647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405f38d-c07e-4edd-97db-f69efbae7d38 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:46.217167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405f38d-c07e-4edd-97db-f69efbae7d38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:46.223537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4268d1-bd1e-4a96-babe-1f237be45d08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:46.224426 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4268d1-bd1e-4a96-babe-1f237be45d08 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:46.224767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4268d1-bd1e-4a96-babe-1f237be45d08 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:46.226954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4268d1-bd1e-4a96-babe-1f237be45d08 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:46.227742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4268d1-bd1e-4a96-babe-1f237be45d08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:46.240583 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4268d1-bd1e-4a96-babe-1f237be45d08 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:46.244618 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405f38d-c07e-4edd-97db-f69efbae7d38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:46.247381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405f38d-c07e-4edd-97db-f69efbae7d38 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:46.270092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 894/1788] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:46 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:46.412176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405f38d-c07e-4edd-97db-f69efbae7d38 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:46.412837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 895/1789] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:45 2022] POST /identity/v3/users => generated 300 bytes in 455 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:10:46.433659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405f38d-c07e-4edd-97db-f69efbae7d38 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:46.443714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e2f91-cb00-4556-96e2-a968e243297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:46.444721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e2f91-cb00-4556-96e2-a968e243297b admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:46.445079 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e2f91-cb00-4556-96e2-a968e243297b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:46.445446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0e2f91-cb00-4556-96e2-a968e243297b admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:46.446441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e2f91-cb00-4556-96e2-a968e243297b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:46.450121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0e2f91-cb00-4556-96e2-a968e243297b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:46.490313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 895/1790] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:46.494586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4268d1-bd1e-4a96-babe-1f237be45d08 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:46.510502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4268d1-bd1e-4a96-babe-1f237be45d08 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:46.527338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0b3f8-3e53-45c8-a076-4c11a02df698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:46.527338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0b3f8-3e53-45c8-a076-4c11a02df698 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:46.527338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0b3f8-3e53-45c8-a076-4c11a02df698 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:46.530059 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e2f91-cb00-4556-96e2-a968e243297b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:46.531556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd0b3f8-3e53-45c8-a076-4c11a02df698 admin admin] PATH_INFO: `/v3/projects/c2375f0f841f4e9f872369b3bef546d8/users/964b7b95ab1c4418abe7db53a4cae3a0/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:46.532860 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8e0e2f91-cb00-4556-96e2-a968e243297b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:46.570576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0e2f91-cb00-4556-96e2-a968e243297b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:46.609597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:46.610612 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:46.610895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:46.611174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] PATH_INFO: `/v3/projects/09dc610744e845be831743907cf473ac` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:46.616046 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0b3f8-3e53-45c8-a076-4c11a02df698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2375f0f841f4e9f872369b3bef546d8, user_id=964b7b95ab1c4418abe7db53a4cae3a0, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:46.619203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd0b3f8-3e53-45c8-a076-4c11a02df698 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:46.623851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] RBAC: Authorizing `identity:delete_project(project_id=09dc610744e845be831743907cf473ac)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:46.626664 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:47.124633 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 896/1791] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:46 2022] PUT /identity/v3/projects/c2375f0f841f4e9f872369b3bef546d8/users/964b7b95ab1c4418abe7db53a4cae3a0/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:47.128761 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0b3f8-3e53-45c8-a076-4c11a02df698 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:47.181307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09dc610744e845be831743907cf473ac', 'request_id': 'req-da2a6a5e-e890-4725-86d8-bc8608e0464c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:47.189752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09dc610744e845be831743907cf473ac', 'request_id': 'req-da2a6a5e-e890-4725-86d8-bc8608e0464c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:47.228708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09dc610744e845be831743907cf473ac', 'request_id': 'req-da2a6a5e-e890-4725-86d8-bc8608e0464c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:47.290433 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd0b3f8-3e53-45c8-a076-4c11a02df698 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:47.372972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] The token cache is being invalidate because project 09dc610744e845be831743907cf473ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:47.372972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:47.372972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:47.378987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 896/1792] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:46 2022] DELETE /identity/v3/projects/09dc610744e845be831743907cf473ac => generated 0 bytes in 846 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:47.380890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:47.382620 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:47.519442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4427b7-b55c-4419-b7ae-7b470090f037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:47.519442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4427b7-b55c-4419-b7ae-7b470090f037 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:47.519442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4427b7-b55c-4419-b7ae-7b470090f037 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:47.519442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4427b7-b55c-4419-b7ae-7b470090f037 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:47.520257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4427b7-b55c-4419-b7ae-7b470090f037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:47.520257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4427b7-b55c-4419-b7ae-7b470090f037 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:47.531883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 897/1793] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:47.536129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4427b7-b55c-4419-b7ae-7b470090f037 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:47.541840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7f4427b7-b55c-4419-b7ae-7b470090f037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:47.582987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4427b7-b55c-4419-b7ae-7b470090f037 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:47.597237 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408be39a-739a-4b5c-afca-313e02f693f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:47.598301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408be39a-739a-4b5c-afca-313e02f693f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:47.598713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408be39a-739a-4b5c-afca-313e02f693f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:47.599141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408be39a-739a-4b5c-afca-313e02f693f2 admin admin] PATH_INFO: `/v3/projects/c2375f0f841f4e9f872369b3bef546d8/users/964b7b95ab1c4418abe7db53a4cae3a0/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:47.620866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408be39a-739a-4b5c-afca-313e02f693f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2375f0f841f4e9f872369b3bef546d8, user_id=964b7b95ab1c4418abe7db53a4cae3a0, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:47.628624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408be39a-739a-4b5c-afca-313e02f693f2 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:47.637401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a6a5e-e890-4725-86d8-bc8608e0464c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:47.657089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:47.658051 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:47.659198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:47.659198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] PATH_INFO: `/v3/users/56564359ef794e699cc48352c4c7c6fa` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:47.661494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] RBAC: Authorizing `identity:delete_user(user_id=56564359ef794e699cc48352c4c7c6fa)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:47.663609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:47.688715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 898/1794] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:47 2022] PUT /identity/v3/projects/c2375f0f841f4e9f872369b3bef546d8/users/964b7b95ab1c4418abe7db53a4cae3a0/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:47.700609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe66795-c521-4bae-92e8-015d17e6f5e6 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:47.701011 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe66795-c521-4bae-92e8-015d17e6f5e6 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:47.701375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe66795-c521-4bae-92e8-015d17e6f5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:47.817674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-3fe66795-c521-4bae-92e8-015d17e6f5e6 None None] MFA Rules not processed for user `964b7b95ab1c4418abe7db53a4cae3a0`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:47.825547 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3fe66795-c521-4bae-92e8-015d17e6f5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:48.080912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:48.197800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 899/1795] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 499 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:48.212821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56564359ef794e699cc48352c4c7c6fa'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:48.222395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe66795-c521-4bae-92e8-015d17e6f5e6 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:48.223944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3fe66795-c521-4bae-92e8-015d17e6f5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:48.284128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56564359ef794e699cc48352c4c7c6fa'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:48.284128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56564359ef794e699cc48352c4c7c6fa'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:48.289451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56564359ef794e699cc48352c4c7c6fa'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:48.426862 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56564359ef794e699cc48352c4c7c6fa'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:48.521729 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe66795-c521-4bae-92e8-015d17e6f5e6 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:48.539070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d355f876-63aa-40f4-b92b-3730ef1cf81b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:48.540370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f876-63aa-40f4-b92b-3730ef1cf81b service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:48.540713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f876-63aa-40f4-b92b-3730ef1cf81b service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:48.541859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d355f876-63aa-40f4-b92b-3730ef1cf81b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:48.543075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 897/1796] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:47 2022] DELETE /identity/v3/users/56564359ef794e699cc48352c4c7c6fa => generated 0 bytes in 1152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:48.552472 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d355f876-63aa-40f4-b92b-3730ef1cf81b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:48.616221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f876-63aa-40f4-b92b-3730ef1cf81b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:48.623222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d355f876-63aa-40f4-b92b-3730ef1cf81b service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:48.670511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 900/1797] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:48.748617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:48.750656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:49.010284 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3543fc5d-06ba-4730-b0ba-a16e754ef326 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:49.034238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:49.038195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:49.038522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:49.040267 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] PATH_INFO: `/v3/users/25ad9297d86e48789a6bf5a3e624b45b` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:49.044503 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25ad9297d86e48789a6bf5a3e624b45b)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:49.050940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:49.596139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25ad9297d86e48789a6bf5a3e624b45b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:49.669941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25ad9297d86e48789a6bf5a3e624b45b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:49.669941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25ad9297d86e48789a6bf5a3e624b45b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:49.669941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25ad9297d86e48789a6bf5a3e624b45b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:49.774196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25ad9297d86e48789a6bf5a3e624b45b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:49.814073 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74832903-bf6e-4532-97e7-7fb3eb324537 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:49.814639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 898/1798] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:48 2022] DELETE /identity/v3/users/25ad9297d86e48789a6bf5a3e624b45b => generated 0 bytes in 1061 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:49.815157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74832903-bf6e-4532-97e7-7fb3eb324537 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:49.815738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74832903-bf6e-4532-97e7-7fb3eb324537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:49.853288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-74832903-bf6e-4532-97e7-7fb3eb324537 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:49.853288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-74832903-bf6e-4532-97e7-7fb3eb324537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:50.010909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 901/1799] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:10:50.104477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:50.115947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:50.274396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64efbcb8-6fe1-46a3-bcba-2ed17458fe36 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:50.280844 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:50.284745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1b99d-11de-4d1e-b773-bbcf263df75d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:50.285931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1b99d-11de-4d1e-b773-bbcf263df75d service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:50.286477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1b99d-11de-4d1e-b773-bbcf263df75d service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:50.286934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1b99d-11de-4d1e-b773-bbcf263df75d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:50.298737 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1b99d-11de-4d1e-b773-bbcf263df75d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:50.300737 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1b99d-11de-4d1e-b773-bbcf263df75d service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:50.315645 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 899/1800] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:50.439640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:50.756766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d3aef-649c-43c5-bde9-8790b722ed8d None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:50.757095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d3aef-649c-43c5-bde9-8790b722ed8d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:50.757678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1d3aef-649c-43c5-bde9-8790b722ed8d None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:50.759309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 902/1801] 10.222.0.52 () {54 vars in 921 bytes} [Thu Jun 23 11:10:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:10:50.791492 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404bbc8-c898-4255-8f7d-170c410a1d9b None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:50.792012 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404bbc8-c898-4255-8f7d-170c410a1d9b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:50.792142 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d404bbc8-c898-4255-8f7d-170c410a1d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:50.834127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-d404bbc8-c898-4255-8f7d-170c410a1d9b None None] MFA Rules not processed for user `a020e7fe06574a108b46f9f48bddc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:50.835880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d404bbc8-c898-4255-8f7d-170c410a1d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:50.957162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 900/1802] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Jun 23 11:10:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:51.044665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d3aef-649c-43c5-bde9-8790b722ed8d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:51.052877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-dc1d3aef-649c-43c5-bde9-8790b722ed8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:51.094488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1d3aef-649c-43c5-bde9-8790b722ed8d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:51.110519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448ce46a-cbc5-4ca4-9ef0-27c3ac31dcce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:51.111196 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ce46a-cbc5-4ca4-9ef0-27c3ac31dcce service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:51.111484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ce46a-cbc5-4ca4-9ef0-27c3ac31dcce service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:51.111769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448ce46a-cbc5-4ca4-9ef0-27c3ac31dcce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:51.121633 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ce46a-cbc5-4ca4-9ef0-27c3ac31dcce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:51.123662 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448ce46a-cbc5-4ca4-9ef0-27c3ac31dcce service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:51.144536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 903/1803] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:51.148675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404bbc8-c898-4255-8f7d-170c410a1d9b None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:51.152237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d404bbc8-c898-4255-8f7d-170c410a1d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:51.187642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d404bbc8-c898-4255-8f7d-170c410a1d9b None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:51.195212 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf247ca-ddb2-4988-8e74-3f52fd91e439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:51.196133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf247ca-ddb2-4988-8e74-3f52fd91e439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:51.196416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf247ca-ddb2-4988-8e74-3f52fd91e439 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:51.196899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf247ca-ddb2-4988-8e74-3f52fd91e439 admin admin] PATH_INFO: `/v3/projects/5090da7b66dc4a189a36e2ae4060d146` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:51.199030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf247ca-ddb2-4988-8e74-3f52fd91e439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5090da7b66dc4a189a36e2ae4060d146)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:51.201453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf247ca-ddb2-4988-8e74-3f52fd91e439 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:51.377066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:51.441570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ccf247ca-ddb2-4988-8e74-3f52fd91e439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5090da7b66dc4a189a36e2ae4060d146', 'request_id': 'req-ccf247ca-ddb2-4988-8e74-3f52fd91e439'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:51.452005 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ccf247ca-ddb2-4988-8e74-3f52fd91e439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5090da7b66dc4a189a36e2ae4060d146', 'request_id': 'req-ccf247ca-ddb2-4988-8e74-3f52fd91e439'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:51.462077 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ccf247ca-ddb2-4988-8e74-3f52fd91e439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5090da7b66dc4a189a36e2ae4060d146', 'request_id': 'req-ccf247ca-ddb2-4988-8e74-3f52fd91e439'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:51.596617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ccf247ca-ddb2-4988-8e74-3f52fd91e439 admin admin] The token cache is being invalidate because project 5090da7b66dc4a189a36e2ae4060d146 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:51.596917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ccf247ca-ddb2-4988-8e74-3f52fd91e439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:51.598552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ccf247ca-ddb2-4988-8e74-3f52fd91e439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:51.603010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 901/1804] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:51 2022] DELETE /identity/v3/projects/5090da7b66dc4a189a36e2ae4060d146 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:51.609889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db535b-0e75-4f28-863c-138396595d07 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:51.611449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db535b-0e75-4f28-863c-138396595d07 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:51.611963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79db535b-0e75-4f28-863c-138396595d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:51.659854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-79db535b-0e75-4f28-863c-138396595d07 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:51.661847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-79db535b-0e75-4f28-863c-138396595d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:51.844973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 904/1805] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:51.852897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53367a1-518d-4ef4-9993-10a250a9138b None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:51.853473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53367a1-518d-4ef4-9993-10a250a9138b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:51.853473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53367a1-518d-4ef4-9993-10a250a9138b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:51.924077 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-a53367a1-518d-4ef4-9993-10a250a9138b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:51.926288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a53367a1-518d-4ef4-9993-10a250a9138b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:51.942502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db535b-0e75-4f28-863c-138396595d07 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:51.954740 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 902/1806] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:51.967751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79db535b-0e75-4f28-863c-138396595d07 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:52.004250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e083ad9-be90-4aa2-8063-b1ed49d32d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:52.004250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083ad9-be90-4aa2-8063-b1ed49d32d3e admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:52.004250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083ad9-be90-4aa2-8063-b1ed49d32d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:52.004250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e083ad9-be90-4aa2-8063-b1ed49d32d3e admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:52.004579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e083ad9-be90-4aa2-8063-b1ed49d32d3e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:52.004579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e083ad9-be90-4aa2-8063-b1ed49d32d3e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:52.004579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e083ad9-be90-4aa2-8063-b1ed49d32d3e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:52.066675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 905/1807] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:52.068269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53367a1-518d-4ef4-9993-10a250a9138b None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:52.084578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53367a1-518d-4ef4-9993-10a250a9138b None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:52.086112 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dfe64-3c20-4afc-9f83-895af50db36d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:52.087085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dfe64-3c20-4afc-9f83-895af50db36d admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:52.087565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dfe64-3c20-4afc-9f83-895af50db36d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:52.088104 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72dfe64-3c20-4afc-9f83-895af50db36d admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:52.089032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dfe64-3c20-4afc-9f83-895af50db36d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:52.091233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72dfe64-3c20-4afc-9f83-895af50db36d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:52.277915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 903/1808] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:52 2022] POST /identity/v3/projects => generated 377 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:52.285807 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e083ad9-be90-4aa2-8063-b1ed49d32d3e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:52.310285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e083ad9-be90-4aa2-8063-b1ed49d32d3e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:52.545587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5cb41-fd9f-48a6-9577-58c6a08c8b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:52.546290 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5cb41-fd9f-48a6-9577-58c6a08c8b3f admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:52.546575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5cb41-fd9f-48a6-9577-58c6a08c8b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:52.546855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e5cb41-fd9f-48a6-9577-58c6a08c8b3f admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:52.547566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5cb41-fd9f-48a6-9577-58c6a08c8b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:52.552535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e5cb41-fd9f-48a6-9577-58c6a08c8b3f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:52.557209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:52.714504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 906/1809] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:52 2022] POST /identity/v3/users => generated 289 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:52.719348 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dfe64-3c20-4afc-9f83-895af50db36d admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:52.733567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72dfe64-3c20-4afc-9f83-895af50db36d admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:52.744446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15a3db-2083-4e86-bc17-f95a8e806716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:52.745335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15a3db-2083-4e86-bc17-f95a8e806716 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:52.745828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15a3db-2083-4e86-bc17-f95a8e806716 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:52.746080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15a3db-2083-4e86-bc17-f95a8e806716 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:52.746959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15a3db-2083-4e86-bc17-f95a8e806716 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:52.748718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a15a3db-2083-4e86-bc17-f95a8e806716 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:52.776325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5cb41-fd9f-48a6-9577-58c6a08c8b3f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:52.784448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 904/1810] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:52.811297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e5cb41-fd9f-48a6-9577-58c6a08c8b3f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:52.848587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1035e93-a27f-4df5-8641-097110643c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:52.849356 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035e93-a27f-4df5-8641-097110643c3f admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:52.849652 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035e93-a27f-4df5-8641-097110643c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:52.849937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1035e93-a27f-4df5-8641-097110643c3f admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:52.850688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1035e93-a27f-4df5-8641-097110643c3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:52.857541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1035e93-a27f-4df5-8641-097110643c3f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:52.898355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 907/1811] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:52.903448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15a3db-2083-4e86-bc17-f95a8e806716 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:52.934209 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15a3db-2083-4e86-bc17-f95a8e806716 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:52.956801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf6db41-a7ec-491b-91f9-410fb9a8b41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:52.956801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6db41-a7ec-491b-91f9-410fb9a8b41a admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:52.956801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6db41-a7ec-491b-91f9-410fb9a8b41a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:52.956801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf6db41-a7ec-491b-91f9-410fb9a8b41a admin admin] PATH_INFO: `/v3/projects/1a15cc9d17084300b9a76781335fc257/users/a138042647a147d992d5d173a550daa3/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:53.014831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6db41-a7ec-491b-91f9-410fb9a8b41a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a15cc9d17084300b9a76781335fc257, user_id=a138042647a147d992d5d173a550daa3, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:53.014831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf6db41-a7ec-491b-91f9-410fb9a8b41a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:53.015214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1035e93-a27f-4df5-8641-097110643c3f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:53.016721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b1035e93-a27f-4df5-8641-097110643c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:53.041390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1035e93-a27f-4df5-8641-097110643c3f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:53.054218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:53.054218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:53.054218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:53.054218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] PATH_INFO: `/v3/projects/2cb9d31525834823aaaee67f45a43958` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:53.055607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb9d31525834823aaaee67f45a43958)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:53.057874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:53.126950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 905/1812] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:52 2022] PUT /identity/v3/projects/1a15cc9d17084300b9a76781335fc257/users/a138042647a147d992d5d173a550daa3/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:53.139195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7e9fc-1af1-4e2b-a5e5-ad936571b449 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:53.139894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7e9fc-1af1-4e2b-a5e5-ad936571b449 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:53.140449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7e9fc-1af1-4e2b-a5e5-ad936571b449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:53.220412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:53.253102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4cf7e9fc-1af1-4e2b-a5e5-ad936571b449 None None] MFA Rules not processed for user `a138042647a147d992d5d173a550daa3`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:53.255695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4cf7e9fc-1af1-4e2b-a5e5-ad936571b449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:53.481379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 906/1813] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:53.481379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a901f-b42c-43b5-8e8d-7d2b6297da7b None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:53.481379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a901f-b42c-43b5-8e8d-7d2b6297da7b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:53.481379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a901f-b42c-43b5-8e8d-7d2b6297da7b None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:53.481379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 907/1814] 10.222.0.52 () {54 vars in 921 bytes} [Thu Jun 23 11:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:10:53.481379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a14da-f7a4-4aad-96f0-b46d05448b47 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:53.481379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a14da-f7a4-4aad-96f0-b46d05448b47 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:53.482670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636a14da-f7a4-4aad-96f0-b46d05448b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:53.617150 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-636a14da-f7a4-4aad-96f0-b46d05448b47 None None] MFA Rules not processed for user `a020e7fe06574a108b46f9f48bddc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:53.617150 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-636a14da-f7a4-4aad-96f0-b46d05448b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:53.617325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb9d31525834823aaaee67f45a43958', 'request_id': 'req-f354ca84-b9ea-4684-9dac-721642eba6bd'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:53.617325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb9d31525834823aaaee67f45a43958', 'request_id': 'req-f354ca84-b9ea-4684-9dac-721642eba6bd'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:53.617325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb9d31525834823aaaee67f45a43958', 'request_id': 'req-f354ca84-b9ea-4684-9dac-721642eba6bd'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:53.796907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 908/1815] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Jun 23 11:10:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:53.798019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a14da-f7a4-4aad-96f0-b46d05448b47 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:53.983847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636a14da-f7a4-4aad-96f0-b46d05448b47 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:53.998808 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bbe97-342a-493b-a5e5-e3358eb27a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:53.999842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bbe97-342a-493b-a5e5-e3358eb27a78 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:54.001164 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bbe97-342a-493b-a5e5-e3358eb27a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:54.001561 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bbe97-342a-493b-a5e5-e3358eb27a78 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:54.020375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bbe97-342a-493b-a5e5-e3358eb27a78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:54.026024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bbe97-342a-493b-a5e5-e3358eb27a78 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:54.379647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] The token cache is being invalidate because project 2cb9d31525834823aaaee67f45a43958 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:54.382897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 909/1816] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:53 2022] POST /identity/v3/projects => generated 375 bytes in 585 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:54.400264 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:54.400264 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:54.400397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bbe97-342a-493b-a5e5-e3358eb27a78 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:54.400471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 908/1817] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:53 2022] DELETE /identity/v3/projects/2cb9d31525834823aaaee67f45a43958 => generated 0 bytes in 1379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:10:54.400471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:54.400600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e43bbe97-342a-493b-a5e5-e3358eb27a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:54.402326 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:54.435268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f354ca84-b9ea-4684-9dac-721642eba6bd admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:54.524397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:54.526276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:54.527746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:54.528356 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] PATH_INFO: `/v3/users/964b7b95ab1c4418abe7db53a4cae3a0` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:54.530067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=964b7b95ab1c4418abe7db53a4cae3a0)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:54.532290 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:54.647381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bbe97-342a-493b-a5e5-e3358eb27a78 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:54.657626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9516f0d-77ed-4a45-a680-f1b5fe1a114c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:54.660962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9516f0d-77ed-4a45-a680-f1b5fe1a114c admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:54.669232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9516f0d-77ed-4a45-a680-f1b5fe1a114c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:54.669232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9516f0d-77ed-4a45-a680-f1b5fe1a114c admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:54.669232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9516f0d-77ed-4a45-a680-f1b5fe1a114c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:54.669232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9516f0d-77ed-4a45-a680-f1b5fe1a114c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:54.772739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 910/1818] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:54 2022] POST /identity/v3/users => generated 288 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:54.777717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9516f0d-77ed-4a45-a680-f1b5fe1a114c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:54.791926 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9516f0d-77ed-4a45-a680-f1b5fe1a114c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:54.798832 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846defc-3b8e-400a-a041-4f32e9b4a82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:54.809652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846defc-3b8e-400a-a041-4f32e9b4a82c admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:54.809983 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846defc-3b8e-400a-a041-4f32e9b4a82c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:54.810365 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846defc-3b8e-400a-a041-4f32e9b4a82c admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:54.811228 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846defc-3b8e-400a-a041-4f32e9b4a82c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:54.814054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3846defc-3b8e-400a-a041-4f32e9b4a82c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:54.832403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 911/1819] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:54 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:54.832403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846defc-3b8e-400a-a041-4f32e9b4a82c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:54.833703 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3846defc-3b8e-400a-a041-4f32e9b4a82c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:54.909103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '964b7b95ab1c4418abe7db53a4cae3a0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:54.910719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '964b7b95ab1c4418abe7db53a4cae3a0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:54.912296 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '964b7b95ab1c4418abe7db53a4cae3a0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:55.021908 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '964b7b95ab1c4418abe7db53a4cae3a0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:55.041243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846defc-3b8e-400a-a041-4f32e9b4a82c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:55.047580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '964b7b95ab1c4418abe7db53a4cae3a0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:55.076651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94844c19-90e3-4b3f-a5a7-54a21ceff4a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:55.076953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94844c19-90e3-4b3f-a5a7-54a21ceff4a4 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:55.077240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94844c19-90e3-4b3f-a5a7-54a21ceff4a4 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:55.077466 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94844c19-90e3-4b3f-a5a7-54a21ceff4a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:55.081899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-94844c19-90e3-4b3f-a5a7-54a21ceff4a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:55.124030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 909/1820] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:10:54 2022] DELETE /identity/v3/users/964b7b95ab1c4418abe7db53a4cae3a0 => generated 0 bytes in 724 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:10:55.125066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:55.127760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:55.130433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94844c19-90e3-4b3f-a5a7-54a21ceff4a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:55.132155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94844c19-90e3-4b3f-a5a7-54a21ceff4a4 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:55.170715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 912/1821] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:55.355970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66008db-f373-4fbc-98d4-061500782318 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:55.362141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522492c3-3ec5-4b41-a6ea-fe0a40ea25a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:55.364628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522492c3-3ec5-4b41-a6ea-fe0a40ea25a6 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:55.364782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522492c3-3ec5-4b41-a6ea-fe0a40ea25a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:55.365027 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522492c3-3ec5-4b41-a6ea-fe0a40ea25a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:55.365784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522492c3-3ec5-4b41-a6ea-fe0a40ea25a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:55.367556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522492c3-3ec5-4b41-a6ea-fe0a40ea25a6 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:55.401945 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94844c19-90e3-4b3f-a5a7-54a21ceff4a4 service nova] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:55.403635 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 910/1822] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:55 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:55.424707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94844c19-90e3-4b3f-a5a7-54a21ceff4a4 service nova] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:55.453247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7874e0b-a49f-4025-89ec-4f910e116cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:55.462995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7874e0b-a49f-4025-89ec-4f910e116cca admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:55.462995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7874e0b-a49f-4025-89ec-4f910e116cca admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:55.462995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7874e0b-a49f-4025-89ec-4f910e116cca admin admin] PATH_INFO: `/v3/projects/c7ba7aab26584f31b3fa5bac49f18489/users/1508d4256b254e5b9a699f2832fc3c09/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:55.493720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7874e0b-a49f-4025-89ec-4f910e116cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7ba7aab26584f31b3fa5bac49f18489, user_id=1508d4256b254e5b9a699f2832fc3c09, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:55.505127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7874e0b-a49f-4025-89ec-4f910e116cca admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:55.619019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 913/1823] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:55 2022] PUT /identity/v3/projects/c7ba7aab26584f31b3fa5bac49f18489/users/1508d4256b254e5b9a699f2832fc3c09/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:10:55.629469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e4066-0a2c-48e7-bd36-4ee0ed900b33 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:55.630243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e4066-0a2c-48e7-bd36-4ee0ed900b33 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:55.630677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e4066-0a2c-48e7-bd36-4ee0ed900b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:55.663379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ff6e4066-0a2c-48e7-bd36-4ee0ed900b33 None None] MFA Rules not processed for user `1508d4256b254e5b9a699f2832fc3c09`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:55.665593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ff6e4066-0a2c-48e7-bd36-4ee0ed900b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:55.788213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7874e0b-a49f-4025-89ec-4f910e116cca admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:55.790005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 911/1824] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:55.952273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7874e0b-a49f-4025-89ec-4f910e116cca admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:55.968504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df15c7-a570-4996-923a-984dcd88a5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:55.968504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df15c7-a570-4996-923a-984dcd88a5ca admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:55.968504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df15c7-a570-4996-923a-984dcd88a5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:55.968504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44df15c7-a570-4996-923a-984dcd88a5ca admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:55.968805 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df15c7-a570-4996-923a-984dcd88a5ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:55.981299 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44df15c7-a570-4996-923a-984dcd88a5ca admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:56.174281 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 914/1825] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:55 2022] POST /identity/v3/projects => generated 379 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:10:56.178470 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e4066-0a2c-48e7-bd36-4ee0ed900b33 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:56.244442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e4066-0a2c-48e7-bd36-4ee0ed900b33 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:56.397653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c050d0-fa92-47c6-afaa-c95af76b399e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:56.398743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c050d0-fa92-47c6-afaa-c95af76b399e admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:56.399463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c050d0-fa92-47c6-afaa-c95af76b399e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:56.399951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c050d0-fa92-47c6-afaa-c95af76b399e admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:56.400922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c050d0-fa92-47c6-afaa-c95af76b399e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:56.403870 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c050d0-fa92-47c6-afaa-c95af76b399e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:56.529040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 912/1826] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:56 2022] POST /identity/v3/users => generated 296 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:56.529670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df15c7-a570-4996-923a-984dcd88a5ca admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:56.598685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44df15c7-a570-4996-923a-984dcd88a5ca admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:56.615990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8604ab8-0dd3-444a-835d-8d2a7eeec7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:56.616849 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8604ab8-0dd3-444a-835d-8d2a7eeec7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:56.618551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8604ab8-0dd3-444a-835d-8d2a7eeec7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:56.619414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8604ab8-0dd3-444a-835d-8d2a7eeec7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:56.623398 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8604ab8-0dd3-444a-835d-8d2a7eeec7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:56.647841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8604ab8-0dd3-444a-835d-8d2a7eeec7e0 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:56.671885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 915/1827] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:56.676061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c050d0-fa92-47c6-afaa-c95af76b399e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:56.707337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c050d0-fa92-47c6-afaa-c95af76b399e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:56.712584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc047052-e230-462e-95b7-0c5e443914aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:56.713513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc047052-e230-462e-95b7-0c5e443914aa admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:56.713835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc047052-e230-462e-95b7-0c5e443914aa admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:56.714117 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc047052-e230-462e-95b7-0c5e443914aa admin admin] PATH_INFO: `/v3/projects/a55364f38a6248808100625f44c3a3c4/users/5e16b922a74b462bb3359209abc2def3/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:56.762711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc047052-e230-462e-95b7-0c5e443914aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55364f38a6248808100625f44c3a3c4, user_id=5e16b922a74b462bb3359209abc2def3, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:56.777654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc047052-e230-462e-95b7-0c5e443914aa admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:56.858302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 913/1828] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:56 2022] PUT /identity/v3/projects/a55364f38a6248808100625f44c3a3c4/users/5e16b922a74b462bb3359209abc2def3/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:56.873363 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8604ab8-0dd3-444a-835d-8d2a7eeec7e0 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:56.894184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8604ab8-0dd3-444a-835d-8d2a7eeec7e0 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:57.055168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639388ca-401d-4168-84b6-aab660a260af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:57.063167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639388ca-401d-4168-84b6-aab660a260af admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:57.063829 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639388ca-401d-4168-84b6-aab660a260af admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:57.064274 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639388ca-401d-4168-84b6-aab660a260af admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:57.065218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639388ca-401d-4168-84b6-aab660a260af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:57.067118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639388ca-401d-4168-84b6-aab660a260af admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:57.090590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 916/1829] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:57.092017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc047052-e230-462e-95b7-0c5e443914aa admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:57.107165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc047052-e230-462e-95b7-0c5e443914aa admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:57.112911 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff756905-9fc3-49a8-af42-eb6effc7bf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:57.137825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff756905-9fc3-49a8-af42-eb6effc7bf34 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:57.140389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:57.140389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff756905-9fc3-49a8-af42-eb6effc7bf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:57.144937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff756905-9fc3-49a8-af42-eb6effc7bf34 admin admin] PATH_INFO: `/v3/projects/a55364f38a6248808100625f44c3a3c4/users/5e16b922a74b462bb3359209abc2def3/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:57.148816 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff756905-9fc3-49a8-af42-eb6effc7bf34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55364f38a6248808100625f44c3a3c4, user_id=5e16b922a74b462bb3359209abc2def3, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:57.155995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff756905-9fc3-49a8-af42-eb6effc7bf34 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:57.194796 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 914/1830] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:57 2022] PUT /identity/v3/projects/a55364f38a6248808100625f44c3a3c4/users/5e16b922a74b462bb3359209abc2def3/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:57.209168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9b86f-d07f-4eaa-b636-8cdd5f98490b None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:57.209735 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9b86f-d07f-4eaa-b636-8cdd5f98490b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:57.209849 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b9b86f-d07f-4eaa-b636-8cdd5f98490b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:57.278049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-17b9b86f-d07f-4eaa-b636-8cdd5f98490b None None] MFA Rules not processed for user `5e16b922a74b462bb3359209abc2def3`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:57.281330 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-17b9b86f-d07f-4eaa-b636-8cdd5f98490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:57.438194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff756905-9fc3-49a8-af42-eb6effc7bf34 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:57.440280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ff756905-9fc3-49a8-af42-eb6effc7bf34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:57.449089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 917/1831] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:57 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:57.462917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9b86f-d07f-4eaa-b636-8cdd5f98490b None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:57.466399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-17b9b86f-d07f-4eaa-b636-8cdd5f98490b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:57.607719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff756905-9fc3-49a8-af42-eb6effc7bf34 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:57.620098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b9b86f-d07f-4eaa-b636-8cdd5f98490b None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:57.621778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e1869-03b8-42eb-b894-1df2eb66037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:57.627291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d4b7e-a632-4541-9742-550f5985127a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:57.628026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d4b7e-a632-4541-9742-550f5985127a service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:57.628366 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d4b7e-a632-4541-9742-550f5985127a service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:57.628574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d4b7e-a632-4541-9742-550f5985127a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:57.628853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e1869-03b8-42eb-b894-1df2eb66037b admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:57.629932 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e1869-03b8-42eb-b894-1df2eb66037b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:57.630979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e1869-03b8-42eb-b894-1df2eb66037b admin admin] PATH_INFO: `/v3/projects/c2375f0f841f4e9f872369b3bef546d8` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:57.634218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e1869-03b8-42eb-b894-1df2eb66037b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2375f0f841f4e9f872369b3bef546d8)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:57.637062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e1869-03b8-42eb-b894-1df2eb66037b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:57.643304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d4b7e-a632-4541-9742-550f5985127a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:57.645206 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d4b7e-a632-4541-9742-550f5985127a service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:57.661742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 918/1832] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:57 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:57.887461 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a94e1869-03b8-42eb-b894-1df2eb66037b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2375f0f841f4e9f872369b3bef546d8', 'request_id': 'req-a94e1869-03b8-42eb-b894-1df2eb66037b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:57.895787 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a94e1869-03b8-42eb-b894-1df2eb66037b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2375f0f841f4e9f872369b3bef546d8', 'request_id': 'req-a94e1869-03b8-42eb-b894-1df2eb66037b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:57.914467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a94e1869-03b8-42eb-b894-1df2eb66037b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2375f0f841f4e9f872369b3bef546d8', 'request_id': 'req-a94e1869-03b8-42eb-b894-1df2eb66037b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:57.934048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d4b7e-a632-4541-9742-550f5985127a service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:57.935577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-552d4b7e-a632-4541-9742-550f5985127a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:57.957055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d4b7e-a632-4541-9742-550f5985127a service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:58.106729 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a7f1-76f9-4dc3-9f1b-03b2d56eb366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:58.108356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a7f1-76f9-4dc3-9f1b-03b2d56eb366 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:58.108639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a7f1-76f9-4dc3-9f1b-03b2d56eb366 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:58.108917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a7f1-76f9-4dc3-9f1b-03b2d56eb366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:58.113271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6802a7f1-76f9-4dc3-9f1b-03b2d56eb366 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:58.128725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a94e1869-03b8-42eb-b894-1df2eb66037b admin admin] The token cache is being invalidate because project c2375f0f841f4e9f872369b3bef546d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:10:58.132734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a94e1869-03b8-42eb-b894-1df2eb66037b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:58.134202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a94e1869-03b8-42eb-b894-1df2eb66037b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:10:58.136434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 915/1833] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:10:57 2022] DELETE /identity/v3/projects/c2375f0f841f4e9f872369b3bef546d8 => generated 0 bytes in 699 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:58.141141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d0030-b7ef-4f56-b26e-32da33e1a939 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:58.141352 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d0030-b7ef-4f56-b26e-32da33e1a939 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:58.141695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d0030-b7ef-4f56-b26e-32da33e1a939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:58.172444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-5b1d0030-b7ef-4f56-b26e-32da33e1a939 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:58.173945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5b1d0030-b7ef-4f56-b26e-32da33e1a939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:58.272664 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:10:58.282808 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a7f1-76f9-4dc3-9f1b-03b2d56eb366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:58.282808 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a7f1-76f9-4dc3-9f1b-03b2d56eb366 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:58.307390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 919/1834] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:10:57 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:10:58.347727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 916/1835] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:10:58.355661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb5db1-1213-4ec2-899b-fc568f898865 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:58.356415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb5db1-1213-4ec2-899b-fc568f898865 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:58.356929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb5db1-1213-4ec2-899b-fc568f898865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:58.400143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-69cb5db1-1213-4ec2-899b-fc568f898865 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:58.407769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-69cb5db1-1213-4ec2-899b-fc568f898865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:58.419632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 920/1836] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:58.427227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d0030-b7ef-4f56-b26e-32da33e1a939 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:58.439036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d0030-b7ef-4f56-b26e-32da33e1a939 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:58.444729 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7e927-c7a8-451b-931c-082f4dcf7615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:58.446118 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e927-c7a8-451b-931c-082f4dcf7615 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:58.446580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e927-c7a8-451b-931c-082f4dcf7615 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:58.448411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7e927-c7a8-451b-931c-082f4dcf7615 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:58.449415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7e927-c7a8-451b-931c-082f4dcf7615 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:10:58.449940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7e927-c7a8-451b-931c-082f4dcf7615 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:58.452200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7e927-c7a8-451b-931c-082f4dcf7615 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:58.489835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb5db1-1213-4ec2-899b-fc568f898865 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:58.491773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 917/1837] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:10:58.506579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb5db1-1213-4ec2-899b-fc568f898865 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:58.520419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84d75b-f2ac-4644-aa07-8d40f3135b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:58.521243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84d75b-f2ac-4644-aa07-8d40f3135b9c admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:58.521529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84d75b-f2ac-4644-aa07-8d40f3135b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:58.521810 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff84d75b-f2ac-4644-aa07-8d40f3135b9c admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:58.522769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84d75b-f2ac-4644-aa07-8d40f3135b9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:58.525642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff84d75b-f2ac-4644-aa07-8d40f3135b9c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:58.809846 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 921/1838] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:58 2022] POST /identity/v3/projects => generated 381 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:10:58.814774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7e927-c7a8-451b-931c-082f4dcf7615 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:58.830166 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7e927-c7a8-451b-931c-082f4dcf7615 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:58.930837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35078818-6279-4262-8de1-51adbb1fab40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:58.932438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35078818-6279-4262-8de1-51adbb1fab40 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:58.932956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35078818-6279-4262-8de1-51adbb1fab40 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:58.933452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35078818-6279-4262-8de1-51adbb1fab40 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:58.934363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35078818-6279-4262-8de1-51adbb1fab40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:58.937107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35078818-6279-4262-8de1-51adbb1fab40 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:59.084112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 918/1839] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:58 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:59.090781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84d75b-f2ac-4644-aa07-8d40f3135b9c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:59.107673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff84d75b-f2ac-4644-aa07-8d40f3135b9c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:59.113998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e5d72-219f-4d2e-b6b1-bc2ca99aeea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:59.114995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e5d72-219f-4d2e-b6b1-bc2ca99aeea7 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:59.126084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e5d72-219f-4d2e-b6b1-bc2ca99aeea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:59.126620 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806e5d72-219f-4d2e-b6b1-bc2ca99aeea7 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:59.127433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e5d72-219f-4d2e-b6b1-bc2ca99aeea7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:59.129164 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806e5d72-219f-4d2e-b6b1-bc2ca99aeea7 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:59.161186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 922/1840] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:59.165020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35078818-6279-4262-8de1-51adbb1fab40 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:59.185209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35078818-6279-4262-8de1-51adbb1fab40 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:59.195168 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97187f24-1b05-4e63-8c48-bbbfb393c79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:59.195948 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97187f24-1b05-4e63-8c48-bbbfb393c79f admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:59.196230 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97187f24-1b05-4e63-8c48-bbbfb393c79f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:59.196689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97187f24-1b05-4e63-8c48-bbbfb393c79f admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:59.200128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97187f24-1b05-4e63-8c48-bbbfb393c79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:59.206074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97187f24-1b05-4e63-8c48-bbbfb393c79f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:59.227504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 919/1841] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:10:59.232963 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e5d72-219f-4d2e-b6b1-bc2ca99aeea7 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:59.255424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806e5d72-219f-4d2e-b6b1-bc2ca99aeea7 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:59.281297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f56fc-81a7-4f54-8220-b0c91bab0ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:59.281297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f56fc-81a7-4f54-8220-b0c91bab0ab2 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:59.281297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f56fc-81a7-4f54-8220-b0c91bab0ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:59.281297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797f56fc-81a7-4f54-8220-b0c91bab0ab2 admin admin] PATH_INFO: `/v3/projects/47691e1b911b42ce88555b68254849aa/users/50366ffc0bba41e18ab1999566dd0afa/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:59.325884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f56fc-81a7-4f54-8220-b0c91bab0ab2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47691e1b911b42ce88555b68254849aa, user_id=50366ffc0bba41e18ab1999566dd0afa, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:59.330186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797f56fc-81a7-4f54-8220-b0c91bab0ab2 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:59.537050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 923/1842] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:10:59 2022] PUT /identity/v3/projects/47691e1b911b42ce88555b68254849aa/users/50366ffc0bba41e18ab1999566dd0afa/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:10:59.548207 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ccd5d-2773-454e-bd94-d8a2a4941ad0 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:59.549224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ccd5d-2773-454e-bd94-d8a2a4941ad0 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:59.549750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ccd5d-2773-454e-bd94-d8a2a4941ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:59.603715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-406ccd5d-2773-454e-bd94-d8a2a4941ad0 None None] MFA Rules not processed for user `50366ffc0bba41e18ab1999566dd0afa`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:10:59.605939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-406ccd5d-2773-454e-bd94-d8a2a4941ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:10:59.708587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 920/1843] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:10:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:10:59.709796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f56fc-81a7-4f54-8220-b0c91bab0ab2 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:59.796705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797f56fc-81a7-4f54-8220-b0c91bab0ab2 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:10:59.801696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36be54-0cb1-4fc3-9823-80c56a5a8361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:10:59.802504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36be54-0cb1-4fc3-9823-80c56a5a8361 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:10:59.803249 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36be54-0cb1-4fc3-9823-80c56a5a8361 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:10:59.803599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff36be54-0cb1-4fc3-9823-80c56a5a8361 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:10:59.804996 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36be54-0cb1-4fc3-9823-80c56a5a8361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:10:59.807194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff36be54-0cb1-4fc3-9823-80c56a5a8361 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:10:59.972243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 924/1844] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:10:59 2022] POST /identity/v3/projects => generated 379 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:10:59.976912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ccd5d-2773-454e-bd94-d8a2a4941ad0 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:10:59.992014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ccd5d-2773-454e-bd94-d8a2a4941ad0 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:00.022001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:00.100149 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66009bd3-5e33-4c70-a791-cabcdf710c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:00.102013 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009bd3-5e33-4c70-a791-cabcdf710c7f admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:00.102346 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009bd3-5e33-4c70-a791-cabcdf710c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:00.112831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009bd3-5e33-4c70-a791-cabcdf710c7f admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:00.115909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66009bd3-5e33-4c70-a791-cabcdf710c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:00.115909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66009bd3-5e33-4c70-a791-cabcdf710c7f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:00.273964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 921/1845] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:10:59 2022] POST /identity/v3/users => generated 296 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:11:00.278178 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36be54-0cb1-4fc3-9823-80c56a5a8361 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:00.288651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff36be54-0cb1-4fc3-9823-80c56a5a8361 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:00.293258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56c4b4-1fba-4b12-be85-42114451120f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:00.293968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56c4b4-1fba-4b12-be85-42114451120f admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:00.294265 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56c4b4-1fba-4b12-be85-42114451120f admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:00.294533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56c4b4-1fba-4b12-be85-42114451120f admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:00.295283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56c4b4-1fba-4b12-be85-42114451120f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:00.296926 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b56c4b4-1fba-4b12-be85-42114451120f admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:00.310439 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 925/1846] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:00.313819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66009bd3-5e33-4c70-a791-cabcdf710c7f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:00.326313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66009bd3-5e33-4c70-a791-cabcdf710c7f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:00.333617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcca213-c2e3-42a7-ba07-534da5916112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:00.334240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcca213-c2e3-42a7-ba07-534da5916112 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:00.334544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcca213-c2e3-42a7-ba07-534da5916112 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:00.334788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcca213-c2e3-42a7-ba07-534da5916112 admin admin] PATH_INFO: `/v3/projects/527a0fdf00db4b4990c5ebd76c6199a1/users/b870d661ef594c57aca0c5f35d45e432/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:00.352124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcca213-c2e3-42a7-ba07-534da5916112 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527a0fdf00db4b4990c5ebd76c6199a1, user_id=b870d661ef594c57aca0c5f35d45e432, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:00.354806 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcca213-c2e3-42a7-ba07-534da5916112 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:00.466230 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 922/1847] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:00 2022] PUT /identity/v3/projects/527a0fdf00db4b4990c5ebd76c6199a1/users/b870d661ef594c57aca0c5f35d45e432/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:00.470265 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56c4b4-1fba-4b12-be85-42114451120f admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:00.480342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b56c4b4-1fba-4b12-be85-42114451120f admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:00.535569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1c0e8-ccfb-4e0c-8dd2-6b9eb2f1a04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:00.536270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1c0e8-ccfb-4e0c-8dd2-6b9eb2f1a04c admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:00.536557 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1c0e8-ccfb-4e0c-8dd2-6b9eb2f1a04c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:00.536837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1c0e8-ccfb-4e0c-8dd2-6b9eb2f1a04c admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:00.537750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1c0e8-ccfb-4e0c-8dd2-6b9eb2f1a04c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:00.539426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1c0e8-ccfb-4e0c-8dd2-6b9eb2f1a04c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:00.549674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 926/1848] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:00.554016 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcca213-c2e3-42a7-ba07-534da5916112 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:00.565363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcca213-c2e3-42a7-ba07-534da5916112 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:00.570276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69413e89-2c95-4cef-8969-6f839f9da6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:00.571166 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69413e89-2c95-4cef-8969-6f839f9da6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:00.571459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69413e89-2c95-4cef-8969-6f839f9da6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:00.571784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69413e89-2c95-4cef-8969-6f839f9da6d7 admin admin] PATH_INFO: `/v3/projects/527a0fdf00db4b4990c5ebd76c6199a1/users/b870d661ef594c57aca0c5f35d45e432/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:00.574791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69413e89-2c95-4cef-8969-6f839f9da6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=527a0fdf00db4b4990c5ebd76c6199a1, user_id=b870d661ef594c57aca0c5f35d45e432, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:00.577913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69413e89-2c95-4cef-8969-6f839f9da6d7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:00.588866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 923/1849] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:00 2022] PUT /identity/v3/projects/527a0fdf00db4b4990c5ebd76c6199a1/users/b870d661ef594c57aca0c5f35d45e432/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:00.599310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6ea5c-c2a9-4861-b4b1-67274e70a4a2 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:00.599592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6ea5c-c2a9-4861-b4b1-67274e70a4a2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:00.599900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6ea5c-c2a9-4861-b4b1-67274e70a4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:00.628073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5dc6ea5c-c2a9-4861-b4b1-67274e70a4a2 None None] MFA Rules not processed for user `b870d661ef594c57aca0c5f35d45e432`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:00.629291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5dc6ea5c-c2a9-4861-b4b1-67274e70a4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:00.671279 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:00.706668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 927/1850] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:00.718682 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69413e89-2c95-4cef-8969-6f839f9da6d7 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:00.720635 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-69413e89-2c95-4cef-8969-6f839f9da6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:00.796565 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69413e89-2c95-4cef-8969-6f839f9da6d7 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:00.800713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2fccb-dce2-4573-a635-87d47b579e86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:00.801382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2fccb-dce2-4573-a635-87d47b579e86 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:00.801670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2fccb-dce2-4573-a635-87d47b579e86 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:00.801950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac2fccb-dce2-4573-a635-87d47b579e86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:00.813664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2fccb-dce2-4573-a635-87d47b579e86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:00.816307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac2fccb-dce2-4573-a635-87d47b579e86 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:00.828569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 924/1851] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:00.937621 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6ea5c-c2a9-4861-b4b1-67274e70a4a2 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:00.951279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6ea5c-c2a9-4861-b4b1-67274e70a4a2 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:00.958366 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e880-7d6b-447f-a17d-6af1e1c5da0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:00.958954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e880-7d6b-447f-a17d-6af1e1c5da0d service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:00.959309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e880-7d6b-447f-a17d-6af1e1c5da0d service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:00.960481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7e880-7d6b-447f-a17d-6af1e1c5da0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:01.051783 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7e880-7d6b-447f-a17d-6af1e1c5da0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:01.053666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7e880-7d6b-447f-a17d-6af1e1c5da0d service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:01.071244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 928/1852] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:00 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:04.438149 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2fccb-dce2-4573-a635-87d47b579e86 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:04.439973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8ac2fccb-dce2-4573-a635-87d47b579e86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:04.511265 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac2fccb-dce2-4573-a635-87d47b579e86 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:04.516316 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:04.517183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:04.517468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:04.517745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] PATH_INFO: `/v3/users/3dc798b6d32147da958e9bfba8b222d4` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:04.518979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dc798b6d32147da958e9bfba8b222d4)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:04.521245 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:04.569894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:04.592096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e880-7d6b-447f-a17d-6af1e1c5da0d service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:04.593578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c0b7e880-7d6b-447f-a17d-6af1e1c5da0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:04.607368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7e880-7d6b-447f-a17d-6af1e1c5da0d service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:04.611953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d35e134-d091-4f07-a863-93f47c3d3762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:04.612874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e134-d091-4f07-a863-93f47c3d3762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:04.613157 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e134-d091-4f07-a863-93f47c3d3762 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:04.613430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d35e134-d091-4f07-a863-93f47c3d3762 admin admin] PATH_INFO: `/v3/users/a138042647a147d992d5d173a550daa3` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:04.614620 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35e134-d091-4f07-a863-93f47c3d3762 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a138042647a147d992d5d173a550daa3)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:04.616567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d35e134-d091-4f07-a863-93f47c3d3762 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:04.746170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dc798b6d32147da958e9bfba8b222d4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:04.746972 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dc798b6d32147da958e9bfba8b222d4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:04.748466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dc798b6d32147da958e9bfba8b222d4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:04.852373 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dc798b6d32147da958e9bfba8b222d4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:04.874490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dc798b6d32147da958e9bfba8b222d4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:04.908526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 925/1853] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:04 2022] DELETE /identity/v3/users/3dc798b6d32147da958e9bfba8b222d4 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:04.910122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:04.912777 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:04.987760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-6d35e134-d091-4f07-a863-93f47c3d3762 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a138042647a147d992d5d173a550daa3'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:05.003252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-6d35e134-d091-4f07-a863-93f47c3d3762 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a138042647a147d992d5d173a550daa3'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:05.004401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-6d35e134-d091-4f07-a863-93f47c3d3762 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a138042647a147d992d5d173a550daa3'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:05.005194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-6d35e134-d091-4f07-a863-93f47c3d3762 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a138042647a147d992d5d173a550daa3'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:05.035114 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b876380-16c8-4483-acbc-27914a6b7c32 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:05.044190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:05.045640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:05.046152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:05.046679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] PATH_INFO: `/v3/users/50366ffc0bba41e18ab1999566dd0afa` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:05.048994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] RBAC: Authorizing `identity:delete_user(user_id=50366ffc0bba41e18ab1999566dd0afa)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:05.052132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:05.208142 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-6d35e134-d091-4f07-a863-93f47c3d3762 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a138042647a147d992d5d173a550daa3'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:05.234267 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 929/1854] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:04 2022] DELETE /identity/v3/users/a138042647a147d992d5d173a550daa3 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:11:05.236022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac7b32-386f-4f37-b8b3-8877463ffeff None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:05.236534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac7b32-386f-4f37-b8b3-8877463ffeff None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:05.237043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac7b32-386f-4f37-b8b3-8877463ffeff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:05.254670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-36ac7b32-386f-4f37-b8b3-8877463ffeff None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:05.256066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-36ac7b32-386f-4f37-b8b3-8877463ffeff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:05.343553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 930/1855] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:05.343553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a06c-8e46-4e69-9ec1-88f8fe57abdd None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:05.343553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a06c-8e46-4e69-9ec1-88f8fe57abdd None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:05.343553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b5a06c-8e46-4e69-9ec1-88f8fe57abdd None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:05.343553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 931/1856] 10.222.0.52 () {54 vars in 921 bytes} [Thu Jun 23 11:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:11:05.343553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff235c62-e224-4aeb-90bc-37e6e140e835 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:05.343553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff235c62-e224-4aeb-90bc-37e6e140e835 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:05.344179 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff235c62-e224-4aeb-90bc-37e6e140e835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:05.359791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-ff235c62-e224-4aeb-90bc-37e6e140e835 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:05.361293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ff235c62-e224-4aeb-90bc-37e6e140e835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:05.372264 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 932/1857] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:05.372264 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff235c62-e224-4aeb-90bc-37e6e140e835 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:05.372264 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ff235c62-e224-4aeb-90bc-37e6e140e835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:05.438887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff235c62-e224-4aeb-90bc-37e6e140e835 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:05.443245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2785ed-8fb6-4b9d-9d38-3354db93a6e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:05.443375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50366ffc0bba41e18ab1999566dd0afa'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:05.444071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50366ffc0bba41e18ab1999566dd0afa'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:05.444169 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2785ed-8fb6-4b9d-9d38-3354db93a6e9 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:05.444357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2785ed-8fb6-4b9d-9d38-3354db93a6e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:05.444639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2785ed-8fb6-4b9d-9d38-3354db93a6e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:05.444928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50366ffc0bba41e18ab1999566dd0afa'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:05.447218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4b2785ed-8fb6-4b9d-9d38-3354db93a6e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:05.460402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2785ed-8fb6-4b9d-9d38-3354db93a6e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:05.462906 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2785ed-8fb6-4b9d-9d38-3354db93a6e9 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:05.481659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 933/1858] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:05.482957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa9655-fe75-413e-802c-78509df56dd5 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:05.483247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa9655-fe75-413e-802c-78509df56dd5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:05.483526 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa9655-fe75-413e-802c-78509df56dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:05.503438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-14aa9655-fe75-413e-802c-78509df56dd5 None None] MFA Rules not processed for user `a020e7fe06574a108b46f9f48bddc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:05.504703 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-14aa9655-fe75-413e-802c-78509df56dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:05.567523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50366ffc0bba41e18ab1999566dd0afa'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:05.575844 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 934/1859] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Jun 23 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:05.575844 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa9655-fe75-413e-802c-78509df56dd5 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:05.576447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50366ffc0bba41e18ab1999566dd0afa'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:05.576760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-14aa9655-fe75-413e-802c-78509df56dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:05.591654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa9655-fe75-413e-802c-78509df56dd5 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:05.595386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80aad09-a4fb-462a-8549-69f92f231a0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:05.596129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aad09-a4fb-462a-8549-69f92f231a0e service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:05.596444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aad09-a4fb-462a-8549-69f92f231a0e service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:05.602577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80aad09-a4fb-462a-8549-69f92f231a0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:05.602577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f80aad09-a4fb-462a-8549-69f92f231a0e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:05.602745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 926/1860] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:04 2022] DELETE /identity/v3/users/50366ffc0bba41e18ab1999566dd0afa => generated 0 bytes in 693 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:05.602745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:05.605874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:05.613956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aad09-a4fb-462a-8549-69f92f231a0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:05.615404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80aad09-a4fb-462a-8549-69f92f231a0e service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:05.625518 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 935/1861] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:05.626810 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0fe8a-1075-4325-abd7-996476afecd6 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:05.627102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0fe8a-1075-4325-abd7-996476afecd6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:05.627384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c0fe8a-1075-4325-abd7-996476afecd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:05.650074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-d3c0fe8a-1075-4325-abd7-996476afecd6 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:05.651730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d3c0fe8a-1075-4325-abd7-996476afecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:05.702271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b23b3-df1c-4f3f-bd7e-6c00a374e60b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:05.708326 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50404908-b9e8-461e-b2a3-daebd8debb87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:05.708990 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50404908-b9e8-461e-b2a3-daebd8debb87 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:05.709279 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50404908-b9e8-461e-b2a3-daebd8debb87 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:05.709566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50404908-b9e8-461e-b2a3-daebd8debb87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:05.723021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50404908-b9e8-461e-b2a3-daebd8debb87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:05.723021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50404908-b9e8-461e-b2a3-daebd8debb87 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:05.734306 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 927/1862] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:05.763857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 936/1863] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:05.776808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50404908-b9e8-461e-b2a3-daebd8debb87 service nova] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:05.844059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50404908-b9e8-461e-b2a3-daebd8debb87 service nova] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:05.864973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cce0d-63f6-435f-8994-1e3f008604ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:05.865815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cce0d-63f6-435f-8994-1e3f008604ed service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:05.866122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cce0d-63f6-435f-8994-1e3f008604ed service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:05.866357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72cce0d-63f6-435f-8994-1e3f008604ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:05.885090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cce0d-63f6-435f-8994-1e3f008604ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:05.887349 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72cce0d-63f6-435f-8994-1e3f008604ed service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:05.907254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 928/1864] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:06.211008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0fe8a-1075-4325-abd7-996476afecd6 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:06.213586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d3c0fe8a-1075-4325-abd7-996476afecd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:06.227314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c0fe8a-1075-4325-abd7-996476afecd6 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:06.233285 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:06.234258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:06.234601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:06.234997 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] PATH_INFO: `/v3/projects/d60215e6349a42639c092279ed73c2f2` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:06.236369 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60215e6349a42639c092279ed73c2f2)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:06.239626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:06.312523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cce0d-63f6-435f-8994-1e3f008604ed service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:06.314352 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f72cce0d-63f6-435f-8994-1e3f008604ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:06.330963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72cce0d-63f6-435f-8994-1e3f008604ed service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:06.337476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:06.338778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:06.339309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:06.339671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] PATH_INFO: `/v3/projects/1a15cc9d17084300b9a76781335fc257` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:06.341044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a15cc9d17084300b9a76781335fc257)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:06.343224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:06.410721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60215e6349a42639c092279ed73c2f2', 'request_id': 'req-41c72aab-cb0b-41e6-996d-d5c5c42b4369'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.418600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60215e6349a42639c092279ed73c2f2', 'request_id': 'req-41c72aab-cb0b-41e6-996d-d5c5c42b4369'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.427349 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60215e6349a42639c092279ed73c2f2', 'request_id': 'req-41c72aab-cb0b-41e6-996d-d5c5c42b4369'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.507697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] The token cache is being invalidate because project d60215e6349a42639c092279ed73c2f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:06.507955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.510577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.511912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 937/1865] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:06 2022] DELETE /identity/v3/projects/d60215e6349a42639c092279ed73c2f2 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:06.516188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:06.517605 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:06.527113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a15cc9d17084300b9a76781335fc257', 'request_id': 'req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.536003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a15cc9d17084300b9a76781335fc257', 'request_id': 'req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.543192 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a15cc9d17084300b9a76781335fc257', 'request_id': 'req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.609438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c72aab-cb0b-41e6-996d-d5c5c42b4369 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:06.621799 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] The token cache is being invalidate because project 1a15cc9d17084300b9a76781335fc257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:06.622176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.623123 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.625860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 929/1866] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:06 2022] DELETE /identity/v3/projects/1a15cc9d17084300b9a76781335fc257 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:06.626691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:06.631758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:06.714450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47be6c00-21e0-4232-8e4a-7c8f1c94ea79 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:06.720273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:06.727954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:06.727954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:06.727954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] PATH_INFO: `/v3/projects/47691e1b911b42ce88555b68254849aa` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:06.727954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] RBAC: Authorizing `identity:delete_project(project_id=47691e1b911b42ce88555b68254849aa)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:06.727954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:06.731656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:06.732841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:06.733126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:06.733408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] PATH_INFO: `/v3/users/2d78300e59a6445097f8dded37326bee` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:06.734912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d78300e59a6445097f8dded37326bee)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:06.737353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:06.861597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47691e1b911b42ce88555b68254849aa', 'request_id': 'req-efeb88c5-64a7-4c8b-9a02-c587aa760ada'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.867785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47691e1b911b42ce88555b68254849aa', 'request_id': 'req-efeb88c5-64a7-4c8b-9a02-c587aa760ada'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.876890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47691e1b911b42ce88555b68254849aa', 'request_id': 'req-efeb88c5-64a7-4c8b-9a02-c587aa760ada'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.986914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] The token cache is being invalidate because project 47691e1b911b42ce88555b68254849aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:06.987218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.988901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:06.994801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 930/1867] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:06 2022] DELETE /identity/v3/projects/47691e1b911b42ce88555b68254849aa => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:06.994801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:06.998920 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:07.004222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d78300e59a6445097f8dded37326bee'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.020031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d78300e59a6445097f8dded37326bee'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.021129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d78300e59a6445097f8dded37326bee'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.021768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d78300e59a6445097f8dded37326bee'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.068756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb88c5-64a7-4c8b-9a02-c587aa760ada admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:07.074514 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:07.075502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:07.075796 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:07.076112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] PATH_INFO: `/v3/users/1508d4256b254e5b9a699f2832fc3c09` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:07.077410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1508d4256b254e5b9a699f2832fc3c09)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:07.079363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:07.118461 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:07.147016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d78300e59a6445097f8dded37326bee'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.161750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 938/1868] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:06 2022] DELETE /identity/v3/users/2d78300e59a6445097f8dded37326bee => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:11:07.162505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:07.163880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:07.242206 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db78d6-cffe-4dc5-b2c1-349abfb4c60e admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:07.248888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9691e-5d76-4799-b3a2-16fdc888ca01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:07.250846 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9691e-5d76-4799-b3a2-16fdc888ca01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:07.251297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9691e-5d76-4799-b3a2-16fdc888ca01 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:07.252216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9691e-5d76-4799-b3a2-16fdc888ca01 admin admin] PATH_INFO: `/v3/users/63443afbae8e4d4c9e9187ef17bd6591` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:07.253563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9691e-5d76-4799-b3a2-16fdc888ca01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63443afbae8e4d4c9e9187ef17bd6591)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:07.256224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9691e-5d76-4799-b3a2-16fdc888ca01 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:07.371752 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1508d4256b254e5b9a699f2832fc3c09'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.372356 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1508d4256b254e5b9a699f2832fc3c09'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.372993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1508d4256b254e5b9a699f2832fc3c09'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.489606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1508d4256b254e5b9a699f2832fc3c09'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.498600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1508d4256b254e5b9a699f2832fc3c09'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.521379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-81a9691e-5d76-4799-b3a2-16fdc888ca01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63443afbae8e4d4c9e9187ef17bd6591'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.529785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 931/1869] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:06 2022] DELETE /identity/v3/users/1508d4256b254e5b9a699f2832fc3c09 => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:07.534721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-81a9691e-5d76-4799-b3a2-16fdc888ca01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63443afbae8e4d4c9e9187ef17bd6591'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.535510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-81a9691e-5d76-4799-b3a2-16fdc888ca01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63443afbae8e4d4c9e9187ef17bd6591'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.536145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-81a9691e-5d76-4799-b3a2-16fdc888ca01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63443afbae8e4d4c9e9187ef17bd6591'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.546174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:07.548500 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:07.622103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-81a9691e-5d76-4799-b3a2-16fdc888ca01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63443afbae8e4d4c9e9187ef17bd6591'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.628793 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5834c5d7-e691-4e5d-95d4-aee3867f9131 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:07.634162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8189d-cf8a-441e-b2d4-5b6cda7a1241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:07.635748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8189d-cf8a-441e-b2d4-5b6cda7a1241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:07.636208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8189d-cf8a-441e-b2d4-5b6cda7a1241 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:07.636642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8189d-cf8a-441e-b2d4-5b6cda7a1241 admin admin] PATH_INFO: `/v3/users/b870d661ef594c57aca0c5f35d45e432` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:07.638080 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8189d-cf8a-441e-b2d4-5b6cda7a1241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b870d661ef594c57aca0c5f35d45e432)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:07.640379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d8189d-cf8a-441e-b2d4-5b6cda7a1241 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:07.645523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 939/1870] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:07 2022] DELETE /identity/v3/users/63443afbae8e4d4c9e9187ef17bd6591 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:07.651184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f517f-bad4-41a6-a82a-06bca9e71a17 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:07.651498 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f517f-bad4-41a6-a82a-06bca9e71a17 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:07.652024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f517f-bad4-41a6-a82a-06bca9e71a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:07.677122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4d5f517f-bad4-41a6-a82a-06bca9e71a17 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:07.678400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4d5f517f-bad4-41a6-a82a-06bca9e71a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:07.750385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 940/1871] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:07.771372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f517f-bad4-41a6-a82a-06bca9e71a17 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:07.773241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4d5f517f-bad4-41a6-a82a-06bca9e71a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:07.862881 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f517f-bad4-41a6-a82a-06bca9e71a17 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:07.866794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45096b2-6dd5-4c99-9135-f19e3707de24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:07.867438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45096b2-6dd5-4c99-9135-f19e3707de24 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:07.867718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45096b2-6dd5-4c99-9135-f19e3707de24 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:07.868021 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45096b2-6dd5-4c99-9135-f19e3707de24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:07.879014 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45096b2-6dd5-4c99-9135-f19e3707de24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:07.880971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45096b2-6dd5-4c99-9135-f19e3707de24 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:07.892288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 941/1872] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:07.893156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45096b2-6dd5-4c99-9135-f19e3707de24 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:07.894691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c45096b2-6dd5-4c99-9135-f19e3707de24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:07.908602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45096b2-6dd5-4c99-9135-f19e3707de24 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:07.911989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-38d8189d-cf8a-441e-b2d4-5b6cda7a1241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b870d661ef594c57aca0c5f35d45e432'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.913653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-38d8189d-cf8a-441e-b2d4-5b6cda7a1241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b870d661ef594c57aca0c5f35d45e432'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.914238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341616d-f9eb-4e65-88ea-003b01944e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:07.914824 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-38d8189d-cf8a-441e-b2d4-5b6cda7a1241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b870d661ef594c57aca0c5f35d45e432'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:07.915317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341616d-f9eb-4e65-88ea-003b01944e24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:07.915761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341616d-f9eb-4e65-88ea-003b01944e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:07.916074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341616d-f9eb-4e65-88ea-003b01944e24 admin admin] PATH_INFO: `/v3/projects/588b97e95f684291905e08895ddb6236` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:07.918200 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341616d-f9eb-4e65-88ea-003b01944e24 admin admin] RBAC: Authorizing `identity:delete_project(project_id=588b97e95f684291905e08895ddb6236)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:07.920259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341616d-f9eb-4e65-88ea-003b01944e24 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:08.026925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-38d8189d-cf8a-441e-b2d4-5b6cda7a1241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b870d661ef594c57aca0c5f35d45e432'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.037034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-38d8189d-cf8a-441e-b2d4-5b6cda7a1241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b870d661ef594c57aca0c5f35d45e432'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.048726 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f341616d-f9eb-4e65-88ea-003b01944e24 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588b97e95f684291905e08895ddb6236', 'request_id': 'req-f341616d-f9eb-4e65-88ea-003b01944e24'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.055424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f341616d-f9eb-4e65-88ea-003b01944e24 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588b97e95f684291905e08895ddb6236', 'request_id': 'req-f341616d-f9eb-4e65-88ea-003b01944e24'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.056799 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 932/1873] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:07 2022] DELETE /identity/v3/users/b870d661ef594c57aca0c5f35d45e432 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:08.064695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f341616d-f9eb-4e65-88ea-003b01944e24 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588b97e95f684291905e08895ddb6236', 'request_id': 'req-f341616d-f9eb-4e65-88ea-003b01944e24'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.198271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f341616d-f9eb-4e65-88ea-003b01944e24 admin admin] The token cache is being invalidate because project 588b97e95f684291905e08895ddb6236 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:08.198567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f341616d-f9eb-4e65-88ea-003b01944e24 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.199303 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f341616d-f9eb-4e65-88ea-003b01944e24 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.205392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 942/1874] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:07 2022] DELETE /identity/v3/projects/588b97e95f684291905e08895ddb6236 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:08.207353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b008b6-21ea-4e41-a1fd-626de7d57c4d None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:08.207661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b008b6-21ea-4e41-a1fd-626de7d57c4d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:08.208002 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b008b6-21ea-4e41-a1fd-626de7d57c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:08.227543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-71b008b6-21ea-4e41-a1fd-626de7d57c4d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:08.228825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-71b008b6-21ea-4e41-a1fd-626de7d57c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:08.289887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 933/1875] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:08.298543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33e73-21d0-4455-8930-6ab61db1e21b None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:08.298900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33e73-21d0-4455-8930-6ab61db1e21b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:08.299104 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c33e73-21d0-4455-8930-6ab61db1e21b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:08.300876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b008b6-21ea-4e41-a1fd-626de7d57c4d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:08.302483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-71b008b6-21ea-4e41-a1fd-626de7d57c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:08.315478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b008b6-21ea-4e41-a1fd-626de7d57c4d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:08.330925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-e2c33e73-21d0-4455-8930-6ab61db1e21b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:08.335635 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:08.336234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e2c33e73-21d0-4455-8930-6ab61db1e21b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:08.343271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:08.343653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:08.344056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] PATH_INFO: `/v3/projects/c7ba7aab26584f31b3fa5bac49f18489` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:08.347160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7ba7aab26584f31b3fa5bac49f18489)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:08.349886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:08.351121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 943/1876] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:08.355696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33e73-21d0-4455-8930-6ab61db1e21b None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:08.369553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c33e73-21d0-4455-8930-6ab61db1e21b None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:08.380069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcb51e-14fa-4207-9c45-6f89cecc0c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:08.382336 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcb51e-14fa-4207-9c45-6f89cecc0c58 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:08.383229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcb51e-14fa-4207-9c45-6f89cecc0c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:08.383617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dcb51e-14fa-4207-9c45-6f89cecc0c58 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:08.386433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcb51e-14fa-4207-9c45-6f89cecc0c58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:08.386863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcb51e-14fa-4207-9c45-6f89cecc0c58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:08.389111 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dcb51e-14fa-4207-9c45-6f89cecc0c58 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:08.407844 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 944/1877] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:08.412589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcb51e-14fa-4207-9c45-6f89cecc0c58 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:08.423788 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dcb51e-14fa-4207-9c45-6f89cecc0c58 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:08.429184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1eb1b-3c38-477e-be3f-5c6286950dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:08.429861 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1eb1b-3c38-477e-be3f-5c6286950dbb admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:08.430148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1eb1b-3c38-477e-be3f-5c6286950dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:08.430452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c1eb1b-3c38-477e-be3f-5c6286950dbb admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:08.432296 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1eb1b-3c38-477e-be3f-5c6286950dbb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:08.433404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c1eb1b-3c38-477e-be3f-5c6286950dbb admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:08.503901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7ba7aab26584f31b3fa5bac49f18489', 'request_id': 'req-9e090de0-295d-44f3-b46a-008dd1f3e0f5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.511222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7ba7aab26584f31b3fa5bac49f18489', 'request_id': 'req-9e090de0-295d-44f3-b46a-008dd1f3e0f5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.518921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7ba7aab26584f31b3fa5bac49f18489', 'request_id': 'req-9e090de0-295d-44f3-b46a-008dd1f3e0f5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.525547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 945/1878] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:08 2022] POST /identity/v3/projects => generated 369 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:11:08.527357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1eb1b-3c38-477e-be3f-5c6286950dbb admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:08.529105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-14c1eb1b-3c38-477e-be3f-5c6286950dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:08.600189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c1eb1b-3c38-477e-be3f-5c6286950dbb admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:08.605071 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:08.606003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:08.606286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:08.606621 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] PATH_INFO: `/v3/projects/6294c1793dcc46418a8d08ef77862cb7` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:08.607856 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6294c1793dcc46418a8d08ef77862cb7)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:08.609810 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:08.655551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] The token cache is being invalidate because project c7ba7aab26584f31b3fa5bac49f18489 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:08.655551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.656164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.657867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 934/1879] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:08 2022] DELETE /identity/v3/projects/c7ba7aab26584f31b3fa5bac49f18489 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:08.658817 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:08.660395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:08.678360 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:08.731453 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e090de0-295d-44f3-b46a-008dd1f3e0f5 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:08.737090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc5883-5875-4703-afb7-71fba89ecf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:08.739467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc5883-5875-4703-afb7-71fba89ecf08 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:08.739467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc5883-5875-4703-afb7-71fba89ecf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:08.739467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbc5883-5875-4703-afb7-71fba89ecf08 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:08.739467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc5883-5875-4703-afb7-71fba89ecf08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:08.741475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbc5883-5875-4703-afb7-71fba89ecf08 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:08.756840 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6294c1793dcc46418a8d08ef77862cb7', 'request_id': 'req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.763352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6294c1793dcc46418a8d08ef77862cb7', 'request_id': 'req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.769865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6294c1793dcc46418a8d08ef77862cb7', 'request_id': 'req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.849842 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 935/1880] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:08 2022] POST /identity/v3/users => generated 285 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:08.853530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc5883-5875-4703-afb7-71fba89ecf08 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:08.853530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7dbc5883-5875-4703-afb7-71fba89ecf08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:08.863100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] The token cache is being invalidate because project 6294c1793dcc46418a8d08ef77862cb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:08.863533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.864372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:08.868978 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 946/1881] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:08 2022] DELETE /identity/v3/projects/6294c1793dcc46418a8d08ef77862cb7 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:08.868978 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:08.869215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbc5883-5875-4703-afb7-71fba89ecf08 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:08.869360 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:08.945352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cdeeb6-a393-4cc3-85bb-cc3d037fb29f admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:08.946211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:08.947489 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:08.948347 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:08.948641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] PATH_INFO: `/v3/projects/527a0fdf00db4b4990c5ebd76c6199a1` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:08.949915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=527a0fdf00db4b4990c5ebd76c6199a1)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:08.951433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:08.952566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:08.952682 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:08.952951 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:08.953277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] PATH_INFO: `/v3/users/5e16b922a74b462bb3359209abc2def3` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:08.954601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e16b922a74b462bb3359209abc2def3)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:08.956757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:09.339758 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e16b922a74b462bb3359209abc2def3'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:09.349825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '527a0fdf00db4b4990c5ebd76c6199a1', 'request_id': 'req-01247224-c71b-4eaa-b06a-23489a6cb0c1'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:09.352683 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e16b922a74b462bb3359209abc2def3'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:09.353420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e16b922a74b462bb3359209abc2def3'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:09.354554 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e16b922a74b462bb3359209abc2def3'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:09.358928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '527a0fdf00db4b4990c5ebd76c6199a1', 'request_id': 'req-01247224-c71b-4eaa-b06a-23489a6cb0c1'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:09.364937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '527a0fdf00db4b4990c5ebd76c6199a1', 'request_id': 'req-01247224-c71b-4eaa-b06a-23489a6cb0c1'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:09.467249 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e16b922a74b462bb3359209abc2def3'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:09.470321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:09.486008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 947/1882] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:08 2022] DELETE /identity/v3/users/5e16b922a74b462bb3359209abc2def3 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:09.487334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:09.488955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:09.581992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749aefbd-3278-4630-8cfb-aa9ecbbf3ed3 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:09.594055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93542f17-721c-47fd-a423-4f9723059924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:09.594789 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93542f17-721c-47fd-a423-4f9723059924 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:09.595157 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93542f17-721c-47fd-a423-4f9723059924 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:09.595460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93542f17-721c-47fd-a423-4f9723059924 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:09.596266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93542f17-721c-47fd-a423-4f9723059924 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:09.600273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93542f17-721c-47fd-a423-4f9723059924 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:09.609889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 948/1883] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:09.611005 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93542f17-721c-47fd-a423-4f9723059924 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:09.612978 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-93542f17-721c-47fd-a423-4f9723059924 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:09.626273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93542f17-721c-47fd-a423-4f9723059924 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:09.632004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:09.632860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] The token cache is being invalidate because project 527a0fdf00db4b4990c5ebd76c6199a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:09.632969 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:09.633165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:09.639272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:09.639384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] PATH_INFO: `/v3/users/f344ee0f477f4e56b4fdf1974540c36e` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:09.639460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:09.639530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f344ee0f477f4e56b4fdf1974540c36e)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:09.639598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 936/1884] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:08 2022] DELETE /identity/v3/projects/527a0fdf00db4b4990c5ebd76c6199a1 => generated 0 bytes in 786 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:09.639680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:09.639759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:09.641198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:09.707297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01247224-c71b-4eaa-b06a-23489a6cb0c1 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:09.712174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8da7f6e-a33f-4601-8d73-7519c724e884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:09.712813 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da7f6e-a33f-4601-8d73-7519c724e884 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:09.713092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da7f6e-a33f-4601-8d73-7519c724e884 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:09.713419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8da7f6e-a33f-4601-8d73-7519c724e884 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:09.714153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da7f6e-a33f-4601-8d73-7519c724e884 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:09.715754 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8da7f6e-a33f-4601-8d73-7519c724e884 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:09.728215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 937/1885] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:09.728215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e6e83-04a5-451e-bb2f-8158095b280d None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:09.728447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e6e83-04a5-451e-bb2f-8158095b280d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:09.728642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660e6e83-04a5-451e-bb2f-8158095b280d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:09.747223 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-660e6e83-04a5-451e-bb2f-8158095b280d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:09.748483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-660e6e83-04a5-451e-bb2f-8158095b280d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:09.759549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 938/1886] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:09.761011 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e6e83-04a5-451e-bb2f-8158095b280d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:09.772859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660e6e83-04a5-451e-bb2f-8158095b280d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:09.778131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662a977-3a78-4246-bc74-e9d00e963a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:09.779027 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662a977-3a78-4246-bc74-e9d00e963a99 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:09.779374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662a977-3a78-4246-bc74-e9d00e963a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:09.779959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662a977-3a78-4246-bc74-e9d00e963a99 admin admin] PATH_INFO: `/v3/projects/e407d247bdac42f99fe4a840576e95b2/users/623e74f38143433d9b354edb3c094529/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:09.795664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662a977-3a78-4246-bc74-e9d00e963a99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e407d247bdac42f99fe4a840576e95b2, user_id=623e74f38143433d9b354edb3c094529, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:09.798427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662a977-3a78-4246-bc74-e9d00e963a99 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:09.971327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 939/1887] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:09 2022] PUT /identity/v3/projects/e407d247bdac42f99fe4a840576e95b2/users/623e74f38143433d9b354edb3c094529/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:09.972421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ef13c-3310-4148-86ca-3a9d8c4eee98 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:09.972826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ef13c-3310-4148-86ca-3a9d8c4eee98 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:09.973336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735ef13c-3310-4148-86ca-3a9d8c4eee98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:09.987763 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f344ee0f477f4e56b4fdf1974540c36e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:09.991421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-735ef13c-3310-4148-86ca-3a9d8c4eee98 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:09.992766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-735ef13c-3310-4148-86ca-3a9d8c4eee98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:10.002510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f344ee0f477f4e56b4fdf1974540c36e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:10.003327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f344ee0f477f4e56b4fdf1974540c36e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:10.004044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f344ee0f477f4e56b4fdf1974540c36e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:10.068850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 940/1888] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:10.075436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d0c4f-66af-4a33-a26b-65cdde38ffa0 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:10.075839 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d0c4f-66af-4a33-a26b-65cdde38ffa0 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:10.076189 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6d0c4f-66af-4a33-a26b-65cdde38ffa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:10.108859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-7b6d0c4f-66af-4a33-a26b-65cdde38ffa0 None None] MFA Rules not processed for user `623e74f38143433d9b354edb3c094529`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:10.110081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7b6d0c4f-66af-4a33-a26b-65cdde38ffa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:10.169536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f344ee0f477f4e56b4fdf1974540c36e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:10.191161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 949/1889] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:09 2022] DELETE /identity/v3/users/f344ee0f477f4e56b4fdf1974540c36e => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:10.192656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:10.194863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:10.207970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 941/1890] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:10 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:10.207970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d0c4f-66af-4a33-a26b-65cdde38ffa0 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:10.219303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6d0c4f-66af-4a33-a26b-65cdde38ffa0 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:10.287896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457784b-582e-44b9-8619-f88fd35ff952 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:10.293729 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:10.295050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:10.295050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:10.295390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] PATH_INFO: `/v3/projects/a55364f38a6248808100625f44c3a3c4` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:10.296868 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55364f38a6248808100625f44c3a3c4)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:10.299051 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:10.343968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87debe-e35f-4dc8-99ae-28021029041f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:10.344838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87debe-e35f-4dc8-99ae-28021029041f admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:10.346562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87debe-e35f-4dc8-99ae-28021029041f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:10.346562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e87debe-e35f-4dc8-99ae-28021029041f admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:10.346897 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87debe-e35f-4dc8-99ae-28021029041f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:10.347219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87debe-e35f-4dc8-99ae-28021029041f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:10.348869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e87debe-e35f-4dc8-99ae-28021029041f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:10.365001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 942/1891] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:10.367165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87debe-e35f-4dc8-99ae-28021029041f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:10.370352 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5e87debe-e35f-4dc8-99ae-28021029041f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:10.383615 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e87debe-e35f-4dc8-99ae-28021029041f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:10.390655 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7079f2-6615-47ee-81d1-be6227e878bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:10.391863 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7079f2-6615-47ee-81d1-be6227e878bd admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:10.391863 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7079f2-6615-47ee-81d1-be6227e878bd admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:10.392131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7079f2-6615-47ee-81d1-be6227e878bd admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:10.392852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7079f2-6615-47ee-81d1-be6227e878bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:10.394800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7079f2-6615-47ee-81d1-be6227e878bd admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:10.444298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55364f38a6248808100625f44c3a3c4', 'request_id': 'req-317f64af-c517-4975-83e4-79e27dd899c4'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:10.453446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55364f38a6248808100625f44c3a3c4', 'request_id': 'req-317f64af-c517-4975-83e4-79e27dd899c4'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:10.465483 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55364f38a6248808100625f44c3a3c4', 'request_id': 'req-317f64af-c517-4975-83e4-79e27dd899c4'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:10.561506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 943/1892] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:10 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:10.562015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7079f2-6615-47ee-81d1-be6227e878bd admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:10.582573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] The token cache is being invalidate because project a55364f38a6248808100625f44c3a3c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:10.582785 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:10.583454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:10.586218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 950/1893] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:10 2022] DELETE /identity/v3/projects/a55364f38a6248808100625f44c3a3c4 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:10.590496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:10.592900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:10.660784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7079f2-6615-47ee-81d1-be6227e878bd admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:10.667971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1eb96-e0af-4153-8148-87f07889b74c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:10.669184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1eb96-e0af-4153-8148-87f07889b74c admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:10.669585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1eb96-e0af-4153-8148-87f07889b74c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:10.669945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1eb96-e0af-4153-8148-87f07889b74c admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:10.671080 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1eb96-e0af-4153-8148-87f07889b74c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:10.673221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1eb96-e0af-4153-8148-87f07889b74c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:10.708301 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f64af-c517-4975-83e4-79e27dd899c4 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:10.713307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e23f52-9568-4298-a009-882ce7fc9034 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:10.713985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e23f52-9568-4298-a009-882ce7fc9034 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:10.714379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e23f52-9568-4298-a009-882ce7fc9034 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:10.714555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e23f52-9568-4298-a009-882ce7fc9034 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:10.715322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e23f52-9568-4298-a009-882ce7fc9034 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:10.717304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e23f52-9568-4298-a009-882ce7fc9034 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:10.789925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 944/1894] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:10 2022] POST /identity/v3/projects => generated 409 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:10.792832 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8974ece-8d02-43ce-86cb-d1dc3d080505 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:10.793369 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8974ece-8d02-43ce-86cb-d1dc3d080505 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:10.793862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8974ece-8d02-43ce-86cb-d1dc3d080505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:10.830705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-f8974ece-8d02-43ce-86cb-d1dc3d080505 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:10.832034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f8974ece-8d02-43ce-86cb-d1dc3d080505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:10.850855 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 951/1895] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:10 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:10.852113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e23f52-9568-4298-a009-882ce7fc9034 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:10.855003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-07e23f52-9568-4298-a009-882ce7fc9034 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:10.868837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e23f52-9568-4298-a009-882ce7fc9034 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:10.912165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 945/1896] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:10.912898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8974ece-8d02-43ce-86cb-d1dc3d080505 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:10.915419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f8974ece-8d02-43ce-86cb-d1dc3d080505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:10.927830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8974ece-8d02-43ce-86cb-d1dc3d080505 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:10.930509 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:10.931445 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:10.931795 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:10.932705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] PATH_INFO: `/v3/projects/0e63d8b6d8a4424cb5b669a0fa3798f0` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:10.933510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc69971-602c-42de-a3d2-b03962a8498a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:10.934151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e63d8b6d8a4424cb5b669a0fa3798f0)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:10.934248 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69971-602c-42de-a3d2-b03962a8498a admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:10.934445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69971-602c-42de-a3d2-b03962a8498a admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:10.934737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc69971-602c-42de-a3d2-b03962a8498a admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:10.935446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc69971-602c-42de-a3d2-b03962a8498a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:10.936254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:10.937405 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc69971-602c-42de-a3d2-b03962a8498a admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:11.032826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 946/1897] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:10 2022] POST /identity/v3/users => generated 305 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:11.033826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc69971-602c-42de-a3d2-b03962a8498a admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.044029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc69971-602c-42de-a3d2-b03962a8498a admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:11.048679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb4266e-0908-4b51-83d5-1a12d97edb78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:11.049331 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4266e-0908-4b51-83d5-1a12d97edb78 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.049620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4266e-0908-4b51-83d5-1a12d97edb78 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.049902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb4266e-0908-4b51-83d5-1a12d97edb78 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.050660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4266e-0908-4b51-83d5-1a12d97edb78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:11.052355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb4266e-0908-4b51-83d5-1a12d97edb78 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:11.063659 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 947/1898] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:11.064532 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c45fe-c61b-475c-a49d-497279470e5e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.064825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c45fe-c61b-475c-a49d-497279470e5e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.065109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578c45fe-c61b-475c-a49d-497279470e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.084480 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-578c45fe-c61b-475c-a49d-497279470e5e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:11.085856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-578c45fe-c61b-475c-a49d-497279470e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:11.086077 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e63d8b6d8a4424cb5b669a0fa3798f0', 'request_id': 'req-092063ea-a0d7-402e-b2b5-f91e24615671'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:11.091672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e63d8b6d8a4424cb5b669a0fa3798f0', 'request_id': 'req-092063ea-a0d7-402e-b2b5-f91e24615671'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:11.098038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e63d8b6d8a4424cb5b669a0fa3798f0', 'request_id': 'req-092063ea-a0d7-402e-b2b5-f91e24615671'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:11.146619 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 948/1899] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:11.147506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c45fe-c61b-475c-a49d-497279470e5e None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.156985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578c45fe-c61b-475c-a49d-497279470e5e None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:11.161855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a8054-1ac9-4305-9af3-c0b56b998c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:11.162511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8054-1ac9-4305-9af3-c0b56b998c49 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.162799 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8054-1ac9-4305-9af3-c0b56b998c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.163081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64a8054-1ac9-4305-9af3-c0b56b998c49 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.163852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a8054-1ac9-4305-9af3-c0b56b998c49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:11.165463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64a8054-1ac9-4305-9af3-c0b56b998c49 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:11.175670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 949/1900] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:11.185082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a8054-1ac9-4305-9af3-c0b56b998c49 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.186476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64a8054-1ac9-4305-9af3-c0b56b998c49 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:11.191206 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131d6a7-8c55-4c3f-ac6f-9a9b3337c054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:11.192110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d6a7-8c55-4c3f-ac6f-9a9b3337c054 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.192392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d6a7-8c55-4c3f-ac6f-9a9b3337c054 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.192667 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6131d6a7-8c55-4c3f-ac6f-9a9b3337c054 admin admin] PATH_INFO: `/v3/projects/3ce96700f277484499a5913cbcf4b897/users/c3730dd0dc3d4f559755c546598e8b0b/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.208127 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131d6a7-8c55-4c3f-ac6f-9a9b3337c054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce96700f277484499a5913cbcf4b897, user_id=c3730dd0dc3d4f559755c546598e8b0b, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:11.210770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6131d6a7-8c55-4c3f-ac6f-9a9b3337c054 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:11.214889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] The token cache is being invalidate because project 0e63d8b6d8a4424cb5b669a0fa3798f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:11.215196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:11.223522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:11.223522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 952/1901] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:10 2022] DELETE /identity/v3/projects/0e63d8b6d8a4424cb5b669a0fa3798f0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:11.223522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.223522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:11.231862 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092063ea-a0d7-402e-b2b5-f91e24615671 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:11.236544 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b472e62-770a-4ca4-98ff-6dc761881f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:11.237177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b472e62-770a-4ca4-98ff-6dc761881f50 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.237462 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b472e62-770a-4ca4-98ff-6dc761881f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.237737 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b472e62-770a-4ca4-98ff-6dc761881f50 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.238449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b472e62-770a-4ca4-98ff-6dc761881f50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:11.238758 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b472e62-770a-4ca4-98ff-6dc761881f50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:11.240393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b472e62-770a-4ca4-98ff-6dc761881f50 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:11.244101 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:11.252339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 953/1902] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:11.253203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b472e62-770a-4ca4-98ff-6dc761881f50 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.260230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5b472e62-770a-4ca4-98ff-6dc761881f50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:11.268888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b472e62-770a-4ca4-98ff-6dc761881f50 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:11.273669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f0ffe4-8bc1-4140-b135-5fa246dbd952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:11.274326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ffe4-8bc1-4140-b135-5fa246dbd952 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.274618 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ffe4-8bc1-4140-b135-5fa246dbd952 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.274899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f0ffe4-8bc1-4140-b135-5fa246dbd952 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.275655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0ffe4-8bc1-4140-b135-5fa246dbd952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:11.277330 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f0ffe4-8bc1-4140-b135-5fa246dbd952 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:11.288037 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 954/1903] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:11.292147 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac6826-791a-4ed5-87af-439dfd7ac4ba None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.292147 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac6826-791a-4ed5-87af-439dfd7ac4ba None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.292147 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac6826-791a-4ed5-87af-439dfd7ac4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.310185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-10ac6826-791a-4ed5-87af-439dfd7ac4ba None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:11.311352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-10ac6826-791a-4ed5-87af-439dfd7ac4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:11.319311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 955/1904] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:11.320150 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac6826-791a-4ed5-87af-439dfd7ac4ba None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.328404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 950/1905] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:11 2022] PUT /identity/v3/projects/3ce96700f277484499a5913cbcf4b897/users/c3730dd0dc3d4f559755c546598e8b0b/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:11.329265 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131d6a7-8c55-4c3f-ac6f-9a9b3337c054 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.330142 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac6826-791a-4ed5-87af-439dfd7ac4ba None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:11.390535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75fc03-f8d1-4b1e-b15f-7b5bc7b7cd45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:11.391225 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75fc03-f8d1-4b1e-b15f-7b5bc7b7cd45 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.391506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75fc03-f8d1-4b1e-b15f-7b5bc7b7cd45 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.391786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75fc03-f8d1-4b1e-b15f-7b5bc7b7cd45 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.392502 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75fc03-f8d1-4b1e-b15f-7b5bc7b7cd45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:11.394426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75fc03-f8d1-4b1e-b15f-7b5bc7b7cd45 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:11.396666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6131d6a7-8c55-4c3f-ac6f-9a9b3337c054 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:11.401815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcd9416-b009-4cc7-a0bc-05d14a25c8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:11.406551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd9416-b009-4cc7-a0bc-05d14a25c8a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.406551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd9416-b009-4cc7-a0bc-05d14a25c8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.406551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcd9416-b009-4cc7-a0bc-05d14a25c8a1 admin admin] PATH_INFO: `/v3/projects/5004391d939440e4ba6c29a5009549d4/users/14dd17761f3e4b86a3f20a78fa3e55f6/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.423020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd9416-b009-4cc7-a0bc-05d14a25c8a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5004391d939440e4ba6c29a5009549d4, user_id=14dd17761f3e4b86a3f20a78fa3e55f6, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:11.425799 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcd9416-b009-4cc7-a0bc-05d14a25c8a1 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:11.535179 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 956/1906] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:11 2022] POST /identity/v3/projects => generated 385 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:11.537922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75fc03-f8d1-4b1e-b15f-7b5bc7b7cd45 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.538054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1f75fc03-f8d1-4b1e-b15f-7b5bc7b7cd45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:11.589558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 951/1907] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:11 2022] PUT /identity/v3/projects/5004391d939440e4ba6c29a5009549d4/users/14dd17761f3e4b86a3f20a78fa3e55f6/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:11.597808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2977a-baae-4031-a2ff-4dce7fe1d727 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.598121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2977a-baae-4031-a2ff-4dce7fe1d727 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.598394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2977a-baae-4031-a2ff-4dce7fe1d727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.612703 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75fc03-f8d1-4b1e-b15f-7b5bc7b7cd45 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:11.620826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a1b2977a-baae-4031-a2ff-4dce7fe1d727 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:11.622430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a1b2977a-baae-4031-a2ff-4dce7fe1d727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:11.675265 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329685d-4566-4891-bb34-fcd041f5ac9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:11.676113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329685d-4566-4891-bb34-fcd041f5ac9c admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.676489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329685d-4566-4891-bb34-fcd041f5ac9c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.676859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3329685d-4566-4891-bb34-fcd041f5ac9c admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.677691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329685d-4566-4891-bb34-fcd041f5ac9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:11.679427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3329685d-4566-4891-bb34-fcd041f5ac9c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:11.693401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 957/1908] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:11.693401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329685d-4566-4891-bb34-fcd041f5ac9c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.698377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 952/1909] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:11.698377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08c59c-ba23-4303-9be9-da662d163e7a None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.698377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08c59c-ba23-4303-9be9-da662d163e7a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.698377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08c59c-ba23-4303-9be9-da662d163e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.704559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3329685d-4566-4891-bb34-fcd041f5ac9c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:11.709971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd19b-d1a8-4062-a8f9-3118ee144c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:11.710689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd19b-d1a8-4062-a8f9-3118ee144c08 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.710971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd19b-d1a8-4062-a8f9-3118ee144c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.711247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dd19b-d1a8-4062-a8f9-3118ee144c08 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.711974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dd19b-d1a8-4062-a8f9-3118ee144c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:11.714637 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dd19b-d1a8-4062-a8f9-3118ee144c08 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:11.729034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ad08c59c-ba23-4303-9be9-da662d163e7a None None] MFA Rules not processed for user `14dd17761f3e4b86a3f20a78fa3e55f6`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:11.730270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ad08c59c-ba23-4303-9be9-da662d163e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:11.789263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 958/1910] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:11 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:11.790391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd19b-d1a8-4062-a8f9-3118ee144c08 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.803708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dd19b-d1a8-4062-a8f9-3118ee144c08 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:11.809987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116a586-f2bd-4f01-a8b3-c7651387a663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:11.811060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116a586-f2bd-4f01-a8b3-c7651387a663 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.811287 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116a586-f2bd-4f01-a8b3-c7651387a663 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.811574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116a586-f2bd-4f01-a8b3-c7651387a663 admin admin] PATH_INFO: `/v3/projects/3ce96700f277484499a5913cbcf4b897/users/c3730dd0dc3d4f559755c546598e8b0b/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.813666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116a586-f2bd-4f01-a8b3-c7651387a663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ce96700f277484499a5913cbcf4b897, user_id=c3730dd0dc3d4f559755c546598e8b0b, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:11.816380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116a586-f2bd-4f01-a8b3-c7651387a663 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:11.817769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 953/1911] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:11.818765 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08c59c-ba23-4303-9be9-da662d163e7a None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.828418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 959/1912] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:11 2022] PUT /identity/v3/projects/3ce96700f277484499a5913cbcf4b897/users/c3730dd0dc3d4f559755c546598e8b0b/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:11.837406 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116a586-f2bd-4f01-a8b3-c7651387a663 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.837515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08c59c-ba23-4303-9be9-da662d163e7a None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:11.948802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93951-d971-49f8-bff5-f2f2b5adfbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:11.949487 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93951-d971-49f8-bff5-f2f2b5adfbf1 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.949779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93951-d971-49f8-bff5-f2f2b5adfbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.950068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c93951-d971-49f8-bff5-f2f2b5adfbf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.954564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93951-d971-49f8-bff5-f2f2b5adfbf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:11.954564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93951-d971-49f8-bff5-f2f2b5adfbf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:11.954564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c93951-d971-49f8-bff5-f2f2b5adfbf1 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:11.977277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116a586-f2bd-4f01-a8b3-c7651387a663 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:11.984406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 954/1913] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:11.985925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93951-d971-49f8-bff5-f2f2b5adfbf1 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:11.988574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0bb29-22fe-49c7-b758-70ec9aeed3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:11.989289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0bb29-22fe-49c7-b758-70ec9aeed3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:11.989574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0bb29-22fe-49c7-b758-70ec9aeed3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:11.989867 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0bb29-22fe-49c7-b758-70ec9aeed3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:11.990774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0bb29-22fe-49c7-b758-70ec9aeed3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:11.994273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0bb29-22fe-49c7-b758-70ec9aeed3e1 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:12.001107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c93951-d971-49f8-bff5-f2f2b5adfbf1 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:12.009666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981567c0-d2ca-4a5f-866b-31e2f0c99008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:12.010926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981567c0-d2ca-4a5f-866b-31e2f0c99008 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:12.011399 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981567c0-d2ca-4a5f-866b-31e2f0c99008 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:12.012159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981567c0-d2ca-4a5f-866b-31e2f0c99008 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:12.013082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981567c0-d2ca-4a5f-866b-31e2f0c99008 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:12.013855 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 960/1914] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:11 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:12.015932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c18e43-8bc5-4e73-b399-6abe6d2cb052 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:12.015932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c18e43-8bc5-4e73-b399-6abe6d2cb052 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:12.016154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c18e43-8bc5-4e73-b399-6abe6d2cb052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:12.024636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981567c0-d2ca-4a5f-866b-31e2f0c99008 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:12.052107 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b5c18e43-8bc5-4e73-b399-6abe6d2cb052 None None] MFA Rules not processed for user `c3730dd0dc3d4f559755c546598e8b0b`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:12.053787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b5c18e43-8bc5-4e73-b399-6abe6d2cb052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:12.141877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 955/1915] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:11 2022] POST /identity/v3/projects => generated 409 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:12.144091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981567c0-d2ca-4a5f-866b-31e2f0c99008 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:12.154153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 961/1916] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:12.155337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c18e43-8bc5-4e73-b399-6abe6d2cb052 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:12.168919 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c18e43-8bc5-4e73-b399-6abe6d2cb052 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:12.225361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981567c0-d2ca-4a5f-866b-31e2f0c99008 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:12.230252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b89239-996f-4893-861f-c335fb5a205f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:12.230979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b89239-996f-4893-861f-c335fb5a205f admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:12.231271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b89239-996f-4893-861f-c335fb5a205f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:12.231552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b89239-996f-4893-861f-c335fb5a205f admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:12.232291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b89239-996f-4893-861f-c335fb5a205f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:12.234912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b89239-996f-4893-861f-c335fb5a205f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:12.239396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a31f9b-4503-4b3a-9cba-b6216f0cc1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:12.240425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a31f9b-4503-4b3a-9cba-b6216f0cc1be admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:12.240820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a31f9b-4503-4b3a-9cba-b6216f0cc1be admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:12.241187 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a31f9b-4503-4b3a-9cba-b6216f0cc1be admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:12.242127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a31f9b-4503-4b3a-9cba-b6216f0cc1be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:12.244568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a31f9b-4503-4b3a-9cba-b6216f0cc1be admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:12.258982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 962/1917] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:12.260765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a31f9b-4503-4b3a-9cba-b6216f0cc1be admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:12.274689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a31f9b-4503-4b3a-9cba-b6216f0cc1be admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:12.281063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a668b0-fb06-4e15-a146-fe73e6b574f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:12.281828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a668b0-fb06-4e15-a146-fe73e6b574f2 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:12.282188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a668b0-fb06-4e15-a146-fe73e6b574f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:12.282541 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a668b0-fb06-4e15-a146-fe73e6b574f2 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:12.283340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a668b0-fb06-4e15-a146-fe73e6b574f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:12.285416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a668b0-fb06-4e15-a146-fe73e6b574f2 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:12.426863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 963/1918] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:12 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:12.427900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a668b0-fb06-4e15-a146-fe73e6b574f2 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:12.430019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 956/1919] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:12 2022] POST /identity/v3/projects => generated 369 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:12.430156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c8a668b0-fb06-4e15-a146-fe73e6b574f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:12.430234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b89239-996f-4893-861f-c335fb5a205f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:12.493491 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a668b0-fb06-4e15-a146-fe73e6b574f2 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:12.493970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b89239-996f-4893-861f-c335fb5a205f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:12.499482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61109340-777a-4c84-a5bc-d4a0aa20b688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:12.500400 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61109340-777a-4c84-a5bc-d4a0aa20b688 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:12.500688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61109340-777a-4c84-a5bc-d4a0aa20b688 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:12.500956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61109340-777a-4c84-a5bc-d4a0aa20b688 admin admin] PATH_INFO: `/v3/projects/cf2bb829713e4e4d9dbcd0a549acc249/users/e734bfb1272a45c9a3bafa098fb046cb/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:12.519920 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61109340-777a-4c84-a5bc-d4a0aa20b688 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf2bb829713e4e4d9dbcd0a549acc249, user_id=e734bfb1272a45c9a3bafa098fb046cb, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:12.522965 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61109340-777a-4c84-a5bc-d4a0aa20b688 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:12.543352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8f82b-6d9b-4220-859f-c381c3f3d1e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:12.544062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8f82b-6d9b-4220-859f-c381c3f3d1e8 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:12.544367 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8f82b-6d9b-4220-859f-c381c3f3d1e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:12.544679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8f82b-6d9b-4220-859f-c381c3f3d1e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:12.608689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8f82b-6d9b-4220-859f-c381c3f3d1e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:12.610197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f8f82b-6d9b-4220-859f-c381c3f3d1e8 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:12.620598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 964/1920] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:12.621515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8f82b-6d9b-4220-859f-c381c3f3d1e8 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:12.631539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f8f82b-6d9b-4220-859f-c381c3f3d1e8 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:12.636870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bc31e-49c8-48e2-b943-c0444bebb3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:12.637525 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bc31e-49c8-48e2-b943-c0444bebb3b0 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:12.637810 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bc31e-49c8-48e2-b943-c0444bebb3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:12.638089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7bc31e-49c8-48e2-b943-c0444bebb3b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:12.638830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bc31e-49c8-48e2-b943-c0444bebb3b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:12.640463 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7bc31e-49c8-48e2-b943-c0444bebb3b0 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:12.650418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 965/1921] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:12.651395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bc31e-49c8-48e2-b943-c0444bebb3b0 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:12.656030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 957/1922] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:12 2022] PUT /identity/v3/projects/cf2bb829713e4e4d9dbcd0a549acc249/users/e734bfb1272a45c9a3bafa098fb046cb/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:12.666130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61109340-777a-4c84-a5bc-d4a0aa20b688 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:12.666262 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7bc31e-49c8-48e2-b943-c0444bebb3b0 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:12.721864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233715e0-4d07-418c-ac52-fff7e4f4c76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:12.722572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233715e0-4d07-418c-ac52-fff7e4f4c76c admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:12.722853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233715e0-4d07-418c-ac52-fff7e4f4c76c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:12.723130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233715e0-4d07-418c-ac52-fff7e4f4c76c admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:12.723848 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233715e0-4d07-418c-ac52-fff7e4f4c76c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:12.725777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233715e0-4d07-418c-ac52-fff7e4f4c76c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:12.728605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61109340-777a-4c84-a5bc-d4a0aa20b688 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:12.733339 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad524bd4-b73d-4390-b6b5-931f03f70aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:12.734273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad524bd4-b73d-4390-b6b5-931f03f70aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:12.734561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad524bd4-b73d-4390-b6b5-931f03f70aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:12.734836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad524bd4-b73d-4390-b6b5-931f03f70aaf admin admin] PATH_INFO: `/v3/projects/ccfa46fe48424fffb7c5e91eec6ca128/users/2957d527ef91440ebf832bd83f905885/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:12.749819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad524bd4-b73d-4390-b6b5-931f03f70aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccfa46fe48424fffb7c5e91eec6ca128, user_id=2957d527ef91440ebf832bd83f905885, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:12.752507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad524bd4-b73d-4390-b6b5-931f03f70aaf admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:12.946096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 958/1923] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:12 2022] PUT /identity/v3/projects/ccfa46fe48424fffb7c5e91eec6ca128/users/2957d527ef91440ebf832bd83f905885/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:12.947993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ce583-cf42-4ba5-856d-604dab2f3c5b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:12.948284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ce583-cf42-4ba5-856d-604dab2f3c5b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:12.948562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ce583-cf42-4ba5-856d-604dab2f3c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:12.949910 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 966/1924] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:12 2022] POST /identity/v3/users => generated 285 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:12.950919 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233715e0-4d07-418c-ac52-fff7e4f4c76c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:12.962864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233715e0-4d07-418c-ac52-fff7e4f4c76c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:12.974382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:12.987159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-467ce583-cf42-4ba5-856d-604dab2f3c5b None None] MFA Rules not processed for user `e734bfb1272a45c9a3bafa098fb046cb`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:12.987159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-467ce583-cf42-4ba5-856d-604dab2f3c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:13.042122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67934e84-f6e5-4a0f-aea7-30af5d66dad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:13.044987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67934e84-f6e5-4a0f-aea7-30af5d66dad1 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:13.044987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67934e84-f6e5-4a0f-aea7-30af5d66dad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:13.044987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67934e84-f6e5-4a0f-aea7-30af5d66dad1 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:13.044987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67934e84-f6e5-4a0f-aea7-30af5d66dad1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:13.045545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67934e84-f6e5-4a0f-aea7-30af5d66dad1 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:13.056433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 967/1925] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:12 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:13.061296 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67934e84-f6e5-4a0f-aea7-30af5d66dad1 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:13.070729 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 959/1926] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:13.072049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ce583-cf42-4ba5-856d-604dab2f3c5b None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:13.076341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67934e84-f6e5-4a0f-aea7-30af5d66dad1 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:13.082380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8c2a2-b2c7-4d4c-a5fb-be51a7efd6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:13.083572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8c2a2-b2c7-4d4c-a5fb-be51a7efd6ad admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:13.084072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8c2a2-b2c7-4d4c-a5fb-be51a7efd6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:13.084497 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8c2a2-b2c7-4d4c-a5fb-be51a7efd6ad admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:13.085779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8c2a2-b2c7-4d4c-a5fb-be51a7efd6ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:13.085920 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ce583-cf42-4ba5-856d-604dab2f3c5b None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:13.087410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8c2a2-b2c7-4d4c-a5fb-be51a7efd6ad admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:13.097295 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cb37f-0fde-4a98-a217-43a3d364af4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:13.102475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cb37f-0fde-4a98-a217-43a3d364af4e admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:13.102475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cb37f-0fde-4a98-a217-43a3d364af4e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:13.102475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cb37f-0fde-4a98-a217-43a3d364af4e admin admin] PATH_INFO: `/v3/projects/ccfa46fe48424fffb7c5e91eec6ca128/users/2957d527ef91440ebf832bd83f905885/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:13.103070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 968/1927] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:13.103070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8c2a2-b2c7-4d4c-a5fb-be51a7efd6ad admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:13.103224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cb37f-0fde-4a98-a217-43a3d364af4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccfa46fe48424fffb7c5e91eec6ca128, user_id=2957d527ef91440ebf832bd83f905885, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:13.106051 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-9bf8c2a2-b2c7-4d4c-a5fb-be51a7efd6ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:13.107107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cb37f-0fde-4a98-a217-43a3d364af4e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:13.123245 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 960/1928] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:13 2022] PUT /identity/v3/projects/ccfa46fe48424fffb7c5e91eec6ca128/users/2957d527ef91440ebf832bd83f905885/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:13.124381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cb37f-0fde-4a98-a217-43a3d364af4e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:13.193754 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8c2a2-b2c7-4d4c-a5fb-be51a7efd6ad admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:13.213709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cb37f-0fde-4a98-a217-43a3d364af4e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:13.219692 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c96639-786e-4c0b-a6ac-eaf2ab5158d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:13.220403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c96639-786e-4c0b-a6ac-eaf2ab5158d4 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:13.220691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c96639-786e-4c0b-a6ac-eaf2ab5158d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:13.220982 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c96639-786e-4c0b-a6ac-eaf2ab5158d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:13.221703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c96639-786e-4c0b-a6ac-eaf2ab5158d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:13.223318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c96639-786e-4c0b-a6ac-eaf2ab5158d4 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:13.240277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 961/1929] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:13.241911 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db471000-588b-4fdc-a9ce-8a2188f40ac5 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:13.242277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db471000-588b-4fdc-a9ce-8a2188f40ac5 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:13.242632 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db471000-588b-4fdc-a9ce-8a2188f40ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:13.261218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b1abf-1966-4b84-b45f-420becadf03f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:13.261960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b1abf-1966-4b84-b45f-420becadf03f service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:13.262331 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b1abf-1966-4b84-b45f-420becadf03f service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:13.262669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09b1abf-1966-4b84-b45f-420becadf03f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:13.281441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-db471000-588b-4fdc-a9ce-8a2188f40ac5 None None] MFA Rules not processed for user `2957d527ef91440ebf832bd83f905885`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:13.282789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-db471000-588b-4fdc-a9ce-8a2188f40ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:13.333146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b1abf-1966-4b84-b45f-420becadf03f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:13.334867 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09b1abf-1966-4b84-b45f-420becadf03f service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:13.354966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 969/1930] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:13 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:13.354966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b1abf-1966-4b84-b45f-420becadf03f service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:13.378035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09b1abf-1966-4b84-b45f-420becadf03f service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:13.382847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72886942-6b03-4eb0-a84d-477a7abb855c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:13.383801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72886942-6b03-4eb0-a84d-477a7abb855c admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:13.384032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72886942-6b03-4eb0-a84d-477a7abb855c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:13.384310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72886942-6b03-4eb0-a84d-477a7abb855c admin admin] PATH_INFO: `/v3/projects/cf48174bf2e44a3997668896ea03d8fa/users/88eaec76897a44f29dd8fc636835b07f/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:13.390404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 962/1931] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:13.391752 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db471000-588b-4fdc-a9ce-8a2188f40ac5 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:13.410196 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db471000-588b-4fdc-a9ce-8a2188f40ac5 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:13.410395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72886942-6b03-4eb0-a84d-477a7abb855c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf48174bf2e44a3997668896ea03d8fa, user_id=88eaec76897a44f29dd8fc636835b07f, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:13.412731 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72886942-6b03-4eb0-a84d-477a7abb855c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:13.423730 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc12438-58b0-462d-abc8-8834027f62e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:13.424866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc12438-58b0-462d-abc8-8834027f62e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:13.425372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc12438-58b0-462d-abc8-8834027f62e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:13.425724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc12438-58b0-462d-abc8-8834027f62e6 admin admin] PATH_INFO: `/v3/users/e734bfb1272a45c9a3bafa098fb046cb` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:13.427171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc12438-58b0-462d-abc8-8834027f62e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e734bfb1272a45c9a3bafa098fb046cb)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:13.430239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc12438-58b0-462d-abc8-8834027f62e6 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:13.512872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 970/1932] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:13 2022] PUT /identity/v3/projects/cf48174bf2e44a3997668896ea03d8fa/users/88eaec76897a44f29dd8fc636835b07f/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:13.513696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72886942-6b03-4eb0-a84d-477a7abb855c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:13.541408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:13.580073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72886942-6b03-4eb0-a84d-477a7abb855c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:13.586912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a50dd-9db5-4665-9f29-ed917c1258fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:13.587652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a50dd-9db5-4665-9f29-ed917c1258fa service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:13.587970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a50dd-9db5-4665-9f29-ed917c1258fa service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:13.588945 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a50dd-9db5-4665-9f29-ed917c1258fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:13.649344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a50dd-9db5-4665-9f29-ed917c1258fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:13.651384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59a50dd-9db5-4665-9f29-ed917c1258fa service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:13.661578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 971/1933] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:13.662817 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434721-846c-45cc-8547-7cf4261f7d86 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:13.663187 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434721-846c-45cc-8547-7cf4261f7d86 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:13.663385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61434721-846c-45cc-8547-7cf4261f7d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:13.691481 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-fcc12438-58b0-462d-abc8-8834027f62e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e734bfb1272a45c9a3bafa098fb046cb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:13.692406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-fcc12438-58b0-462d-abc8-8834027f62e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e734bfb1272a45c9a3bafa098fb046cb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:13.694542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-fcc12438-58b0-462d-abc8-8834027f62e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e734bfb1272a45c9a3bafa098fb046cb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:13.711137 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-61434721-846c-45cc-8547-7cf4261f7d86 None None] MFA Rules not processed for user `88eaec76897a44f29dd8fc636835b07f`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:13.712006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-61434721-846c-45cc-8547-7cf4261f7d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:13.783096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-fcc12438-58b0-462d-abc8-8834027f62e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e734bfb1272a45c9a3bafa098fb046cb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:13.796831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-fcc12438-58b0-462d-abc8-8834027f62e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e734bfb1272a45c9a3bafa098fb046cb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:13.799904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 972/1934] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:13.804374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61434721-846c-45cc-8547-7cf4261f7d86 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:13.806589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-61434721-846c-45cc-8547-7cf4261f7d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:13.819227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 963/1935] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:13 2022] DELETE /identity/v3/users/e734bfb1272a45c9a3bafa098fb046cb => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:13.824571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85d136-8fdc-471f-9c6b-1a4a2646265e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:13.825089 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85d136-8fdc-471f-9c6b-1a4a2646265e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:13.825829 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85d136-8fdc-471f-9c6b-1a4a2646265e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:13.852537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-9f85d136-8fdc-471f-9c6b-1a4a2646265e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:13.853832 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9f85d136-8fdc-471f-9c6b-1a4a2646265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:13.889391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61434721-846c-45cc-8547-7cf4261f7d86 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:13.930067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 964/1936] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:13.942026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85d136-8fdc-471f-9c6b-1a4a2646265e None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:13.943449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9f85d136-8fdc-471f-9c6b-1a4a2646265e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:13.958621 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dac8e0-6409-4039-8b29-d7209fee7b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:13.959460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dac8e0-6409-4039-8b29-d7209fee7b3c admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:13.959879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dac8e0-6409-4039-8b29-d7209fee7b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:13.960290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38dac8e0-6409-4039-8b29-d7209fee7b3c admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:13.961096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dac8e0-6409-4039-8b29-d7209fee7b3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:13.963314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38dac8e0-6409-4039-8b29-d7209fee7b3c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:14.006216 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85d136-8fdc-471f-9c6b-1a4a2646265e None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:14.010928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14328eaf-35ff-4d49-9aaa-8e700d47cda8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:14.011687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14328eaf-35ff-4d49-9aaa-8e700d47cda8 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:14.012064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14328eaf-35ff-4d49-9aaa-8e700d47cda8 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:14.012408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14328eaf-35ff-4d49-9aaa-8e700d47cda8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:14.022972 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14328eaf-35ff-4d49-9aaa-8e700d47cda8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:14.024848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14328eaf-35ff-4d49-9aaa-8e700d47cda8 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:14.055913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 965/1937] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:11:14.082215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 973/1938] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:13 2022] POST /identity/v3/projects => generated 367 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:11:14.086029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14328eaf-35ff-4d49-9aaa-8e700d47cda8 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:14.098218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14328eaf-35ff-4d49-9aaa-8e700d47cda8 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:14.172008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1a89c-3527-485a-bcad-9779d93b4532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:14.172793 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1a89c-3527-485a-bcad-9779d93b4532 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:14.173084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1a89c-3527-485a-bcad-9779d93b4532 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:14.173361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c1a89c-3527-485a-bcad-9779d93b4532 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:14.174184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1a89c-3527-485a-bcad-9779d93b4532 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:14.176715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c1a89c-3527-485a-bcad-9779d93b4532 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:14.334056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dac8e0-6409-4039-8b29-d7209fee7b3c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:14.336343 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-38dac8e0-6409-4039-8b29-d7209fee7b3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:14.345409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 966/1939] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:14 2022] POST /identity/v3/users => generated 290 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:14.346891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1a89c-3527-485a-bcad-9779d93b4532 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:14.356995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c1a89c-3527-485a-bcad-9779d93b4532 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:14.361851 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a167b8c-a805-4c41-8c91-7a278d819459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:14.362509 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a167b8c-a805-4c41-8c91-7a278d819459 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:14.362792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a167b8c-a805-4c41-8c91-7a278d819459 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:14.363067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a167b8c-a805-4c41-8c91-7a278d819459 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:14.364218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a167b8c-a805-4c41-8c91-7a278d819459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:14.365410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a167b8c-a805-4c41-8c91-7a278d819459 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:14.402336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 967/1940] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:14.406671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a167b8c-a805-4c41-8c91-7a278d819459 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:14.436059 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38dac8e0-6409-4039-8b29-d7209fee7b3c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:14.440950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a167b8c-a805-4c41-8c91-7a278d819459 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:14.442241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1eea-993a-4f5a-9df7-8f7b50d7a459 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:14.443557 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1eea-993a-4f5a-9df7-8f7b50d7a459 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:14.443954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1eea-993a-4f5a-9df7-8f7b50d7a459 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:14.444309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa1eea-993a-4f5a-9df7-8f7b50d7a459 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:14.447298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-66aa1eea-993a-4f5a-9df7-8f7b50d7a459 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:14.451134 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3590602-9d39-4bee-9691-4a9719ba1704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:14.452392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3590602-9d39-4bee-9691-4a9719ba1704 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:14.452824 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3590602-9d39-4bee-9691-4a9719ba1704 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:14.453314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3590602-9d39-4bee-9691-4a9719ba1704 admin admin] PATH_INFO: `/v3/projects/5cfc45f95e834733883eab14705b20c6/users/a6a020f24a2f40e686f297422a4251c5/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:14.478197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3590602-9d39-4bee-9691-4a9719ba1704 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc45f95e834733883eab14705b20c6, user_id=a6a020f24a2f40e686f297422a4251c5, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:14.482106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3590602-9d39-4bee-9691-4a9719ba1704 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:14.575762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 968/1941] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:14 2022] PUT /identity/v3/projects/5cfc45f95e834733883eab14705b20c6/users/a6a020f24a2f40e686f297422a4251c5/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:14.577053 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3590602-9d39-4bee-9691-4a9719ba1704 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:14.595349 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:14.606165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa1eea-993a-4f5a-9df7-8f7b50d7a459 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:14.610198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa1eea-993a-4f5a-9df7-8f7b50d7a459 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:14.625887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 974/1942] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:14 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:14.676302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3590602-9d39-4bee-9691-4a9719ba1704 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:14.687059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015bd4ce-05cd-4d1b-976c-e26a5089d10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:14.687821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bd4ce-05cd-4d1b-976c-e26a5089d10b admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:14.688111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bd4ce-05cd-4d1b-976c-e26a5089d10b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:14.688432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015bd4ce-05cd-4d1b-976c-e26a5089d10b admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:14.689128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bd4ce-05cd-4d1b-976c-e26a5089d10b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:14.696138 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015bd4ce-05cd-4d1b-976c-e26a5089d10b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:14.734311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 969/1943] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:14 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:14.739406 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1eea-993a-4f5a-9df7-8f7b50d7a459 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:14.762660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa1eea-993a-4f5a-9df7-8f7b50d7a459 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:14.773532 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1aa30-334b-4794-8cef-15e5f62f5a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:14.774267 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1aa30-334b-4794-8cef-15e5f62f5a1c admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:14.774546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1aa30-334b-4794-8cef-15e5f62f5a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:14.774829 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1aa30-334b-4794-8cef-15e5f62f5a1c admin admin] PATH_INFO: `/v3/projects/5cfc45f95e834733883eab14705b20c6/users/a6a020f24a2f40e686f297422a4251c5/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:14.777018 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1aa30-334b-4794-8cef-15e5f62f5a1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cfc45f95e834733883eab14705b20c6, user_id=a6a020f24a2f40e686f297422a4251c5, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:14.779830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1aa30-334b-4794-8cef-15e5f62f5a1c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:14.811556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 975/1944] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:14 2022] PUT /identity/v3/projects/5cfc45f95e834733883eab14705b20c6/users/a6a020f24a2f40e686f297422a4251c5/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:14.822987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e292-8230-4253-9219-a257a6c55eaf None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:14.823285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e292-8230-4253-9219-a257a6c55eaf None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:14.823569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6e292-8230-4253-9219-a257a6c55eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:14.848771 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1aa30-334b-4794-8cef-15e5f62f5a1c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:14.852198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-77f1aa30-334b-4794-8cef-15e5f62f5a1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:14.860090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-72f6e292-8230-4253-9219-a257a6c55eaf None None] MFA Rules not processed for user `a6a020f24a2f40e686f297422a4251c5`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:14.861379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-72f6e292-8230-4253-9219-a257a6c55eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:14.965785 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1aa30-334b-4794-8cef-15e5f62f5a1c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:14.973217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba0602-67e8-41b5-a1b2-9ef8d818b059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:14.976029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba0602-67e8-41b5-a1b2-9ef8d818b059 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:14.976029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba0602-67e8-41b5-a1b2-9ef8d818b059 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:14.976029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba0602-67e8-41b5-a1b2-9ef8d818b059 admin admin] PATH_INFO: `/v3/projects/cf2bb829713e4e4d9dbcd0a549acc249` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:14.976708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba0602-67e8-41b5-a1b2-9ef8d818b059 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf2bb829713e4e4d9dbcd0a549acc249)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:14.979915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba0602-67e8-41b5-a1b2-9ef8d818b059 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:14.997847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 970/1945] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:15.149507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6e292-8230-4253-9219-a257a6c55eaf None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:15.152381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-72f6e292-8230-4253-9219-a257a6c55eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:15.185118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-75ba0602-67e8-41b5-a1b2-9ef8d818b059 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf2bb829713e4e4d9dbcd0a549acc249', 'request_id': 'req-75ba0602-67e8-41b5-a1b2-9ef8d818b059'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:15.193961 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-75ba0602-67e8-41b5-a1b2-9ef8d818b059 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf2bb829713e4e4d9dbcd0a549acc249', 'request_id': 'req-75ba0602-67e8-41b5-a1b2-9ef8d818b059'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:15.202587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-75ba0602-67e8-41b5-a1b2-9ef8d818b059 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf2bb829713e4e4d9dbcd0a549acc249', 'request_id': 'req-75ba0602-67e8-41b5-a1b2-9ef8d818b059'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:15.230762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6e292-8230-4253-9219-a257a6c55eaf None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:15.281131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6f042-8974-4c7a-be5f-72afd9da0f67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:15.281675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6f042-8974-4c7a-be5f-72afd9da0f67 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:15.281957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6f042-8974-4c7a-be5f-72afd9da0f67 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:15.282231 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6f042-8974-4c7a-be5f-72afd9da0f67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:15.336194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-75ba0602-67e8-41b5-a1b2-9ef8d818b059 admin admin] The token cache is being invalidate because project cf2bb829713e4e4d9dbcd0a549acc249 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:15.337589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-75ba0602-67e8-41b5-a1b2-9ef8d818b059 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:15.339650 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-75ba0602-67e8-41b5-a1b2-9ef8d818b059 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:15.342226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 976/1946] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:14 2022] DELETE /identity/v3/projects/cf2bb829713e4e4d9dbcd0a549acc249 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:15.348000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7146b0-f734-4112-b9e8-c1de5242e8c7 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:15.348581 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7146b0-f734-4112-b9e8-c1de5242e8c7 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:15.348883 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7146b0-f734-4112-b9e8-c1de5242e8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:15.365155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6f042-8974-4c7a-be5f-72afd9da0f67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:15.367096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6f042-8974-4c7a-be5f-72afd9da0f67 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:15.381365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 971/1947] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:15 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:11:15.408147 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5d7146b0-f734-4112-b9e8-c1de5242e8c7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:15.409406 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5d7146b0-f734-4112-b9e8-c1de5242e8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:15.538529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 977/1948] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:15.541228 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6f042-8974-4c7a-be5f-72afd9da0f67 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:15.547781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc0b5c-2e0a-43be-9fb5-72e9ee7f3264 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:15.549833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc0b5c-2e0a-43be-9fb5-72e9ee7f3264 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:15.550276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdc0b5c-2e0a-43be-9fb5-72e9ee7f3264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:15.560164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6f042-8974-4c7a-be5f-72afd9da0f67 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:15.582261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51616b-e195-4436-94ca-69ec422f7222 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:15.585949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51616b-e195-4436-94ca-69ec422f7222 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:15.586252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51616b-e195-4436-94ca-69ec422f7222 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:15.586548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f51616b-e195-4436-94ca-69ec422f7222 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:15.594783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-1f51616b-e195-4436-94ca-69ec422f7222 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:15.616440 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-2fdc0b5c-2e0a-43be-9fb5-72e9ee7f3264 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:15.619987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2fdc0b5c-2e0a-43be-9fb5-72e9ee7f3264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:15.646180 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 978/1949] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:15.650634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc0b5c-2e0a-43be-9fb5-72e9ee7f3264 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:15.662240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdc0b5c-2e0a-43be-9fb5-72e9ee7f3264 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:15.673707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e825c-0389-49f1-97fe-cb6be54df0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:15.674383 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e825c-0389-49f1-97fe-cb6be54df0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:15.674670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e825c-0389-49f1-97fe-cb6be54df0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:15.675008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e825c-0389-49f1-97fe-cb6be54df0a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:15.675679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e825c-0389-49f1-97fe-cb6be54df0a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:15.676016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e825c-0389-49f1-97fe-cb6be54df0a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:15.678006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985e825c-0389-49f1-97fe-cb6be54df0a3 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:15.690716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 979/1950] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:15.694900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e825c-0389-49f1-97fe-cb6be54df0a3 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:15.705769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985e825c-0389-49f1-97fe-cb6be54df0a3 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:15.706994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51616b-e195-4436-94ca-69ec422f7222 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:15.708598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f51616b-e195-4436-94ca-69ec422f7222 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:15.710522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beba50d-7715-40e2-a0d4-0ffc0940d889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:15.714707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba50d-7715-40e2-a0d4-0ffc0940d889 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:15.714707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba50d-7715-40e2-a0d4-0ffc0940d889 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:15.714707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beba50d-7715-40e2-a0d4-0ffc0940d889 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:15.714707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beba50d-7715-40e2-a0d4-0ffc0940d889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:15.714707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beba50d-7715-40e2-a0d4-0ffc0940d889 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:15.719119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 972/1951] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:15.824305 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 980/1952] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:15 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:11:15.828313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51616b-e195-4436-94ca-69ec422f7222 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:15.844531 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f51616b-e195-4436-94ca-69ec422f7222 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:15.914580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac9be9-af28-4b6d-a725-c10c9849e941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:15.915285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac9be9-af28-4b6d-a725-c10c9849e941 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:15.915568 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac9be9-af28-4b6d-a725-c10c9849e941 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:15.916089 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac9be9-af28-4b6d-a725-c10c9849e941 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:15.916847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac9be9-af28-4b6d-a725-c10c9849e941 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:15.918790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac9be9-af28-4b6d-a725-c10c9849e941 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:16.034071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 973/1953] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:15 2022] POST /identity/v3/users => generated 289 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:11:16.039182 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beba50d-7715-40e2-a0d4-0ffc0940d889 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:16.052949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beba50d-7715-40e2-a0d4-0ffc0940d889 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:16.058259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d96aa-c454-49cd-9957-bd6591ca5f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:16.059127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d96aa-c454-49cd-9957-bd6591ca5f57 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:16.059213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d96aa-c454-49cd-9957-bd6591ca5f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:16.059765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d96aa-c454-49cd-9957-bd6591ca5f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:16.060780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d96aa-c454-49cd-9957-bd6591ca5f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:16.062500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d96aa-c454-49cd-9957-bd6591ca5f57 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:16.110173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 981/1954] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:16.113997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac9be9-af28-4b6d-a725-c10c9849e941 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:16.125251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac9be9-af28-4b6d-a725-c10c9849e941 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:16.129806 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:16.145467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cec68-1cf4-422b-84ce-2a873c41ef03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:16.145902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cec68-1cf4-422b-84ce-2a873c41ef03 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:16.146191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cec68-1cf4-422b-84ce-2a873c41ef03 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:16.146470 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cec68-1cf4-422b-84ce-2a873c41ef03 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:16.147215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cec68-1cf4-422b-84ce-2a873c41ef03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:16.149370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cec68-1cf4-422b-84ce-2a873c41ef03 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:16.172481 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 974/1955] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:16.176575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d96aa-c454-49cd-9957-bd6591ca5f57 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:16.188136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d96aa-c454-49cd-9957-bd6591ca5f57 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:16.200825 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7834-c113-4493-8b66-0c54294bbc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:16.201751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7834-c113-4493-8b66-0c54294bbc2a admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:16.202321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7834-c113-4493-8b66-0c54294bbc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:16.203966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff7834-c113-4493-8b66-0c54294bbc2a admin admin] PATH_INFO: `/v3/projects/97aeb2a7be57458ba3a493f830a3ac03/users/2410189ae9fd420182f33e10f211340f/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:16.227347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7834-c113-4493-8b66-0c54294bbc2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=97aeb2a7be57458ba3a493f830a3ac03, user_id=2410189ae9fd420182f33e10f211340f, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:16.234450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff7834-c113-4493-8b66-0c54294bbc2a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:16.524242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 982/1956] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:16 2022] PUT /identity/v3/projects/97aeb2a7be57458ba3a493f830a3ac03/users/2410189ae9fd420182f33e10f211340f/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:16.534179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fee145-e91f-4255-8f36-9259288584d6 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:16.534466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fee145-e91f-4255-8f36-9259288584d6 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:16.534750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fee145-e91f-4255-8f36-9259288584d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:16.586136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-43fee145-e91f-4255-8f36-9259288584d6 None None] MFA Rules not processed for user `2410189ae9fd420182f33e10f211340f`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:16.587560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-43fee145-e91f-4255-8f36-9259288584d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:16.735474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 975/1957] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:16 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:16.742133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7834-c113-4493-8b66-0c54294bbc2a admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:16.879193 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff7834-c113-4493-8b66-0c54294bbc2a admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:16.890030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5dbb0c-00d7-431c-a868-b6bfa6161bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:16.891090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dbb0c-00d7-431c-a868-b6bfa6161bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:16.891594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dbb0c-00d7-431c-a868-b6bfa6161bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:16.894395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5dbb0c-00d7-431c-a868-b6bfa6161bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:16.895386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5dbb0c-00d7-431c-a868-b6bfa6161bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:16.901460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5dbb0c-00d7-431c-a868-b6bfa6161bd8 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:17.028667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 983/1958] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:16 2022] POST /identity/v3/projects => generated 377 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:17.032723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fee145-e91f-4255-8f36-9259288584d6 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:17.050612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fee145-e91f-4255-8f36-9259288584d6 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:17.134434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaec9bf-8ec8-4874-9e99-26fd5eb045c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:17.135451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaec9bf-8ec8-4874-9e99-26fd5eb045c9 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:17.135979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaec9bf-8ec8-4874-9e99-26fd5eb045c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:17.136812 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaec9bf-8ec8-4874-9e99-26fd5eb045c9 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:17.137165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaec9bf-8ec8-4874-9e99-26fd5eb045c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:17.139204 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaec9bf-8ec8-4874-9e99-26fd5eb045c9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:17.282879 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 976/1959] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:17 2022] POST /identity/v3/users => generated 289 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:11:17.289817 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5dbb0c-00d7-431c-a868-b6bfa6161bd8 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:17.320175 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5dbb0c-00d7-431c-a868-b6bfa6161bd8 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:17.334064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1083fa1-74ad-4478-a0b6-5c77b02ed66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:17.334815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1083fa1-74ad-4478-a0b6-5c77b02ed66c admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:17.335167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1083fa1-74ad-4478-a0b6-5c77b02ed66c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:17.335746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1083fa1-74ad-4478-a0b6-5c77b02ed66c admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:17.344800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1083fa1-74ad-4478-a0b6-5c77b02ed66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:17.346922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1083fa1-74ad-4478-a0b6-5c77b02ed66c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:17.371640 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 984/1960] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:17.371729 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaec9bf-8ec8-4874-9e99-26fd5eb045c9 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:17.384210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaec9bf-8ec8-4874-9e99-26fd5eb045c9 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:17.389819 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf0fa8d-14fe-49fe-b84f-beeae5b66e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:17.392228 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0fa8d-14fe-49fe-b84f-beeae5b66e2c admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:17.392588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0fa8d-14fe-49fe-b84f-beeae5b66e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:17.392860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0fa8d-14fe-49fe-b84f-beeae5b66e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:17.393663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0fa8d-14fe-49fe-b84f-beeae5b66e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:17.396179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf0fa8d-14fe-49fe-b84f-beeae5b66e2c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:17.422979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 977/1961] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:17 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:17.432129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1083fa1-74ad-4478-a0b6-5c77b02ed66c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:17.438474 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1083fa1-74ad-4478-a0b6-5c77b02ed66c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:17.444906 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607284aa-4e8f-4399-9609-9a22078f1b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:17.447049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607284aa-4e8f-4399-9609-9a22078f1b73 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:17.450836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607284aa-4e8f-4399-9609-9a22078f1b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:17.451174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607284aa-4e8f-4399-9609-9a22078f1b73 admin admin] PATH_INFO: `/v3/projects/34cb306a7268470985ca7d3d5690b81d/users/609ad5fce28344c88f3fcc1435baa8fb/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:17.489804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607284aa-4e8f-4399-9609-9a22078f1b73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34cb306a7268470985ca7d3d5690b81d, user_id=609ad5fce28344c88f3fcc1435baa8fb, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:17.492598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607284aa-4e8f-4399-9609-9a22078f1b73 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:17.603357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 985/1962] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:17 2022] PUT /identity/v3/projects/34cb306a7268470985ca7d3d5690b81d/users/609ad5fce28344c88f3fcc1435baa8fb/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:11:17.612782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa4dfe-8280-4259-8333-1bf21355663e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:17.613079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa4dfe-8280-4259-8333-1bf21355663e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:17.613470 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa4dfe-8280-4259-8333-1bf21355663e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:17.659383 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-acaa4dfe-8280-4259-8333-1bf21355663e None None] MFA Rules not processed for user `609ad5fce28344c88f3fcc1435baa8fb`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:17.661321 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-acaa4dfe-8280-4259-8333-1bf21355663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:17.746107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 978/1963] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:17.747674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607284aa-4e8f-4399-9609-9a22078f1b73 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:17.786105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:17.847024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607284aa-4e8f-4399-9609-9a22078f1b73 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:17.853353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad943681-a4d1-4a75-a16d-7eb14f8b8755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:17.853353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad943681-a4d1-4a75-a16d-7eb14f8b8755 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:17.854236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad943681-a4d1-4a75-a16d-7eb14f8b8755 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:17.854348 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad943681-a4d1-4a75-a16d-7eb14f8b8755 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:17.855425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad943681-a4d1-4a75-a16d-7eb14f8b8755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:17.857461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad943681-a4d1-4a75-a16d-7eb14f8b8755 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:17.994544 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 986/1964] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:17 2022] POST /identity/v3/projects => generated 377 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:18.007929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa4dfe-8280-4259-8333-1bf21355663e None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:18.011875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa4dfe-8280-4259-8333-1bf21355663e None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:18.025084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad943681-a4d1-4a75-a16d-7eb14f8b8755 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:18.027977 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ad943681-a4d1-4a75-a16d-7eb14f8b8755 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:18.094882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8ef23-e39a-41e1-aaa4-6179b2fa5cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:18.096577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8ef23-e39a-41e1-aaa4-6179b2fa5cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:18.097321 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8ef23-e39a-41e1-aaa4-6179b2fa5cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:18.097669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e8ef23-e39a-41e1-aaa4-6179b2fa5cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:18.098847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8ef23-e39a-41e1-aaa4-6179b2fa5cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:18.100975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e8ef23-e39a-41e1-aaa4-6179b2fa5cb8 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:18.125574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad943681-a4d1-4a75-a16d-7eb14f8b8755 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:18.131772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03139b0c-4272-487b-8c01-a951ac0775d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:18.132858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03139b0c-4272-487b-8c01-a951ac0775d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:18.135920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03139b0c-4272-487b-8c01-a951ac0775d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:18.135920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03139b0c-4272-487b-8c01-a951ac0775d1 admin admin] PATH_INFO: `/v3/users/623e74f38143433d9b354edb3c094529` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:18.135920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03139b0c-4272-487b-8c01-a951ac0775d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=623e74f38143433d9b354edb3c094529)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:18.137119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03139b0c-4272-487b-8c01-a951ac0775d1 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:18.271154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 979/1965] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:17 2022] POST /identity/v3/users => generated 295 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:18.274970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8ef23-e39a-41e1-aaa4-6179b2fa5cb8 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:18.288407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e8ef23-e39a-41e1-aaa4-6179b2fa5cb8 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:18.293945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98235981-e0be-4d4b-82fc-0327647fd19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:18.294617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98235981-e0be-4d4b-82fc-0327647fd19a admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:18.295237 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98235981-e0be-4d4b-82fc-0327647fd19a admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:18.295450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98235981-e0be-4d4b-82fc-0327647fd19a admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:18.296220 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98235981-e0be-4d4b-82fc-0327647fd19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:18.300047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98235981-e0be-4d4b-82fc-0327647fd19a admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:18.319862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 980/1966] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:11:18.324757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98235981-e0be-4d4b-82fc-0327647fd19a admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:18.337005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98235981-e0be-4d4b-82fc-0327647fd19a admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:18.343287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8b072-d8da-41df-ab00-e68df475598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:18.344384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8b072-d8da-41df-ab00-e68df475598c admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:18.351137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8b072-d8da-41df-ab00-e68df475598c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:18.351137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8b072-d8da-41df-ab00-e68df475598c admin admin] PATH_INFO: `/v3/projects/3c27d7eee8604c808b8040b91f118122/users/1fa506abab0c4595892680af3b24a568/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:18.380941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-03139b0c-4272-487b-8c01-a951ac0775d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '623e74f38143433d9b354edb3c094529'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:18.381443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8b072-d8da-41df-ab00-e68df475598c admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c27d7eee8604c808b8040b91f118122, user_id=1fa506abab0c4595892680af3b24a568, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:18.386156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8b072-d8da-41df-ab00-e68df475598c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:18.397185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-03139b0c-4272-487b-8c01-a951ac0775d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '623e74f38143433d9b354edb3c094529'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:18.398095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-03139b0c-4272-487b-8c01-a951ac0775d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '623e74f38143433d9b354edb3c094529'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:18.398833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-03139b0c-4272-487b-8c01-a951ac0775d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '623e74f38143433d9b354edb3c094529'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:18.489753 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 981/1967] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:18 2022] PUT /identity/v3/projects/3c27d7eee8604c808b8040b91f118122/users/1fa506abab0c4595892680af3b24a568/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:18.494024 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8b072-d8da-41df-ab00-e68df475598c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:18.498018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-dea8b072-d8da-41df-ab00-e68df475598c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:18.517590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-03139b0c-4272-487b-8c01-a951ac0775d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '623e74f38143433d9b354edb3c094529'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:18.538760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 987/1968] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:18 2022] DELETE /identity/v3/users/623e74f38143433d9b354edb3c094529 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:11:18.543181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa625c-ba19-4408-b6f3-bda83fbe75dd None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:18.543698 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa625c-ba19-4408-b6f3-bda83fbe75dd None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:18.544159 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa625c-ba19-4408-b6f3-bda83fbe75dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:18.566896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-d8aa625c-ba19-4408-b6f3-bda83fbe75dd None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:18.568499 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d8aa625c-ba19-4408-b6f3-bda83fbe75dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:18.663691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8b072-d8da-41df-ab00-e68df475598c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:18.706310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 988/1969] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:18.715011 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa625c-ba19-4408-b6f3-bda83fbe75dd None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:18.718326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d8aa625c-ba19-4408-b6f3-bda83fbe75dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:18.792053 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf677a-171d-4bdf-8c0c-ef618c418708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:18.792839 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf677a-171d-4bdf-8c0c-ef618c418708 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:18.793137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf677a-171d-4bdf-8c0c-ef618c418708 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:18.793418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf677a-171d-4bdf-8c0c-ef618c418708 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:18.794462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf677a-171d-4bdf-8c0c-ef618c418708 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:18.796454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf677a-171d-4bdf-8c0c-ef618c418708 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:18.810870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa625c-ba19-4408-b6f3-bda83fbe75dd None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:18.814770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 982/1970] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:11:18.816328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf677a-171d-4bdf-8c0c-ef618c418708 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:18.818029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3453300-522c-4497-8ebd-1e58d87a96e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:18.818885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453300-522c-4497-8ebd-1e58d87a96e6 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:18.819226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453300-522c-4497-8ebd-1e58d87a96e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:18.819629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3453300-522c-4497-8ebd-1e58d87a96e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:18.830535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf677a-171d-4bdf-8c0c-ef618c418708 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:18.831734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3453300-522c-4497-8ebd-1e58d87a96e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:18.833424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3453300-522c-4497-8ebd-1e58d87a96e6 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:18.837747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5f58d-81da-4d76-8985-a3da27ee7301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:18.839175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5f58d-81da-4d76-8985-a3da27ee7301 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:18.839607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5f58d-81da-4d76-8985-a3da27ee7301 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:18.840109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5f58d-81da-4d76-8985-a3da27ee7301 admin admin] PATH_INFO: `/v3/projects/3c27d7eee8604c808b8040b91f118122/users/1fa506abab0c4595892680af3b24a568/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:18.844748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5f58d-81da-4d76-8985-a3da27ee7301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c27d7eee8604c808b8040b91f118122, user_id=1fa506abab0c4595892680af3b24a568, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:18.848332 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5f58d-81da-4d76-8985-a3da27ee7301 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:18.858928 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 989/1971] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:11:18.863492 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 983/1972] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:18 2022] PUT /identity/v3/projects/3c27d7eee8604c808b8040b91f118122/users/1fa506abab0c4595892680af3b24a568/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:18.875989 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0edb-b6a2-4055-a0f9-edb139e9effb None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:18.876353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0edb-b6a2-4055-a0f9-edb139e9effb None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:18.876634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3d0edb-b6a2-4055-a0f9-edb139e9effb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:18.908490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3a3d0edb-b6a2-4055-a0f9-edb139e9effb None None] MFA Rules not processed for user `1fa506abab0c4595892680af3b24a568`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:18.911316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3a3d0edb-b6a2-4055-a0f9-edb139e9effb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:19.021043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 990/1973] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:19.080607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5f58d-81da-4d76-8985-a3da27ee7301 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:19.082445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-edf5f58d-81da-4d76-8985-a3da27ee7301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:19.162861 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5f58d-81da-4d76-8985-a3da27ee7301 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:19.167947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b912f92-c183-4c9a-ba0b-ab3b765df2c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:19.168910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912f92-c183-4c9a-ba0b-ab3b765df2c8 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:19.169251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912f92-c183-4c9a-ba0b-ab3b765df2c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:19.169782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b912f92-c183-4c9a-ba0b-ab3b765df2c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:19.173191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-1b912f92-c183-4c9a-ba0b-ab3b765df2c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:19.243011 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b912f92-c183-4c9a-ba0b-ab3b765df2c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:19.244748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b912f92-c183-4c9a-ba0b-ab3b765df2c8 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:19.256403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 984/1974] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:19.577020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0edb-b6a2-4055-a0f9-edb139e9effb None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:19.578566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3a3d0edb-b6a2-4055-a0f9-edb139e9effb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:19.635223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:19.751427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3d0edb-b6a2-4055-a0f9-edb139e9effb None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:19.764935 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:19.765929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:19.766312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:19.766585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] PATH_INFO: `/v3/projects/e407d247bdac42f99fe4a840576e95b2` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:19.767849 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e407d247bdac42f99fe4a840576e95b2)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:19.769887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:20.001472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e407d247bdac42f99fe4a840576e95b2', 'request_id': 'req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:20.013773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e407d247bdac42f99fe4a840576e95b2', 'request_id': 'req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:20.026392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e407d247bdac42f99fe4a840576e95b2', 'request_id': 'req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:20.139286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] The token cache is being invalidate because project e407d247bdac42f99fe4a840576e95b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:20.139286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:20.139286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:20.139286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 991/1975] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:19 2022] DELETE /identity/v3/projects/e407d247bdac42f99fe4a840576e95b2 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:20.143953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b912f92-c183-4c9a-ba0b-ab3b765df2c8 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:20.157024 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b912f92-c183-4c9a-ba0b-ab3b765df2c8 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:20.221623 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321e908e-75fe-438b-a7f9-fd4bdfb18113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:20.230585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e908e-75fe-438b-a7f9-fd4bdfb18113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:20.230585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e908e-75fe-438b-a7f9-fd4bdfb18113 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:20.230585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321e908e-75fe-438b-a7f9-fd4bdfb18113 admin admin] PATH_INFO: `/v3/users/c3730dd0dc3d4f559755c546598e8b0b` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:20.230585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e908e-75fe-438b-a7f9-fd4bdfb18113 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3730dd0dc3d4f559755c546598e8b0b)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:20.230585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321e908e-75fe-438b-a7f9-fd4bdfb18113 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:20.505505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-321e908e-75fe-438b-a7f9-fd4bdfb18113 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3730dd0dc3d4f559755c546598e8b0b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:20.506163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-321e908e-75fe-438b-a7f9-fd4bdfb18113 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3730dd0dc3d4f559755c546598e8b0b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:20.506757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-321e908e-75fe-438b-a7f9-fd4bdfb18113 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3730dd0dc3d4f559755c546598e8b0b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:20.586874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-321e908e-75fe-438b-a7f9-fd4bdfb18113 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3730dd0dc3d4f559755c546598e8b0b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:20.595269 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-321e908e-75fe-438b-a7f9-fd4bdfb18113 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3730dd0dc3d4f559755c546598e8b0b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:20.612840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 985/1976] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:20 2022] DELETE /identity/v3/users/c3730dd0dc3d4f559755c546598e8b0b => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:21.273802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:21.275334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:21.289481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dafd36-af8e-4c2c-beb0-d59b3dcbe376 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:21.348280 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:21.349308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:21.349621 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:21.349908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] PATH_INFO: `/v3/projects/3ce96700f277484499a5913cbcf4b897` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:21.351085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ce96700f277484499a5913cbcf4b897)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:21.353042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:21.506208 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ce96700f277484499a5913cbcf4b897', 'request_id': 'req-34fb4b49-4a81-4a16-a714-2e2961694e17'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:21.511593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ce96700f277484499a5913cbcf4b897', 'request_id': 'req-34fb4b49-4a81-4a16-a714-2e2961694e17'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:21.518026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ce96700f277484499a5913cbcf4b897', 'request_id': 'req-34fb4b49-4a81-4a16-a714-2e2961694e17'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:21.569116 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:21.642797 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] The token cache is being invalidate because project 3ce96700f277484499a5913cbcf4b897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:21.643131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:21.643899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:21.645568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 992/1977] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:21 2022] DELETE /identity/v3/projects/3ce96700f277484499a5913cbcf4b897 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:21.655199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a5878-b588-48a6-afcc-049bdb4fe2c2 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:21.655311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a5878-b588-48a6-afcc-049bdb4fe2c2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:21.655591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1a5878-b588-48a6-afcc-049bdb4fe2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:21.677845 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-2d1a5878-b588-48a6-afcc-049bdb4fe2c2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:21.679200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2d1a5878-b588-48a6-afcc-049bdb4fe2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:21.703489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:21.704950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:21.740490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 986/1978] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:21.748488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2232-08d1-4ed4-bd07-8b81dd9c4a6b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:21.748782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2232-08d1-4ed4-bd07-8b81dd9c4a6b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:21.749060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c2232-08d1-4ed4-bd07-8b81dd9c4a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:21.764343 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb4b49-4a81-4a16-a714-2e2961694e17 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:21.767241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-d44c2232-08d1-4ed4-bd07-8b81dd9c4a6b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:21.768205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b584e-9252-43f3-af91-2f9c1651a3dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:21.768392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d44c2232-08d1-4ed4-bd07-8b81dd9c4a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:21.768859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b584e-9252-43f3-af91-2f9c1651a3dc service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:21.771294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b584e-9252-43f3-af91-2f9c1651a3dc service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:21.771294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45b584e-9252-43f3-af91-2f9c1651a3dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:21.771294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e45b584e-9252-43f3-af91-2f9c1651a3dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:21.777323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 987/1979] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:21.781831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c2232-08d1-4ed4-bd07-8b81dd9c4a6b None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:21.792157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c2232-08d1-4ed4-bd07-8b81dd9c4a6b None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:21.800015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a5605-23c8-4a64-825c-de198096143c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:21.802214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a5605-23c8-4a64-825c-de198096143c admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:21.802496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a5605-23c8-4a64-825c-de198096143c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:21.802778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a5605-23c8-4a64-825c-de198096143c admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:21.803646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a5605-23c8-4a64-825c-de198096143c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:21.803984 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a5605-23c8-4a64-825c-de198096143c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:21.805603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a5605-23c8-4a64-825c-de198096143c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:21.818375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 988/1980] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:11:21.823431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a5605-23c8-4a64-825c-de198096143c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:21.835103 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a5605-23c8-4a64-825c-de198096143c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:21.836213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b584e-9252-43f3-af91-2f9c1651a3dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:21.837679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45b584e-9252-43f3-af91-2f9c1651a3dc service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:21.841561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cd222-d4be-4cce-8de2-76a339ab8b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:21.842307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cd222-d4be-4cce-8de2-76a339ab8b64 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:21.842596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cd222-d4be-4cce-8de2-76a339ab8b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:21.842876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cd222-d4be-4cce-8de2-76a339ab8b64 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:21.843612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cd222-d4be-4cce-8de2-76a339ab8b64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:21.845530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cd222-d4be-4cce-8de2-76a339ab8b64 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:21.848367 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 993/1981] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:11:22.000143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 989/1982] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:21 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:11:22.004502 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b584e-9252-43f3-af91-2f9c1651a3dc service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:22.016503 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45b584e-9252-43f3-af91-2f9c1651a3dc service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:22.078281 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025d0d2-c4a9-4bc8-82b8-d5f5268b4ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:22.079030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025d0d2-c4a9-4bc8-82b8-d5f5268b4ddc admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:22.079319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025d0d2-c4a9-4bc8-82b8-d5f5268b4ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:22.079597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b025d0d2-c4a9-4bc8-82b8-d5f5268b4ddc admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:22.080343 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025d0d2-c4a9-4bc8-82b8-d5f5268b4ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:22.082333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b025d0d2-c4a9-4bc8-82b8-d5f5268b4ddc admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:22.278074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 994/1983] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:22 2022] POST /identity/v3/users => generated 292 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:22.282238 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cd222-d4be-4cce-8de2-76a339ab8b64 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:22.293018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cd222-d4be-4cce-8de2-76a339ab8b64 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:22.298387 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43952a-c1f0-4d46-9f22-47c99d4885bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:22.299472 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43952a-c1f0-4d46-9f22-47c99d4885bf admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:22.300083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43952a-c1f0-4d46-9f22-47c99d4885bf admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:22.300526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e43952a-c1f0-4d46-9f22-47c99d4885bf admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:22.301900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43952a-c1f0-4d46-9f22-47c99d4885bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:22.305062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e43952a-c1f0-4d46-9f22-47c99d4885bf admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:22.318721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 990/1984] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:22.323625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025d0d2-c4a9-4bc8-82b8-d5f5268b4ddc admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:22.334026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b025d0d2-c4a9-4bc8-82b8-d5f5268b4ddc admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:22.338838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337f1d69-77b1-4170-80fd-b3491a588ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:22.339500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1d69-77b1-4170-80fd-b3491a588ceb admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:22.339782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1d69-77b1-4170-80fd-b3491a588ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:22.340107 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337f1d69-77b1-4170-80fd-b3491a588ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:22.340826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f1d69-77b1-4170-80fd-b3491a588ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:22.342432 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337f1d69-77b1-4170-80fd-b3491a588ceb admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:22.352521 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 995/1985] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:22.356778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43952a-c1f0-4d46-9f22-47c99d4885bf admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:22.357439 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:22.366781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e43952a-c1f0-4d46-9f22-47c99d4885bf admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:22.371978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cf8a5-b6e0-4cc1-9712-3c5eb643e3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:22.372858 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf8a5-b6e0-4cc1-9712-3c5eb643e3e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:22.373143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf8a5-b6e0-4cc1-9712-3c5eb643e3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:22.373421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585cf8a5-b6e0-4cc1-9712-3c5eb643e3e2 admin admin] PATH_INFO: `/v3/projects/89b0059a57e04ce8bd4bb204ef5efa84/users/380bfa61e14149168bdb69024161603d/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:22.388452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cf8a5-b6e0-4cc1-9712-3c5eb643e3e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89b0059a57e04ce8bd4bb204ef5efa84, user_id=380bfa61e14149168bdb69024161603d, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:22.391224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585cf8a5-b6e0-4cc1-9712-3c5eb643e3e2 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:22.545698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 991/1986] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:22 2022] PUT /identity/v3/projects/89b0059a57e04ce8bd4bb204ef5efa84/users/380bfa61e14149168bdb69024161603d/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:22.558090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3430a9-b5e8-4c80-b02f-55178ba46e45 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:22.558388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3430a9-b5e8-4c80-b02f-55178ba46e45 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:22.558671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3430a9-b5e8-4c80-b02f-55178ba46e45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:22.587048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-ac3430a9-b5e8-4c80-b02f-55178ba46e45 None None] MFA Rules not processed for user `380bfa61e14149168bdb69024161603d`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:22.588654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ac3430a9-b5e8-4c80-b02f-55178ba46e45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:22.655717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 996/1987] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:22.660624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cf8a5-b6e0-4cc1-9712-3c5eb643e3e2 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:22.726505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585cf8a5-b6e0-4cc1-9712-3c5eb643e3e2 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:22.731327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fd4cf-20ba-4b98-9ee8-546dd48afb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:22.732029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fd4cf-20ba-4b98-9ee8-546dd48afb55 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:22.732324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fd4cf-20ba-4b98-9ee8-546dd48afb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:22.732603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09fd4cf-20ba-4b98-9ee8-546dd48afb55 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:22.733347 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fd4cf-20ba-4b98-9ee8-546dd48afb55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:22.735302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09fd4cf-20ba-4b98-9ee8-546dd48afb55 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:22.879934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 992/1988] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:22 2022] POST /identity/v3/projects => generated 387 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:22.881138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3430a9-b5e8-4c80-b02f-55178ba46e45 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:22.892744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3430a9-b5e8-4c80-b02f-55178ba46e45 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:22.949838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0ea3-cc7d-4f1d-b652-f6939bc89f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:22.950539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0ea3-cc7d-4f1d-b652-f6939bc89f63 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:22.950821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0ea3-cc7d-4f1d-b652-f6939bc89f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:22.951123 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e0ea3-cc7d-4f1d-b652-f6939bc89f63 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:22.951820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0ea3-cc7d-4f1d-b652-f6939bc89f63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:22.953887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e0ea3-cc7d-4f1d-b652-f6939bc89f63 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:23.148654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 997/1989] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:22 2022] POST /identity/v3/users => generated 300 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:23.150881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fd4cf-20ba-4b98-9ee8-546dd48afb55 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:23.161668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09fd4cf-20ba-4b98-9ee8-546dd48afb55 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:23.167875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97659c7-c5c9-48ae-bda3-5d234b767fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:23.168587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97659c7-c5c9-48ae-bda3-5d234b767fbf admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:23.168848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97659c7-c5c9-48ae-bda3-5d234b767fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:23.169127 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97659c7-c5c9-48ae-bda3-5d234b767fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:23.169890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97659c7-c5c9-48ae-bda3-5d234b767fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:23.171530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97659c7-c5c9-48ae-bda3-5d234b767fbf admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:23.184275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 993/1990] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:23.189183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0ea3-cc7d-4f1d-b652-f6939bc89f63 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:23.200577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e0ea3-cc7d-4f1d-b652-f6939bc89f63 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:23.205274 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec08cf-89d5-436a-a559-064cacc524b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:23.206167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec08cf-89d5-436a-a559-064cacc524b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:23.206448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec08cf-89d5-436a-a559-064cacc524b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:23.206727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ec08cf-89d5-436a-a559-064cacc524b7 admin admin] PATH_INFO: `/v3/projects/762fda97d0e64f51baa64d11f4b92c3c/users/9e86d615dc05492c83b29c5c634cd6c9/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:23.222064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec08cf-89d5-436a-a559-064cacc524b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762fda97d0e64f51baa64d11f4b92c3c, user_id=9e86d615dc05492c83b29c5c634cd6c9, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:23.224903 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ec08cf-89d5-436a-a559-064cacc524b7 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:23.530562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 998/1991] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:23 2022] PUT /identity/v3/projects/762fda97d0e64f51baa64d11f4b92c3c/users/9e86d615dc05492c83b29c5c634cd6c9/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:23.534682 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97659c7-c5c9-48ae-bda3-5d234b767fbf admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:23.544655 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97659c7-c5c9-48ae-bda3-5d234b767fbf admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:23.601803 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92279e74-36a6-4314-b9bb-7da32f7e4e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:23.602473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92279e74-36a6-4314-b9bb-7da32f7e4e6e admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:23.608445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92279e74-36a6-4314-b9bb-7da32f7e4e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:23.608445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92279e74-36a6-4314-b9bb-7da32f7e4e6e admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:23.608445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92279e74-36a6-4314-b9bb-7da32f7e4e6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:23.608445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92279e74-36a6-4314-b9bb-7da32f7e4e6e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:23.615727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 994/1992] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:23.620304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec08cf-89d5-436a-a559-064cacc524b7 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:23.630872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ec08cf-89d5-436a-a559-064cacc524b7 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:23.636104 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcf480-5ffa-42bf-9dd8-453a9b846e52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:23.642947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcf480-5ffa-42bf-9dd8-453a9b846e52 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:23.642947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcf480-5ffa-42bf-9dd8-453a9b846e52 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:23.642947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fcf480-5ffa-42bf-9dd8-453a9b846e52 admin admin] PATH_INFO: `/v3/projects/762fda97d0e64f51baa64d11f4b92c3c/users/9e86d615dc05492c83b29c5c634cd6c9/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:23.642947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcf480-5ffa-42bf-9dd8-453a9b846e52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=762fda97d0e64f51baa64d11f4b92c3c, user_id=9e86d615dc05492c83b29c5c634cd6c9, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:23.642947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fcf480-5ffa-42bf-9dd8-453a9b846e52 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:23.653312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 999/1993] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:23 2022] PUT /identity/v3/projects/762fda97d0e64f51baa64d11f4b92c3c/users/9e86d615dc05492c83b29c5c634cd6c9/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:23.663738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49775546-201f-4f90-8fb0-83f4ba874a3d None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:23.664260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49775546-201f-4f90-8fb0-83f4ba874a3d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:23.664445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49775546-201f-4f90-8fb0-83f4ba874a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:23.698410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-49775546-201f-4f90-8fb0-83f4ba874a3d None None] MFA Rules not processed for user `9e86d615dc05492c83b29c5c634cd6c9`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:23.699662 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-49775546-201f-4f90-8fb0-83f4ba874a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:23.771144 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 995/1994] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:23.818446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcf480-5ffa-42bf-9dd8-453a9b846e52 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:23.820266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-11fcf480-5ffa-42bf-9dd8-453a9b846e52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:23.830820 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:23.862212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49775546-201f-4f90-8fb0-83f4ba874a3d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:23.930628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fcf480-5ffa-42bf-9dd8-453a9b846e52 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:23.935365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49775546-201f-4f90-8fb0-83f4ba874a3d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:23.938496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:23.939188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff79a71-5215-4eb4-ada8-dbd0a11d124a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:23.939885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff79a71-5215-4eb4-ada8-dbd0a11d124a service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:23.940000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:23.940171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff79a71-5215-4eb4-ada8-dbd0a11d124a service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:23.940404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:23.940496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff79a71-5215-4eb4-ada8-dbd0a11d124a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:23.940958 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] PATH_INFO: `/v3/users/14dd17761f3e4b86a3f20a78fa3e55f6` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:23.942289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] RBAC: Authorizing `identity:delete_user(user_id=14dd17761f3e4b86a3f20a78fa3e55f6)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:23.944267 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:23.951539 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff79a71-5215-4eb4-ada8-dbd0a11d124a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:23.953015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff79a71-5215-4eb4-ada8-dbd0a11d124a service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:23.962988 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 996/1995] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:11:24.294384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14dd17761f3e4b86a3f20a78fa3e55f6'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:24.298306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14dd17761f3e4b86a3f20a78fa3e55f6'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:24.299122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14dd17761f3e4b86a3f20a78fa3e55f6'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:24.299744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14dd17761f3e4b86a3f20a78fa3e55f6'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:24.303744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff79a71-5215-4eb4-ada8-dbd0a11d124a service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:24.316525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff79a71-5215-4eb4-ada8-dbd0a11d124a service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:24.323516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:24.323516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:24.324394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:24.324394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] PATH_INFO: `/v3/users/380bfa61e14149168bdb69024161603d` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:24.326341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] RBAC: Authorizing `identity:delete_user(user_id=380bfa61e14149168bdb69024161603d)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:24.330058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:24.397652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14dd17761f3e4b86a3f20a78fa3e55f6'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:24.423643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1000/1996] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:23 2022] DELETE /identity/v3/users/14dd17761f3e4b86a3f20a78fa3e55f6 => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:24.427049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:24.429603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:24.499988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bc0f63-6529-460b-8dd1-2801baa8008c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:24.506268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b59daa-8b38-4a79-95e2-c18634735d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:24.506937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b59daa-8b38-4a79-95e2-c18634735d18 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:24.507224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b59daa-8b38-4a79-95e2-c18634735d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:24.507503 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b59daa-8b38-4a79-95e2-c18634735d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:24.511441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f4b59daa-8b38-4a79-95e2-c18634735d18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:24.592034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b59daa-8b38-4a79-95e2-c18634735d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:24.593302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b59daa-8b38-4a79-95e2-c18634735d18 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:24.599150 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '380bfa61e14149168bdb69024161603d'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:24.600020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '380bfa61e14149168bdb69024161603d'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:24.600738 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '380bfa61e14149168bdb69024161603d'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:24.605528 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1001/1997] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:24 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:24.606949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76238ccb-f63b-45cb-8773-536a880865c9 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:24.607450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76238ccb-f63b-45cb-8773-536a880865c9 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:24.607733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76238ccb-f63b-45cb-8773-536a880865c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:24.625405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-76238ccb-f63b-45cb-8773-536a880865c9 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:24.626776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-76238ccb-f63b-45cb-8773-536a880865c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:24.677007 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '380bfa61e14149168bdb69024161603d'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:24.685250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '380bfa61e14149168bdb69024161603d'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:24.687514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1002/1998] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:24.688436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76238ccb-f63b-45cb-8773-536a880865c9 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:24.689648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-76238ccb-f63b-45cb-8773-536a880865c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:24.702455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76238ccb-f63b-45cb-8773-536a880865c9 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:24.704491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 997/1999] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:24 2022] DELETE /identity/v3/users/380bfa61e14149168bdb69024161603d => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:24.705461 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:24.708801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:24.762505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:24.763374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:24.763660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:24.763996 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] PATH_INFO: `/v3/users/88eaec76897a44f29dd8fc636835b07f` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:24.765217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88eaec76897a44f29dd8fc636835b07f)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:24.767215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:24.769763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f43beb1-0769-4711-84dc-0a0c6dbda232 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:24.774535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca67076-bafe-4c96-9238-e9bee00f9acb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:24.776490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67076-bafe-4c96-9238-e9bee00f9acb service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:24.776490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67076-bafe-4c96-9238-e9bee00f9acb service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:24.776490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca67076-bafe-4c96-9238-e9bee00f9acb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:24.786588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca67076-bafe-4c96-9238-e9bee00f9acb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:24.788095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca67076-bafe-4c96-9238-e9bee00f9acb service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:24.799252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 998/2000] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:24.800606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed6dfc-9217-4245-a1ef-427d3c4e939a None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:24.800901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed6dfc-9217-4245-a1ef-427d3c4e939a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:24.801181 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed6dfc-9217-4245-a1ef-427d3c4e939a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:24.882731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b7ed6dfc-9217-4245-a1ef-427d3c4e939a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:24.882731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b7ed6dfc-9217-4245-a1ef-427d3c4e939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:24.882731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 999/2001] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:24.882731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed6dfc-9217-4245-a1ef-427d3c4e939a None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:24.882731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b7ed6dfc-9217-4245-a1ef-427d3c4e939a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:24.884368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed6dfc-9217-4245-a1ef-427d3c4e939a None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:24.884368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642e593-b9c6-4492-ae23-decbd35c909a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:24.884368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642e593-b9c6-4492-ae23-decbd35c909a service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:24.884368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642e593-b9c6-4492-ae23-decbd35c909a service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:24.885207 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4642e593-b9c6-4492-ae23-decbd35c909a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:24.885207 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642e593-b9c6-4492-ae23-decbd35c909a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:24.886043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4642e593-b9c6-4492-ae23-decbd35c909a service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:24.910995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1000/2002] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:11:26.544162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88eaec76897a44f29dd8fc636835b07f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:26.559084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88eaec76897a44f29dd8fc636835b07f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:26.560166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88eaec76897a44f29dd8fc636835b07f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:26.561478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88eaec76897a44f29dd8fc636835b07f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:26.700880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88eaec76897a44f29dd8fc636835b07f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:26.703953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:26.709001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642e593-b9c6-4492-ae23-decbd35c909a service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:26.710658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-4642e593-b9c6-4492-ae23-decbd35c909a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:26.722567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1003/2003] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:24 2022] DELETE /identity/v3/users/88eaec76897a44f29dd8fc636835b07f => generated 0 bytes in 2034 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:26.723060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:26.724612 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:26.730119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4642e593-b9c6-4492-ae23-decbd35c909a service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:26.798837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20904dbb-1ef3-42b1-bd2b-d8489f5eb8a7 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:26.803589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c796fa93-4467-4b35-ad43-24e430190762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:26.804603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796fa93-4467-4b35-ad43-24e430190762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:26.804895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796fa93-4467-4b35-ad43-24e430190762 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:26.805171 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c796fa93-4467-4b35-ad43-24e430190762 admin admin] PATH_INFO: `/v3/projects/5004391d939440e4ba6c29a5009549d4` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:26.807601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796fa93-4467-4b35-ad43-24e430190762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5004391d939440e4ba6c29a5009549d4)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:26.809971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c796fa93-4467-4b35-ad43-24e430190762 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:26.817528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:26.818770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:26.819252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:26.819633 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] PATH_INFO: `/v3/projects/89b0059a57e04ce8bd4bb204ef5efa84` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:26.821324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=89b0059a57e04ce8bd4bb204ef5efa84)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:26.824400 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:26.929919 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c796fa93-4467-4b35-ad43-24e430190762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5004391d939440e4ba6c29a5009549d4', 'request_id': 'req-c796fa93-4467-4b35-ad43-24e430190762'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:26.935945 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c796fa93-4467-4b35-ad43-24e430190762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5004391d939440e4ba6c29a5009549d4', 'request_id': 'req-c796fa93-4467-4b35-ad43-24e430190762'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:26.942487 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c796fa93-4467-4b35-ad43-24e430190762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5004391d939440e4ba6c29a5009549d4', 'request_id': 'req-c796fa93-4467-4b35-ad43-24e430190762'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.005641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89b0059a57e04ce8bd4bb204ef5efa84', 'request_id': 'req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.031271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89b0059a57e04ce8bd4bb204ef5efa84', 'request_id': 'req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.031271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89b0059a57e04ce8bd4bb204ef5efa84', 'request_id': 'req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.070948 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c796fa93-4467-4b35-ad43-24e430190762 admin admin] The token cache is being invalidate because project 5004391d939440e4ba6c29a5009549d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:27.071498 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c796fa93-4467-4b35-ad43-24e430190762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.072798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c796fa93-4467-4b35-ad43-24e430190762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.077410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1004/2004] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:26 2022] DELETE /identity/v3/projects/5004391d939440e4ba6c29a5009549d4 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:27.077410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f1d3a-b45d-4048-aded-36920eef6613 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:27.077410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f1d3a-b45d-4048-aded-36920eef6613 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:27.077410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3f1d3a-b45d-4048-aded-36920eef6613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:27.094640 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-af3f1d3a-b45d-4048-aded-36920eef6613 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:27.095712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-af3f1d3a-b45d-4048-aded-36920eef6613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:27.100351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:27.152212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] The token cache is being invalidate because project 89b0059a57e04ce8bd4bb204ef5efa84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:27.152506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.153148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.154754 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1001/2005] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:26 2022] DELETE /identity/v3/projects/89b0059a57e04ce8bd4bb204ef5efa84 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:27.155532 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:27.156076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1005/2006] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:27.158671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f1d3a-b45d-4048-aded-36920eef6613 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:27.160092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-af3f1d3a-b45d-4048-aded-36920eef6613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:27.161628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:27.172271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3f1d3a-b45d-4048-aded-36920eef6613 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:27.174961 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf16fe0-8411-4af3-9ffa-7dea5588d51c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:27.176955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:27.177807 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:27.178093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:27.178363 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] PATH_INFO: `/v3/users/9e86d615dc05492c83b29c5c634cd6c9` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:27.179559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e86d615dc05492c83b29c5c634cd6c9)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:27.180094 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:27.181050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:27.181407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:27.181537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:27.181810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] PATH_INFO: `/v3/users/2957d527ef91440ebf832bd83f905885` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:27.183082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2957d527ef91440ebf832bd83f905885)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:27.185164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:27.426960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e86d615dc05492c83b29c5c634cd6c9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.427441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2957d527ef91440ebf832bd83f905885'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.427441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2957d527ef91440ebf832bd83f905885'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.427441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2957d527ef91440ebf832bd83f905885'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.436056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e86d615dc05492c83b29c5c634cd6c9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.436850 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e86d615dc05492c83b29c5c634cd6c9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.437478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e86d615dc05492c83b29c5c634cd6c9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.538603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2957d527ef91440ebf832bd83f905885'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.546427 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2957d527ef91440ebf832bd83f905885'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.565726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1002/2007] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:27 2022] DELETE /identity/v3/users/2957d527ef91440ebf832bd83f905885 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:27.568932 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:27.568932 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:27.648392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e86d615dc05492c83b29c5c634cd6c9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:27.653238 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796becd-d352-4756-9d3c-eaab5b25bc98 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:27.660636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219dd3-b1c1-47f8-ad9e-279b21e2567c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:27.660636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219dd3-b1c1-47f8-ad9e-279b21e2567c service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:27.660636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219dd3-b1c1-47f8-ad9e-279b21e2567c service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:27.660636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45219dd3-b1c1-47f8-ad9e-279b21e2567c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:27.661044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-45219dd3-b1c1-47f8-ad9e-279b21e2567c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:27.662931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1006/2008] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:27 2022] DELETE /identity/v3/users/9e86d615dc05492c83b29c5c634cd6c9 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:27.738894 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45219dd3-b1c1-47f8-ad9e-279b21e2567c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:27.740402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45219dd3-b1c1-47f8-ad9e-279b21e2567c service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:27.751666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1003/2009] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:28.036580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:28.045574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:28.154123 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e8236a-f7db-4c1c-87d7-4195343fa214 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:28.160177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:28.162010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:28.162010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:28.162010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] PATH_INFO: `/v3/projects/ccfa46fe48424fffb7c5e91eec6ca128` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:28.163225 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccfa46fe48424fffb7c5e91eec6ca128)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:28.167008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:28.196496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219dd3-b1c1-47f8-ad9e-279b21e2567c service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:28.197131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-45219dd3-b1c1-47f8-ad9e-279b21e2567c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:28.209544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45219dd3-b1c1-47f8-ad9e-279b21e2567c service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:28.214873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04447bfc-1536-4540-bd55-8870d82f6a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:28.215743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447bfc-1536-4540-bd55-8870d82f6a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:28.216073 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447bfc-1536-4540-bd55-8870d82f6a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:28.216406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04447bfc-1536-4540-bd55-8870d82f6a97 admin admin] PATH_INFO: `/v3/projects/762fda97d0e64f51baa64d11f4b92c3c` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:28.219333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04447bfc-1536-4540-bd55-8870d82f6a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=762fda97d0e64f51baa64d11f4b92c3c)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:28.221497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04447bfc-1536-4540-bd55-8870d82f6a97 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:28.325444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccfa46fe48424fffb7c5e91eec6ca128', 'request_id': 'req-0eb454db-ab82-4345-bacf-db04fc2b575f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.331171 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccfa46fe48424fffb7c5e91eec6ca128', 'request_id': 'req-0eb454db-ab82-4345-bacf-db04fc2b575f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.339451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccfa46fe48424fffb7c5e91eec6ca128', 'request_id': 'req-0eb454db-ab82-4345-bacf-db04fc2b575f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.366031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-04447bfc-1536-4540-bd55-8870d82f6a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '762fda97d0e64f51baa64d11f4b92c3c', 'request_id': 'req-04447bfc-1536-4540-bd55-8870d82f6a97'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.373210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-04447bfc-1536-4540-bd55-8870d82f6a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '762fda97d0e64f51baa64d11f4b92c3c', 'request_id': 'req-04447bfc-1536-4540-bd55-8870d82f6a97'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.379257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-04447bfc-1536-4540-bd55-8870d82f6a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '762fda97d0e64f51baa64d11f4b92c3c', 'request_id': 'req-04447bfc-1536-4540-bd55-8870d82f6a97'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.449040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] The token cache is being invalidate because project ccfa46fe48424fffb7c5e91eec6ca128 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:28.449334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.449964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.451700 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1007/2010] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:28 2022] DELETE /identity/v3/projects/ccfa46fe48424fffb7c5e91eec6ca128 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:28.452529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:28.453987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:28.519952 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb454db-ab82-4345-bacf-db04fc2b575f admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:28.581429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:28.582317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:28.582597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:28.582913 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] PATH_INFO: `/v3/projects/cf48174bf2e44a3997668896ea03d8fa` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:28.584425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf48174bf2e44a3997668896ea03d8fa)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:28.586880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:28.613851 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-04447bfc-1536-4540-bd55-8870d82f6a97 admin admin] The token cache is being invalidate because project 762fda97d0e64f51baa64d11f4b92c3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:28.614150 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-04447bfc-1536-4540-bd55-8870d82f6a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.614827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-04447bfc-1536-4540-bd55-8870d82f6a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.616513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1004/2011] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:28 2022] DELETE /identity/v3/projects/762fda97d0e64f51baa64d11f4b92c3c => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:28.619927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097459b8-e440-40c8-b904-8eb90db8bd07 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:28.619927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097459b8-e440-40c8-b904-8eb90db8bd07 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:28.619927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097459b8-e440-40c8-b904-8eb90db8bd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:28.640362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-097459b8-e440-40c8-b904-8eb90db8bd07 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:28.641678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-097459b8-e440-40c8-b904-8eb90db8bd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:28.657129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1005/2012] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:28.657129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03c433-f1e1-4483-8b55-120928cea2ba None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:28.657129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03c433-f1e1-4483-8b55-120928cea2ba None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:28.657129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee03c433-f1e1-4483-8b55-120928cea2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:28.673561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ee03c433-f1e1-4483-8b55-120928cea2ba None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:28.674799 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ee03c433-f1e1-4483-8b55-120928cea2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:28.683722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1006/2013] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:28.684846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4f7a2-9b67-4568-a602-ceb8beae6bad None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:28.685153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4f7a2-9b67-4568-a602-ceb8beae6bad None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:28.685416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f4f7a2-9b67-4568-a602-ceb8beae6bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:28.704993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-f5f4f7a2-9b67-4568-a602-ceb8beae6bad None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:28.706210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f5f4f7a2-9b67-4568-a602-ceb8beae6bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:28.715691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1007/2014] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:28.720721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7be8b-13d6-4ae8-a472-9efe40a45b5e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:28.721523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7be8b-13d6-4ae8-a472-9efe40a45b5e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:28.722297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea7be8b-13d6-4ae8-a472-9efe40a45b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:28.725106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:28.740756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf48174bf2e44a3997668896ea03d8fa', 'request_id': 'req-9728b2a2-3d79-4868-9258-94df9189bc8b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.743184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-aea7be8b-13d6-4ae8-a472-9efe40a45b5e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:28.744899 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-aea7be8b-13d6-4ae8-a472-9efe40a45b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:28.747655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf48174bf2e44a3997668896ea03d8fa', 'request_id': 'req-9728b2a2-3d79-4868-9258-94df9189bc8b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.754586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf48174bf2e44a3997668896ea03d8fa', 'request_id': 'req-9728b2a2-3d79-4868-9258-94df9189bc8b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.806047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1008/2015] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:28.806945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7be8b-13d6-4ae8-a472-9efe40a45b5e None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:28.816735 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea7be8b-13d6-4ae8-a472-9efe40a45b5e None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:28.821344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18bf96-4768-4e37-b155-fdd6a35a04a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:28.822511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18bf96-4768-4e37-b155-fdd6a35a04a6 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:28.822789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18bf96-4768-4e37-b155-fdd6a35a04a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:28.823067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f18bf96-4768-4e37-b155-fdd6a35a04a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:28.823793 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18bf96-4768-4e37-b155-fdd6a35a04a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:28.824143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18bf96-4768-4e37-b155-fdd6a35a04a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:28.825752 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f18bf96-4768-4e37-b155-fdd6a35a04a6 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:28.838881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1009/2016] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:28.839590 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18bf96-4768-4e37-b155-fdd6a35a04a6 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:28.846044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] The token cache is being invalidate because project cf48174bf2e44a3997668896ea03d8fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:28.846420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.847131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:28.848797 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1008/2017] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:28 2022] DELETE /identity/v3/projects/cf48174bf2e44a3997668896ea03d8fa => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:28.849541 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:28.853335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:28.863591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f18bf96-4768-4e37-b155-fdd6a35a04a6 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:28.863591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dfc11-09e6-41c1-a416-c8137082f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:28.863591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dfc11-09e6-41c1-a416-c8137082f0b6 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:28.863591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dfc11-09e6-41c1-a416-c8137082f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:28.865211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266dfc11-09e6-41c1-a416-c8137082f0b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:28.865211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266dfc11-09e6-41c1-a416-c8137082f0b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:28.865211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266dfc11-09e6-41c1-a416-c8137082f0b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:28.866263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266dfc11-09e6-41c1-a416-c8137082f0b6 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:28.866378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9728b2a2-3d79-4868-9258-94df9189bc8b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:28.871469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0fae-2a7d-4e48-bb58-d73cc7a12a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:28.872173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0fae-2a7d-4e48-bb58-d73cc7a12a0c admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:28.872458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0fae-2a7d-4e48-bb58-d73cc7a12a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:28.872894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b0fae-2a7d-4e48-bb58-d73cc7a12a0c admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:28.873599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b0fae-2a7d-4e48-bb58-d73cc7a12a0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:28.875543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b0fae-2a7d-4e48-bb58-d73cc7a12a0c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:28.879912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1010/2018] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:28.880764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dfc11-09e6-41c1-a416-c8137082f0b6 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:28.885167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-266dfc11-09e6-41c1-a416-c8137082f0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:28.898479 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266dfc11-09e6-41c1-a416-c8137082f0b6 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:28.904289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:28.905165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:28.905451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:28.905731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] PATH_INFO: `/v3/users/a6a020f24a2f40e686f297422a4251c5` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:28.906968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6a020f24a2f40e686f297422a4251c5)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:28.908996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:29.008241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1009/2019] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:28 2022] POST /identity/v3/projects => generated 375 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:29.008241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0fae-2a7d-4e48-bb58-d73cc7a12a0c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:29.008241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-918b0fae-2a7d-4e48-bb58-d73cc7a12a0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:29.073149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b0fae-2a7d-4e48-bb58-d73cc7a12a0c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:29.077896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bed949-b5ce-43de-9e1e-9a71670be869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:29.078555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed949-b5ce-43de-9e1e-9a71670be869 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:29.078834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed949-b5ce-43de-9e1e-9a71670be869 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:29.079106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bed949-b5ce-43de-9e1e-9a71670be869 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:29.079790 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bed949-b5ce-43de-9e1e-9a71670be869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:29.081800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bed949-b5ce-43de-9e1e-9a71670be869 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:29.176223 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6a020f24a2f40e686f297422a4251c5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:29.176964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6a020f24a2f40e686f297422a4251c5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:29.177699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6a020f24a2f40e686f297422a4251c5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:29.289250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1010/2020] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:29 2022] POST /identity/v3/projects => generated 381 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:29.289250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bed949-b5ce-43de-9e1e-9a71670be869 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:29.289250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c8bed949-b5ce-43de-9e1e-9a71670be869 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:29.324075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6a020f24a2f40e686f297422a4251c5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:29.326677 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:29.338223 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6a020f24a2f40e686f297422a4251c5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:29.377551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bed949-b5ce-43de-9e1e-9a71670be869 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:29.383757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a19cd-9301-4ede-9a8c-1562a8e7f2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:29.385038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a19cd-9301-4ede-9a8c-1562a8e7f2ca admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:29.385317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a19cd-9301-4ede-9a8c-1562a8e7f2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:29.385591 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6a19cd-9301-4ede-9a8c-1562a8e7f2ca admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:29.385986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1011/2021] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:28 2022] DELETE /identity/v3/users/a6a020f24a2f40e686f297422a4251c5 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:29.386478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a19cd-9301-4ede-9a8c-1562a8e7f2ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:29.386945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:29.388509 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6a19cd-9301-4ede-9a8c-1562a8e7f2ca admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:29.390064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:29.482337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f9f87-1258-4b70-a4a5-5eafb3c2d61c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:29.492545 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d38d2-7531-4478-8738-e91583f6bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:29.493434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d38d2-7531-4478-8738-e91583f6bb45 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:29.493955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d38d2-7531-4478-8738-e91583f6bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:29.494520 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d38d2-7531-4478-8738-e91583f6bb45 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:29.495435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d38d2-7531-4478-8738-e91583f6bb45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:29.498407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497d38d2-7531-4478-8738-e91583f6bb45 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:29.684832 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1011/2022] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:29 2022] POST /identity/v3/users => generated 288 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:29.688841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a19cd-9301-4ede-9a8c-1562a8e7f2ca admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:29.689457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1012/2023] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:29 2022] POST /identity/v3/users => generated 291 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:29.699191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d38d2-7531-4478-8738-e91583f6bb45 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:29.704199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6a19cd-9301-4ede-9a8c-1562a8e7f2ca admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:29.706316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497bfc-77b9-4ae8-aac4-2e76118428b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:29.706976 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497bfc-77b9-4ae8-aac4-2e76118428b3 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:29.707260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497bfc-77b9-4ae8-aac4-2e76118428b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:29.707538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15497bfc-77b9-4ae8-aac4-2e76118428b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:29.708350 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15497bfc-77b9-4ae8-aac4-2e76118428b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:29.709607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d38d2-7531-4478-8738-e91583f6bb45 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:29.710020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15497bfc-77b9-4ae8-aac4-2e76118428b3 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:29.714392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5929-f689-4ad1-b4dd-294b0aa78144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:29.715060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5929-f689-4ad1-b4dd-294b0aa78144 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:29.715344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5929-f689-4ad1-b4dd-294b0aa78144 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:29.715724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c5929-f689-4ad1-b4dd-294b0aa78144 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:29.716487 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5929-f689-4ad1-b4dd-294b0aa78144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:29.718088 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c5929-f689-4ad1-b4dd-294b0aa78144 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:29.723212 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1012/2024] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:29.724394 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497bfc-77b9-4ae8-aac4-2e76118428b3 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:29.732157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1013/2025] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:11:29.735233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15497bfc-77b9-4ae8-aac4-2e76118428b3 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:29.735665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5929-f689-4ad1-b4dd-294b0aa78144 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:29.744345 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cc28b-adb9-4773-a222-d089a882d0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:29.744345 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cc28b-adb9-4773-a222-d089a882d0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:29.744901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cc28b-adb9-4773-a222-d089a882d0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:29.744991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082cc28b-adb9-4773-a222-d089a882d0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:29.747019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cc28b-adb9-4773-a222-d089a882d0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:29.748071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c5929-f689-4ad1-b4dd-294b0aa78144 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:29.749008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082cc28b-adb9-4773-a222-d089a882d0d6 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:29.754055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b3801-64f9-45de-b731-78b438aa3fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:29.754726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b3801-64f9-45de-b731-78b438aa3fc8 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:29.755008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b3801-64f9-45de-b731-78b438aa3fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:29.755285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b3801-64f9-45de-b731-78b438aa3fc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:29.756736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b3801-64f9-45de-b731-78b438aa3fc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:29.758673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b3801-64f9-45de-b731-78b438aa3fc8 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:29.764898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1013/2026] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:29.769104 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cc28b-adb9-4773-a222-d089a882d0d6 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:29.783724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1014/2027] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:29.787078 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b3801-64f9-45de-b731-78b438aa3fc8 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:29.801806 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b3801-64f9-45de-b731-78b438aa3fc8 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:29.803158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082cc28b-adb9-4773-a222-d089a882d0d6 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:29.808491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bb9297-c94c-4715-b76f-29f76ae6627f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:29.809380 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb9297-c94c-4715-b76f-29f76ae6627f admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:29.809653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb9297-c94c-4715-b76f-29f76ae6627f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:29.809938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bb9297-c94c-4715-b76f-29f76ae6627f admin admin] PATH_INFO: `/v3/projects/f3fdaa05e2c64f4e9a13076764ae8d68/users/e8699323dbcb4d2ea4b4c5d79353518c/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:29.818382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a536b1-2229-4e5f-b8ce-097ae1e996fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:29.818741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a536b1-2229-4e5f-b8ce-097ae1e996fa admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:29.819017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a536b1-2229-4e5f-b8ce-097ae1e996fa admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:29.819300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a536b1-2229-4e5f-b8ce-097ae1e996fa admin admin] PATH_INFO: `/v3/projects/2968a97e737f493d9468e1c3b48e24da/users/40cd8c6c7c1746ba8978e8e432ade7f7/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:29.834761 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb9297-c94c-4715-b76f-29f76ae6627f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3fdaa05e2c64f4e9a13076764ae8d68, user_id=e8699323dbcb4d2ea4b4c5d79353518c, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:29.838167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bb9297-c94c-4715-b76f-29f76ae6627f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:29.842504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a536b1-2229-4e5f-b8ce-097ae1e996fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2968a97e737f493d9468e1c3b48e24da, user_id=40cd8c6c7c1746ba8978e8e432ade7f7, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:29.846915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a536b1-2229-4e5f-b8ce-097ae1e996fa admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:29.950699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1015/2028] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:29 2022] PUT /identity/v3/projects/f3fdaa05e2c64f4e9a13076764ae8d68/users/e8699323dbcb4d2ea4b4c5d79353518c/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:29.962298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44ffb-a157-4c06-8387-beff4d31c715 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:29.962491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44ffb-a157-4c06-8387-beff4d31c715 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:29.962959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44ffb-a157-4c06-8387-beff4d31c715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:29.992405 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-3fb44ffb-a157-4c06-8387-beff4d31c715 None None] MFA Rules not processed for user `e8699323dbcb4d2ea4b4c5d79353518c`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:29.994869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3fb44ffb-a157-4c06-8387-beff4d31c715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:30.000832 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1014/2029] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:29 2022] PUT /identity/v3/projects/2968a97e737f493d9468e1c3b48e24da/users/40cd8c6c7c1746ba8978e8e432ade7f7/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:30.017126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acdb06-73b0-437f-b6f5-98620cfc3b09 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.017419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acdb06-73b0-437f-b6f5-98620cfc3b09 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.017705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8acdb06-73b0-437f-b6f5-98620cfc3b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.045687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-d8acdb06-73b0-437f-b6f5-98620cfc3b09 None None] MFA Rules not processed for user `40cd8c6c7c1746ba8978e8e432ade7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:30.059426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d8acdb06-73b0-437f-b6f5-98620cfc3b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:30.064851 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1016/2030] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:30.069340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb44ffb-a157-4c06-8387-beff4d31c715 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:30.113796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1015/2031] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:30.126364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acdb06-73b0-437f-b6f5-98620cfc3b09 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:30.128272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d8acdb06-73b0-437f-b6f5-98620cfc3b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:30.139858 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb44ffb-a157-4c06-8387-beff4d31c715 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:30.148860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19bc1e-1ed0-49b2-a7de-d157e1774600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:30.149462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19bc1e-1ed0-49b2-a7de-d157e1774600 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.149794 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19bc1e-1ed0-49b2-a7de-d157e1774600 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.150054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19bc1e-1ed0-49b2-a7de-d157e1774600 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.150870 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19bc1e-1ed0-49b2-a7de-d157e1774600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:30.157235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19bc1e-1ed0-49b2-a7de-d157e1774600 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:30.200024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8acdb06-73b0-437f-b6f5-98620cfc3b09 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:30.203730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec00efa-4471-4c3d-bbf3-bb453caceac7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:30.204409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec00efa-4471-4c3d-bbf3-bb453caceac7 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.204692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec00efa-4471-4c3d-bbf3-bb453caceac7 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.205001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec00efa-4471-4c3d-bbf3-bb453caceac7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.215841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec00efa-4471-4c3d-bbf3-bb453caceac7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:30.217307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec00efa-4471-4c3d-bbf3-bb453caceac7 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:30.226881 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1016/2032] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:11:30.227701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec00efa-4471-4c3d-bbf3-bb453caceac7 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:30.229634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-dec00efa-4471-4c3d-bbf3-bb453caceac7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:30.244872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec00efa-4471-4c3d-bbf3-bb453caceac7 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:30.249761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:30.250615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.250891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.251190 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b admin admin] PATH_INFO: `/v3/projects/5cfc45f95e834733883eab14705b20c6` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.252449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cfc45f95e834733883eab14705b20c6)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:30.253440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1017/2033] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:30 2022] POST /identity/v3/projects => generated 379 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:30.254412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:30.257868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19bc1e-1ed0-49b2-a7de-d157e1774600 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:30.331292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19bc1e-1ed0-49b2-a7de-d157e1774600 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:30.335966 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89936584-1e00-414d-9eb2-786e98c45c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:30.336645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89936584-1e00-414d-9eb2-786e98c45c60 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.336933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89936584-1e00-414d-9eb2-786e98c45c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.337215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89936584-1e00-414d-9eb2-786e98c45c60 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.337944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89936584-1e00-414d-9eb2-786e98c45c60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:30.340069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89936584-1e00-414d-9eb2-786e98c45c60 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:30.394557 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cfc45f95e834733883eab14705b20c6', 'request_id': 'req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:30.400828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cfc45f95e834733883eab14705b20c6', 'request_id': 'req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:30.407740 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cfc45f95e834733883eab14705b20c6', 'request_id': 'req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:30.438732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1018/2034] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:30 2022] POST /identity/v3/users => generated 296 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:11:30.442881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89936584-1e00-414d-9eb2-786e98c45c60 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:30.453961 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89936584-1e00-414d-9eb2-786e98c45c60 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:30.510336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39524733-d849-4c75-915a-dc53f16d0abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:30.511008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39524733-d849-4c75-915a-dc53f16d0abd admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.511300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39524733-d849-4c75-915a-dc53f16d0abd admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.511578 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39524733-d849-4c75-915a-dc53f16d0abd admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.512347 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39524733-d849-4c75-915a-dc53f16d0abd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:30.513949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39524733-d849-4c75-915a-dc53f16d0abd admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:30.524232 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1019/2035] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:30.529075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b admin admin] The token cache is being invalidate because project 5cfc45f95e834733883eab14705b20c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:30.529226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39524733-d849-4c75-915a-dc53f16d0abd admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:30.529373 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:30.530044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b53c31d6-9d1f-4f67-96e0-dc5ae285209b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:30.531624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1017/2036] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:30 2022] DELETE /identity/v3/projects/5cfc45f95e834733883eab14705b20c6 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:30.538056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8cbb-846d-4943-aa26-a2782c4bc39e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.538355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8cbb-846d-4943-aa26-a2782c4bc39e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.538703 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf8cbb-846d-4943-aa26-a2782c4bc39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.539285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39524733-d849-4c75-915a-dc53f16d0abd admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:30.544561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9682e-a559-48a3-9b9c-f33bc756d2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:30.545444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9682e-a559-48a3-9b9c-f33bc756d2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.545727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9682e-a559-48a3-9b9c-f33bc756d2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.546003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b9682e-a559-48a3-9b9c-f33bc756d2f1 admin admin] PATH_INFO: `/v3/projects/06728cdedcbe433891fdf748273e96dc/users/c20f9d77e93d4096aff521448f8d4155/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.561204 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9682e-a559-48a3-9b9c-f33bc756d2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06728cdedcbe433891fdf748273e96dc, user_id=c20f9d77e93d4096aff521448f8d4155, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:30.564088 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b9682e-a559-48a3-9b9c-f33bc756d2f1 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:30.564982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-e8bf8cbb-846d-4943-aa26-a2782c4bc39e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:30.566124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e8bf8cbb-846d-4943-aa26-a2782c4bc39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:30.581480 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1018/2037] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:30.583134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efa76d-4790-457d-9f1e-5f3e0835fce1 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.583433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efa76d-4790-457d-9f1e-5f3e0835fce1 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.583709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54efa76d-4790-457d-9f1e-5f3e0835fce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.604196 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-54efa76d-4790-457d-9f1e-5f3e0835fce1 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:30.605422 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-54efa76d-4790-457d-9f1e-5f3e0835fce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:30.613582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1019/2038] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:30.617851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efa76d-4790-457d-9f1e-5f3e0835fce1 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:30.627585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54efa76d-4790-457d-9f1e-5f3e0835fce1 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:30.633488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee0da2-c83e-419d-85f4-c2412441c7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:30.634153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee0da2-c83e-419d-85f4-c2412441c7ff admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.634475 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee0da2-c83e-419d-85f4-c2412441c7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.634752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebee0da2-c83e-419d-85f4-c2412441c7ff admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.635688 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee0da2-c83e-419d-85f4-c2412441c7ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:30.635830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee0da2-c83e-419d-85f4-c2412441c7ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:30.637468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebee0da2-c83e-419d-85f4-c2412441c7ff admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:30.646342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1020/2039] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:30 2022] PUT /identity/v3/projects/06728cdedcbe433891fdf748273e96dc/users/c20f9d77e93d4096aff521448f8d4155/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:30.650757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9682e-a559-48a3-9b9c-f33bc756d2f1 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:30.652701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-72b9682e-a559-48a3-9b9c-f33bc756d2f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:30.657282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1020/2040] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:11:30.658257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee0da2-c83e-419d-85f4-c2412441c7ff admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:30.670882 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebee0da2-c83e-419d-85f4-c2412441c7ff admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:30.729817 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b9682e-a559-48a3-9b9c-f33bc756d2f1 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:30.732588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68ab6e-4796-4b27-ab8d-2badd61693b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:30.733276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68ab6e-4796-4b27-ab8d-2badd61693b3 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.733560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68ab6e-4796-4b27-ab8d-2badd61693b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.733846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68ab6e-4796-4b27-ab8d-2badd61693b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.734592 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68ab6e-4796-4b27-ab8d-2badd61693b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:30.736250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68ab6e-4796-4b27-ab8d-2badd61693b3 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:30.747447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1021/2041] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:30 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:30.748375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68ab6e-4796-4b27-ab8d-2badd61693b3 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:30.751194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a117d-4325-458f-ae9f-c26c0d7c537b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:30.752160 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a117d-4325-458f-ae9f-c26c0d7c537b admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.752570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a117d-4325-458f-ae9f-c26c0d7c537b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.752929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a117d-4325-458f-ae9f-c26c0d7c537b admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.753933 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a117d-4325-458f-ae9f-c26c0d7c537b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:30.761778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-dd68ab6e-4796-4b27-ab8d-2badd61693b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:30.761896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a117d-4325-458f-ae9f-c26c0d7c537b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:30.771151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68ab6e-4796-4b27-ab8d-2badd61693b3 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:30.778928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd46b7bb-85b5-47e5-a2be-03e515115312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:30.787395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46b7bb-85b5-47e5-a2be-03e515115312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.791367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46b7bb-85b5-47e5-a2be-03e515115312 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.791367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd46b7bb-85b5-47e5-a2be-03e515115312 admin admin] PATH_INFO: `/v3/users/2410189ae9fd420182f33e10f211340f` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.791367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46b7bb-85b5-47e5-a2be-03e515115312 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2410189ae9fd420182f33e10f211340f)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:30.792319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd46b7bb-85b5-47e5-a2be-03e515115312 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:30.918228 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1021/2042] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:30 2022] POST /identity/v3/projects => generated 375 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:30.918228 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a117d-4325-458f-ae9f-c26c0d7c537b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:30.980651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a117d-4325-458f-ae9f-c26c0d7c537b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:30.985822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd498654-bcae-45b8-ba35-f1ee2abfdd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:30.986762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd498654-bcae-45b8-ba35-f1ee2abfdd92 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:30.987049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd498654-bcae-45b8-ba35-f1ee2abfdd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:30.987330 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd498654-bcae-45b8-ba35-f1ee2abfdd92 admin admin] PATH_INFO: `/v3/projects/06728cdedcbe433891fdf748273e96dc/users/c20f9d77e93d4096aff521448f8d4155/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:30.989400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd498654-bcae-45b8-ba35-f1ee2abfdd92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06728cdedcbe433891fdf748273e96dc, user_id=c20f9d77e93d4096aff521448f8d4155, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:30.992169 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd498654-bcae-45b8-ba35-f1ee2abfdd92 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:31.003600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1022/2043] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:30 2022] PUT /identity/v3/projects/06728cdedcbe433891fdf748273e96dc/users/c20f9d77e93d4096aff521448f8d4155/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:31.004531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd498654-bcae-45b8-ba35-f1ee2abfdd92 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:31.045898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:31.058683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-fd46b7bb-85b5-47e5-a2be-03e515115312 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2410189ae9fd420182f33e10f211340f'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:31.059536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-fd46b7bb-85b5-47e5-a2be-03e515115312 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2410189ae9fd420182f33e10f211340f'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:31.060455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-fd46b7bb-85b5-47e5-a2be-03e515115312 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2410189ae9fd420182f33e10f211340f'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:31.084404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd498654-bcae-45b8-ba35-f1ee2abfdd92 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:31.084526 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab6d9c3-9327-445d-89d4-7185134b4137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:31.086583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6d9c3-9327-445d-89d4-7185134b4137 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:31.087307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6d9c3-9327-445d-89d4-7185134b4137 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:31.087307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab6d9c3-9327-445d-89d4-7185134b4137 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:31.088466 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6d9c3-9327-445d-89d4-7185134b4137 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:31.090412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab6d9c3-9327-445d-89d4-7185134b4137 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:31.139990 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-fd46b7bb-85b5-47e5-a2be-03e515115312 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2410189ae9fd420182f33e10f211340f'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:31.147526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-fd46b7bb-85b5-47e5-a2be-03e515115312 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2410189ae9fd420182f33e10f211340f'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:31.169126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1022/2044] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:30 2022] DELETE /identity/v3/users/2410189ae9fd420182f33e10f211340f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:31.169126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc737173-388a-4b88-9f81-de26840a8847 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:31.169126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc737173-388a-4b88-9f81-de26840a8847 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:31.169126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc737173-388a-4b88-9f81-de26840a8847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:31.196285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-dc737173-388a-4b88-9f81-de26840a8847 None None] MFA Rules not processed for user `c20f9d77e93d4096aff521448f8d4155`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:31.198085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-dc737173-388a-4b88-9f81-de26840a8847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:31.203320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1023/2045] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:31 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:31.203320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c4349-79b3-4c21-9218-9b132039dd2b None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:31.203320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c4349-79b3-4c21-9218-9b132039dd2b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:31.203320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c4349-79b3-4c21-9218-9b132039dd2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:31.221927 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-382c4349-79b3-4c21-9218-9b132039dd2b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:31.223234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-382c4349-79b3-4c21-9218-9b132039dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:31.274102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1023/2046] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:31 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:31.275246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc737173-388a-4b88-9f81-de26840a8847 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:31.276580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-dc737173-388a-4b88-9f81-de26840a8847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:31.301998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1024/2047] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:31.302865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c4349-79b3-4c21-9218-9b132039dd2b None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:31.304199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-382c4349-79b3-4c21-9218-9b132039dd2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:31.348564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc737173-388a-4b88-9f81-de26840a8847 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:31.353608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8bd78-182e-45de-8407-aead3d7c4ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:31.354282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8bd78-182e-45de-8407-aead3d7c4ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:31.354570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8bd78-182e-45de-8407-aead3d7c4ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:31.354848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8bd78-182e-45de-8407-aead3d7c4ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:31.355674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8bd78-182e-45de-8407-aead3d7c4ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:31.357326 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8bd78-182e-45de-8407-aead3d7c4ec4 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:31.368267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1024/2048] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:31.372013 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c4349-79b3-4c21-9218-9b132039dd2b None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:31.373090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8bd78-182e-45de-8407-aead3d7c4ec4 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:31.373535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880ea5-85e8-479a-a592-79cd5a495b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:31.374189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880ea5-85e8-479a-a592-79cd5a495b97 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:31.374478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880ea5-85e8-479a-a592-79cd5a495b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:31.374741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88880ea5-85e8-479a-a592-79cd5a495b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:31.375323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e7b8bd78-182e-45de-8407-aead3d7c4ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:31.385323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88880ea5-85e8-479a-a592-79cd5a495b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:31.386953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88880ea5-85e8-479a-a592-79cd5a495b97 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:31.398460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1025/2049] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:31.409412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880ea5-85e8-479a-a592-79cd5a495b97 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:31.426012 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88880ea5-85e8-479a-a592-79cd5a495b97 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:31.433162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a0896-f67f-4128-bec8-8ae57cc128e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:31.433833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a0896-f67f-4128-bec8-8ae57cc128e7 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:31.434113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a0896-f67f-4128-bec8-8ae57cc128e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:31.434431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902a0896-f67f-4128-bec8-8ae57cc128e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:31.435715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a0896-f67f-4128-bec8-8ae57cc128e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:31.437784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902a0896-f67f-4128-bec8-8ae57cc128e7 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:31.440502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8bd78-182e-45de-8407-aead3d7c4ec4 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:31.455343 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1026/2050] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:31.455485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4713180e-7e24-419b-a454-cc6df8c9ae87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:31.455485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713180e-7e24-419b-a454-cc6df8c9ae87 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:31.455485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713180e-7e24-419b-a454-cc6df8c9ae87 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:31.455485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4713180e-7e24-419b-a454-cc6df8c9ae87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:31.456467 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a0896-f67f-4128-bec8-8ae57cc128e7 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:31.468004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902a0896-f67f-4128-bec8-8ae57cc128e7 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:31.473552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713180e-7e24-419b-a454-cc6df8c9ae87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:31.475054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4713180e-7e24-419b-a454-cc6df8c9ae87 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:31.479081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6546d-63a3-4205-8118-4274acb31d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:31.481159 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6546d-63a3-4205-8118-4274acb31d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:31.481560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6546d-63a3-4205-8118-4274acb31d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:31.481941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6546d-63a3-4205-8118-4274acb31d51 admin admin] PATH_INFO: `/v3/projects/48b97469d5774c21b6d501d48ab0f758/users/9f4407e0a4b34b339a6313980c6ae5de/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:31.485708 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1025/2051] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:31.499004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6546d-63a3-4205-8118-4274acb31d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48b97469d5774c21b6d501d48ab0f758, user_id=9f4407e0a4b34b339a6313980c6ae5de, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:31.502181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6546d-63a3-4205-8118-4274acb31d51 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:31.643187 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1027/2052] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:31 2022] PUT /identity/v3/projects/48b97469d5774c21b6d501d48ab0f758/users/9f4407e0a4b34b339a6313980c6ae5de/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:11:31.653577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a5514-0c80-4dfd-a188-ef2f15ce32de None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:31.653801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a5514-0c80-4dfd-a188-ef2f15ce32de None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:31.654083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a5514-0c80-4dfd-a188-ef2f15ce32de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:31.680775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-046a5514-0c80-4dfd-a188-ef2f15ce32de None None] MFA Rules not processed for user `9f4407e0a4b34b339a6313980c6ae5de`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:31.682626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-046a5514-0c80-4dfd-a188-ef2f15ce32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:31.751987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1026/2053] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:31.756530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6546d-63a3-4205-8118-4274acb31d51 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:31.833808 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6546d-63a3-4205-8118-4274acb31d51 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:31.839183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dd8eb-af93-432d-a9b7-43576a1b0828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:31.839965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dd8eb-af93-432d-a9b7-43576a1b0828 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:31.840324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dd8eb-af93-432d-a9b7-43576a1b0828 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:31.840676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07dd8eb-af93-432d-a9b7-43576a1b0828 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:31.841459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dd8eb-af93-432d-a9b7-43576a1b0828 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:31.843461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07dd8eb-af93-432d-a9b7-43576a1b0828 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:31.989207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1028/2054] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:31 2022] POST /identity/v3/projects => generated 373 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:31.996361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dd8eb-af93-432d-a9b7-43576a1b0828 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:31.996580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a5514-0c80-4dfd-a188-ef2f15ce32de None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:31.998209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-046a5514-0c80-4dfd-a188-ef2f15ce32de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:32.037891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a5514-0c80-4dfd-a188-ef2f15ce32de None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:32.092095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07dd8eb-af93-432d-a9b7-43576a1b0828 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:32.100158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcd642-f322-4ccf-95ed-4de586397049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:32.100843 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcd642-f322-4ccf-95ed-4de586397049 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:32.101130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcd642-f322-4ccf-95ed-4de586397049 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:32.102170 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcd642-f322-4ccf-95ed-4de586397049 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:32.103891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcd642-f322-4ccf-95ed-4de586397049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:32.106709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dcd642-f322-4ccf-95ed-4de586397049 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:32.137371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:32.138595 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:32.139487 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:32.140004 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] PATH_INFO: `/v3/projects/97aeb2a7be57458ba3a493f830a3ac03` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:32.141702 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97aeb2a7be57458ba3a493f830a3ac03)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:32.143844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:32.173185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:32.265801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1029/2055] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:31 2022] POST /identity/v3/users => generated 293 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:32.269853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcd642-f322-4ccf-95ed-4de586397049 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:32.280335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcd642-f322-4ccf-95ed-4de586397049 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:32.285118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca01b99-84b6-4b16-874f-66d55e825d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:32.285773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca01b99-84b6-4b16-874f-66d55e825d29 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:32.286051 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca01b99-84b6-4b16-874f-66d55e825d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:32.286328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca01b99-84b6-4b16-874f-66d55e825d29 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:32.287046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca01b99-84b6-4b16-874f-66d55e825d29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:32.288683 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca01b99-84b6-4b16-874f-66d55e825d29 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:32.302625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1030/2056] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:11:32.306706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca01b99-84b6-4b16-874f-66d55e825d29 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:32.317484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca01b99-84b6-4b16-874f-66d55e825d29 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:32.319455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97aeb2a7be57458ba3a493f830a3ac03', 'request_id': 'req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:32.327405 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97aeb2a7be57458ba3a493f830a3ac03', 'request_id': 'req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:32.336962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97aeb2a7be57458ba3a493f830a3ac03', 'request_id': 'req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:32.375928 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f1126-5e6b-4cb3-84cb-7ec81f800548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:32.376820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f1126-5e6b-4cb3-84cb-7ec81f800548 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:32.377104 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f1126-5e6b-4cb3-84cb-7ec81f800548 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:32.377383 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684f1126-5e6b-4cb3-84cb-7ec81f800548 admin admin] PATH_INFO: `/v3/projects/74b19975eec640739ec6f5d583ddebb7/users/1ab0b345e12b4d95981acf69bf6637a0/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:32.394510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f1126-5e6b-4cb3-84cb-7ec81f800548 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b19975eec640739ec6f5d583ddebb7, user_id=1ab0b345e12b4d95981acf69bf6637a0, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:32.397263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684f1126-5e6b-4cb3-84cb-7ec81f800548 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:32.470964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] The token cache is being invalidate because project 97aeb2a7be57458ba3a493f830a3ac03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:32.471259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:32.471940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:32.473516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1027/2057] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:31 2022] DELETE /identity/v3/projects/97aeb2a7be57458ba3a493f830a3ac03 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:32.477237 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:32.478717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:32.491018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98acf0e4-6f0a-4648-8d6e-d6d1bf8c3c2a admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:32.496020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:32.496860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:32.497143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:32.497418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] PATH_INFO: `/v3/users/609ad5fce28344c88f3fcc1435baa8fb` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:32.498710 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] RBAC: Authorizing `identity:delete_user(user_id=609ad5fce28344c88f3fcc1435baa8fb)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:32.500688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:32.547049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1031/2058] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:32 2022] PUT /identity/v3/projects/74b19975eec640739ec6f5d583ddebb7/users/1ab0b345e12b4d95981acf69bf6637a0/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:11:32.551147 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f1126-5e6b-4cb3-84cb-7ec81f800548 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:32.552844 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-684f1126-5e6b-4cb3-84cb-7ec81f800548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:32.621955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684f1126-5e6b-4cb3-84cb-7ec81f800548 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:32.628064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfa9a0-e857-4572-be2d-22819dc39e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:32.628847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa9a0-e857-4572-be2d-22819dc39e5a admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:32.629136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa9a0-e857-4572-be2d-22819dc39e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:32.630041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bfa9a0-e857-4572-be2d-22819dc39e5a admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:32.630203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfa9a0-e857-4572-be2d-22819dc39e5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:32.631875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bfa9a0-e857-4572-be2d-22819dc39e5a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:32.644087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1032/2059] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:11:32.648106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfa9a0-e857-4572-be2d-22819dc39e5a admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:32.658703 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bfa9a0-e857-4572-be2d-22819dc39e5a admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:32.663562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3e373a-3e61-40fd-8ce8-54f5357a2d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:32.664561 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e373a-3e61-40fd-8ce8-54f5357a2d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:32.664851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e373a-3e61-40fd-8ce8-54f5357a2d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:32.665195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3e373a-3e61-40fd-8ce8-54f5357a2d98 admin admin] PATH_INFO: `/v3/projects/74b19975eec640739ec6f5d583ddebb7/users/1ab0b345e12b4d95981acf69bf6637a0/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:32.667284 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e373a-3e61-40fd-8ce8-54f5357a2d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b19975eec640739ec6f5d583ddebb7, user_id=1ab0b345e12b4d95981acf69bf6637a0, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:32.670188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3e373a-3e61-40fd-8ce8-54f5357a2d98 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:32.681672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1033/2060] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:32 2022] PUT /identity/v3/projects/74b19975eec640739ec6f5d583ddebb7/users/1ab0b345e12b4d95981acf69bf6637a0/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:11:32.692799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b08e5-9525-4dc3-a1ef-574e6e28c27a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:32.693091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b08e5-9525-4dc3-a1ef-574e6e28c27a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:32.693367 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b08e5-9525-4dc3-a1ef-574e6e28c27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:32.721585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-118b08e5-9525-4dc3-a1ef-574e6e28c27a None None] MFA Rules not processed for user `1ab0b345e12b4d95981acf69bf6637a0`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:32.722808 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-118b08e5-9525-4dc3-a1ef-574e6e28c27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:32.789369 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1034/2061] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:32.816642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '609ad5fce28344c88f3fcc1435baa8fb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:32.817321 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '609ad5fce28344c88f3fcc1435baa8fb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:32.817928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '609ad5fce28344c88f3fcc1435baa8fb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:32.840053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b08e5-9525-4dc3-a1ef-574e6e28c27a None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:32.841459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-118b08e5-9525-4dc3-a1ef-574e6e28c27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:32.906736 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b08e5-9525-4dc3-a1ef-574e6e28c27a None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:32.910623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba9824-57e3-48ff-9ddd-9f56e2946fc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:32.911260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9824-57e3-48ff-9ddd-9f56e2946fc4 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:32.911545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9824-57e3-48ff-9ddd-9f56e2946fc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:32.911848 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ba9824-57e3-48ff-9ddd-9f56e2946fc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:32.913681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e0ba9824-57e3-48ff-9ddd-9f56e2946fc4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:32.916802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '609ad5fce28344c88f3fcc1435baa8fb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:32.925289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '609ad5fce28344c88f3fcc1435baa8fb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:32.951205 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1028/2062] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:32 2022] DELETE /identity/v3/users/609ad5fce28344c88f3fcc1435baa8fb => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:11:32.952535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:32.954091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:32.988742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba9824-57e3-48ff-9ddd-9f56e2946fc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:32.990482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ba9824-57e3-48ff-9ddd-9f56e2946fc4 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:33.001010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1035/2063] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:11:33.028785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc37fe9-3224-4059-9ff3-b572762cf383 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:33.033730 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70844c6-12ac-486e-9e57-57f0000c6990 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20f9d77e93d4096aff521448f8d4155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06728cdedcbe433891fdf748273e96dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:33.034407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70844c6-12ac-486e-9e57-57f0000c6990 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:33.034918 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70844c6-12ac-486e-9e57-57f0000c6990 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:33.035222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70844c6-12ac-486e-9e57-57f0000c6990 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:33.035791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70844c6-12ac-486e-9e57-57f0000c6990 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:33.036154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70844c6-12ac-486e-9e57-57f0000c6990 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:33.037771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70844c6-12ac-486e-9e57-57f0000c6990 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:33.050958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1029/2064] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:33.055445 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba9824-57e3-48ff-9ddd-9f56e2946fc4 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:33.135409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ba9824-57e3-48ff-9ddd-9f56e2946fc4 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:33.140577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7c38-ade2-4ed6-9383-e107f004bf4b tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20f9d77e93d4096aff521448f8d4155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06728cdedcbe433891fdf748273e96dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:33.141380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7c38-ade2-4ed6-9383-e107f004bf4b tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:33.141693 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7c38-ade2-4ed6-9383-e107f004bf4b tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:33.141978 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7c38-ade2-4ed6-9383-e107f004bf4b tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:33.142676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e7c38-ade2-4ed6-9383-e107f004bf4b tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:33.144687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e7c38-ade2-4ed6-9383-e107f004bf4b tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:33.338570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1036/2065] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:33 2022] POST /identity/v3/projects => generated 354 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:33.347421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70844c6-12ac-486e-9e57-57f0000c6990 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:33.357524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70844c6-12ac-486e-9e57-57f0000c6990 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:33.416207 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65679c0-2b56-41c1-a1aa-5d6e1af96b8e tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20f9d77e93d4096aff521448f8d4155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06728cdedcbe433891fdf748273e96dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:33.416889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65679c0-2b56-41c1-a1aa-5d6e1af96b8e tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:33.417216 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65679c0-2b56-41c1-a1aa-5d6e1af96b8e tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:33.417499 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65679c0-2b56-41c1-a1aa-5d6e1af96b8e tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:33.418237 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65679c0-2b56-41c1-a1aa-5d6e1af96b8e tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:33.418550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65679c0-2b56-41c1-a1aa-5d6e1af96b8e tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:33.420258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65679c0-2b56-41c1-a1aa-5d6e1af96b8e tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:33.433815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1030/2066] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:33.446544 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7c38-ade2-4ed6-9383-e107f004bf4b tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:33.449056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-999e7c38-ade2-4ed6-9383-e107f004bf4b tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:33.473322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65679c0-2b56-41c1-a1aa-5d6e1af96b8e tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:33.484997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65679c0-2b56-41c1-a1aa-5d6e1af96b8e tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:33.490713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c20f9d77e93d4096aff521448f8d4155', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '06728cdedcbe433891fdf748273e96dc', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:33.491841 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:33.491969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:33.492165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] PATH_INFO: `/v3/projects/ddb67ba81708461ca448baccf8b8bd5d` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:33.494113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ddb67ba81708461ca448baccf8b8bd5d)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:33.496409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:33.529102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7c38-ade2-4ed6-9383-e107f004bf4b tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:33.534057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:33.534942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:33.535222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:33.535516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] PATH_INFO: `/v3/projects/34cb306a7268470985ca7d3d5690b81d` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:33.536827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34cb306a7268470985ca7d3d5690b81d)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:33.538800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:33.551684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:33.646653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddb67ba81708461ca448baccf8b8bd5d', 'request_id': 'req-2ae05e97-4e77-4962-b5df-11c39370e2b0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:33.653502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddb67ba81708461ca448baccf8b8bd5d', 'request_id': 'req-2ae05e97-4e77-4962-b5df-11c39370e2b0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:33.660405 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddb67ba81708461ca448baccf8b8bd5d', 'request_id': 'req-2ae05e97-4e77-4962-b5df-11c39370e2b0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:33.711724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34cb306a7268470985ca7d3d5690b81d', 'request_id': 'req-750e595d-3d15-413b-90ab-9dd20d84a750'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:33.718446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34cb306a7268470985ca7d3d5690b81d', 'request_id': 'req-750e595d-3d15-413b-90ab-9dd20d84a750'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:33.725156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34cb306a7268470985ca7d3d5690b81d', 'request_id': 'req-750e595d-3d15-413b-90ab-9dd20d84a750'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:33.905784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] The token cache is being invalidate because project ddb67ba81708461ca448baccf8b8bd5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:33.906402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:33.906853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:33.908451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1031/2067] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:33 2022] DELETE /identity/v3/projects/ddb67ba81708461ca448baccf8b8bd5d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:11:34.013373 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] The token cache is being invalidate because project 34cb306a7268470985ca7d3d5690b81d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:34.013901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:34.014506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:34.016613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1037/2068] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:33 2022] DELETE /identity/v3/projects/34cb306a7268470985ca7d3d5690b81d => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:34.020666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:34.022114 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:34.090128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae05e97-4e77-4962-b5df-11c39370e2b0 tempest-VolumeQuotaClassesTest-906594894 tempest-VolumeQuotaClassesTest-906594894-project-admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:34.151996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab50ea9-c82d-484f-872f-283cd067c2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:34.152875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50ea9-c82d-484f-872f-283cd067c2cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:34.153160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50ea9-c82d-484f-872f-283cd067c2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:34.153439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab50ea9-c82d-484f-872f-283cd067c2cb admin admin] PATH_INFO: `/v3/users/1fa506abab0c4595892680af3b24a568` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:34.154730 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab50ea9-c82d-484f-872f-283cd067c2cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1fa506abab0c4595892680af3b24a568)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:34.156726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab50ea9-c82d-484f-872f-283cd067c2cb admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:34.446622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-eab50ea9-c82d-484f-872f-283cd067c2cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1fa506abab0c4595892680af3b24a568'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:34.447472 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-eab50ea9-c82d-484f-872f-283cd067c2cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1fa506abab0c4595892680af3b24a568'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:34.448114 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-eab50ea9-c82d-484f-872f-283cd067c2cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1fa506abab0c4595892680af3b24a568'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:34.586676 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-eab50ea9-c82d-484f-872f-283cd067c2cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1fa506abab0c4595892680af3b24a568'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:34.595390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-eab50ea9-c82d-484f-872f-283cd067c2cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1fa506abab0c4595892680af3b24a568'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:34.613964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1032/2069] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:34 2022] DELETE /identity/v3/users/1fa506abab0c4595892680af3b24a568 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:34.729277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:34.730703 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:34.744064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e595d-3d15-413b-90ab-9dd20d84a750 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:34.805874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:34.807546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:34.807962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:34.808338 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] PATH_INFO: `/v3/users/e8699323dbcb4d2ea4b4c5d79353518c` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:34.809671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8699323dbcb4d2ea4b4c5d79353518c)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:34.811716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:35.103189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8699323dbcb4d2ea4b4c5d79353518c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.116124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8699323dbcb4d2ea4b4c5d79353518c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.116876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8699323dbcb4d2ea4b4c5d79353518c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.117552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8699323dbcb4d2ea4b4c5d79353518c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.135559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:35.265334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8699323dbcb4d2ea4b4c5d79353518c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.278856 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1038/2070] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:34 2022] DELETE /identity/v3/users/e8699323dbcb4d2ea4b4c5d79353518c => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:35.283521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d237dd-da9f-4df7-8d15-b17e1e5a9be8 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:35.284043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d237dd-da9f-4df7-8d15-b17e1e5a9be8 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:35.284197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d237dd-da9f-4df7-8d15-b17e1e5a9be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:35.293031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:35.295100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:35.305102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a3d237dd-da9f-4df7-8d15-b17e1e5a9be8 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:35.306987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a3d237dd-da9f-4df7-8d15-b17e1e5a9be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:35.359947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9e8b3-83bf-40eb-afce-0c298fce5db7 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:35.365495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d4492-f1e3-414a-938c-e5f496742e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:35.366570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d4492-f1e3-414a-938c-e5f496742e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:35.369941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d4492-f1e3-414a-938c-e5f496742e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:35.369941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d4492-f1e3-414a-938c-e5f496742e65 admin admin] PATH_INFO: `/v3/users/40cd8c6c7c1746ba8978e8e432ade7f7` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:35.371108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d4492-f1e3-414a-938c-e5f496742e65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40cd8c6c7c1746ba8978e8e432ade7f7)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:35.373165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7d4492-f1e3-414a-938c-e5f496742e65 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:35.375411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1033/2071] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:35.375700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d237dd-da9f-4df7-8d15-b17e1e5a9be8 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:35.377185 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a3d237dd-da9f-4df7-8d15-b17e1e5a9be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:35.392319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d237dd-da9f-4df7-8d15-b17e1e5a9be8 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:35.397420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:35.398293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:35.398572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:35.398852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] PATH_INFO: `/v3/projects/3c27d7eee8604c808b8040b91f118122` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:35.400681 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c27d7eee8604c808b8040b91f118122)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:35.402800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:35.692000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-df7d4492-f1e3-414a-938c-e5f496742e65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40cd8c6c7c1746ba8978e8e432ade7f7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.692652 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c27d7eee8604c808b8040b91f118122', 'request_id': 'req-5df5cba2-772a-4bf5-9560-613954994fe6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.700357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c27d7eee8604c808b8040b91f118122', 'request_id': 'req-5df5cba2-772a-4bf5-9560-613954994fe6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.706240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c27d7eee8604c808b8040b91f118122', 'request_id': 'req-5df5cba2-772a-4bf5-9560-613954994fe6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.706438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-df7d4492-f1e3-414a-938c-e5f496742e65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40cd8c6c7c1746ba8978e8e432ade7f7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.707177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-df7d4492-f1e3-414a-938c-e5f496742e65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40cd8c6c7c1746ba8978e8e432ade7f7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.707793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-df7d4492-f1e3-414a-938c-e5f496742e65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40cd8c6c7c1746ba8978e8e432ade7f7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.842450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] The token cache is being invalidate because project 3c27d7eee8604c808b8040b91f118122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:35.842946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.843686 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.849025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1034/2072] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:35 2022] DELETE /identity/v3/projects/3c27d7eee8604c808b8040b91f118122 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:35.850340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:35.851846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:35.916021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5cba2-772a-4bf5-9560-613954994fe6 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:35.919676 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60541b99-029a-4c9b-b3e1-3db109a0bca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:35.920361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60541b99-029a-4c9b-b3e1-3db109a0bca5 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:35.920643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60541b99-029a-4c9b-b3e1-3db109a0bca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:35.920921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60541b99-029a-4c9b-b3e1-3db109a0bca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:35.922739 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-60541b99-029a-4c9b-b3e1-3db109a0bca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:35.951502 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-df7d4492-f1e3-414a-938c-e5f496742e65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40cd8c6c7c1746ba8978e8e432ade7f7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:35.971588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1039/2073] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:35 2022] DELETE /identity/v3/users/40cd8c6c7c1746ba8978e8e432ade7f7 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:35.973337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a423741-0b70-4f2f-8653-a6d6713ec3b2 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:35.974470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a423741-0b70-4f2f-8653-a6d6713ec3b2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:35.976574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a423741-0b70-4f2f-8653-a6d6713ec3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.013788 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-6a423741-0b70-4f2f-8653-a6d6713ec3b2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:36.015089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6a423741-0b70-4f2f-8653-a6d6713ec3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:36.025209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60541b99-029a-4c9b-b3e1-3db109a0bca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:36.028866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60541b99-029a-4c9b-b3e1-3db109a0bca5 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:36.043471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1035/2074] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:36.045634 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1106ba-c7b2-4c42-acfe-9a6a79598875 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:36.046245 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1106ba-c7b2-4c42-acfe-9a6a79598875 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:36.046695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1106ba-c7b2-4c42-acfe-9a6a79598875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.070219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-3c1106ba-c7b2-4c42-acfe-9a6a79598875 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:36.071696 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3c1106ba-c7b2-4c42-acfe-9a6a79598875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:36.089780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1040/2075] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:36.098535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e5e78-261a-4c50-80da-f18739503d1b None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:36.099031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e5e78-261a-4c50-80da-f18739503d1b None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:36.099454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e5e78-261a-4c50-80da-f18739503d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.124731 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-455e5e78-261a-4c50-80da-f18739503d1b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:36.127608 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-455e5e78-261a-4c50-80da-f18739503d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:36.144145 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1041/2076] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:36.145660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e5e78-261a-4c50-80da-f18739503d1b None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:36.156692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e5e78-261a-4c50-80da-f18739503d1b None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:36.162192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6519a-a362-401b-8b4d-0b09ece65a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:36.162880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6519a-a362-401b-8b4d-0b09ece65a99 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:36.163168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6519a-a362-401b-8b4d-0b09ece65a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:36.163447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac6519a-a362-401b-8b4d-0b09ece65a99 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.165307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6519a-a362-401b-8b4d-0b09ece65a99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:36.165307 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6519a-a362-401b-8b4d-0b09ece65a99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:36.167010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1036/2077] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:36.167897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac6519a-a362-401b-8b4d-0b09ece65a99 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:36.182869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1106ba-c7b2-4c42-acfe-9a6a79598875 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:36.187791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1042/2078] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:36.189292 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6519a-a362-401b-8b4d-0b09ece65a99 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:36.191973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3c1106ba-c7b2-4c42-acfe-9a6a79598875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:36.200415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac6519a-a362-401b-8b4d-0b09ece65a99 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:36.206500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad181d-6922-48ed-be95-6bee8c7f7db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:36.207174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad181d-6922-48ed-be95-6bee8c7f7db5 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:36.207606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad181d-6922-48ed-be95-6bee8c7f7db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:36.207920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad181d-6922-48ed-be95-6bee8c7f7db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.208681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad181d-6922-48ed-be95-6bee8c7f7db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:36.210957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad181d-6922-48ed-be95-6bee8c7f7db5 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:36.279545 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1106ba-c7b2-4c42-acfe-9a6a79598875 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:36.283466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d09144-dbed-4fb4-a137-26a457f96d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:36.284152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d09144-dbed-4fb4-a137-26a457f96d98 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:36.284721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d09144-dbed-4fb4-a137-26a457f96d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:36.284721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d09144-dbed-4fb4-a137-26a457f96d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.295744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d09144-dbed-4fb4-a137-26a457f96d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:36.297232 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d09144-dbed-4fb4-a137-26a457f96d98 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:36.310035 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1037/2079] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:36.310035 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d09144-dbed-4fb4-a137-26a457f96d98 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:36.310450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-95d09144-dbed-4fb4-a137-26a457f96d98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:36.323685 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d09144-dbed-4fb4-a137-26a457f96d98 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:36.328665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0ee861-4968-444f-8c65-5674aa77f907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:36.329734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ee861-4968-444f-8c65-5674aa77f907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:36.330022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ee861-4968-444f-8c65-5674aa77f907 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:36.330302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0ee861-4968-444f-8c65-5674aa77f907 admin admin] PATH_INFO: `/v3/users/9f4407e0a4b34b339a6313980c6ae5de` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.331577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ee861-4968-444f-8c65-5674aa77f907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4407e0a4b34b339a6313980c6ae5de)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:36.336529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0ee861-4968-444f-8c65-5674aa77f907 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:36.350039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1043/2080] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:36 2022] POST /identity/v3/projects => generated 383 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:36.356001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad181d-6922-48ed-be95-6bee8c7f7db5 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:36.474521 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad181d-6922-48ed-be95-6bee8c7f7db5 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:36.479458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19b57b-2cb3-4409-b074-5913d96e0309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:36.480218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19b57b-2cb3-4409-b074-5913d96e0309 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:36.480505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19b57b-2cb3-4409-b074-5913d96e0309 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:36.480785 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19b57b-2cb3-4409-b074-5913d96e0309 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.482095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19b57b-2cb3-4409-b074-5913d96e0309 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:36.483715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19b57b-2cb3-4409-b074-5913d96e0309 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:36.636457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:36.638626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1044/2081] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:36 2022] POST /identity/v3/users => generated 292 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:36.642719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19b57b-2cb3-4409-b074-5913d96e0309 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:36.660476 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19b57b-2cb3-4409-b074-5913d96e0309 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:36.673454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f05877-6d92-4bc5-b21c-fc04d8a8c3d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:36.674142 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f05877-6d92-4bc5-b21c-fc04d8a8c3d6 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:36.674432 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f05877-6d92-4bc5-b21c-fc04d8a8c3d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:36.674770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f05877-6d92-4bc5-b21c-fc04d8a8c3d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.675497 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f05877-6d92-4bc5-b21c-fc04d8a8c3d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:36.682657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ff0ee861-4968-444f-8c65-5674aa77f907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4407e0a4b34b339a6313980c6ae5de'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:36.683072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f05877-6d92-4bc5-b21c-fc04d8a8c3d6 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:36.683752 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ff0ee861-4968-444f-8c65-5674aa77f907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4407e0a4b34b339a6313980c6ae5de'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:36.684478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ff0ee861-4968-444f-8c65-5674aa77f907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4407e0a4b34b339a6313980c6ae5de'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:36.705069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1045/2082] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:36.709258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f05877-6d92-4bc5-b21c-fc04d8a8c3d6 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:36.721062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-13f05877-6d92-4bc5-b21c-fc04d8a8c3d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:36.737571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f05877-6d92-4bc5-b21c-fc04d8a8c3d6 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:36.745138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f45f3-7f60-49b6-bccd-294137d850cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:36.745861 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ff0ee861-4968-444f-8c65-5674aa77f907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4407e0a4b34b339a6313980c6ae5de'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:36.746182 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f45f3-7f60-49b6-bccd-294137d850cd admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:36.746672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f45f3-7f60-49b6-bccd-294137d850cd admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:36.747044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f45f3-7f60-49b6-bccd-294137d850cd admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.748155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f45f3-7f60-49b6-bccd-294137d850cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:36.750497 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f45f3-7f60-49b6-bccd-294137d850cd admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:36.757408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ff0ee861-4968-444f-8c65-5674aa77f907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4407e0a4b34b339a6313980c6ae5de'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:36.769354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1046/2083] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:36 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:36.770963 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f45f3-7f60-49b6-bccd-294137d850cd admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:36.784769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1038/2084] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:36 2022] DELETE /identity/v3/users/9f4407e0a4b34b339a6313980c6ae5de => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:36.784980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f45f3-7f60-49b6-bccd-294137d850cd admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:36.786764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ed1bf-d073-4fcf-82ef-c55d440003c1 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:36.787242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ed1bf-d073-4fcf-82ef-c55d440003c1 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:36.787472 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067ed1bf-d073-4fcf-82ef-c55d440003c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.814449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-067ed1bf-d073-4fcf-82ef-c55d440003c1 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:36.814449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-067ed1bf-d073-4fcf-82ef-c55d440003c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:36.865390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ea39b-257d-4e20-bc70-bb23e5c2b80c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:36.866658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ea39b-257d-4e20-bc70-bb23e5c2b80c admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:36.867070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ea39b-257d-4e20-bc70-bb23e5c2b80c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:36.867395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ea39b-257d-4e20-bc70-bb23e5c2b80c admin admin] PATH_INFO: `/v3/projects/b40b776d9da2486cb20dabb01e13bca0/users/66b03571917344ed86b57bc3f2795f6a/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.885132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1039/2085] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:36.885132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ed1bf-d073-4fcf-82ef-c55d440003c1 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:36.885132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-067ed1bf-d073-4fcf-82ef-c55d440003c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:36.890275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ea39b-257d-4e20-bc70-bb23e5c2b80c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b40b776d9da2486cb20dabb01e13bca0, user_id=66b03571917344ed86b57bc3f2795f6a, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:36.893061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970ea39b-257d-4e20-bc70-bb23e5c2b80c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:36.906801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067ed1bf-d073-4fcf-82ef-c55d440003c1 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:36.911611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc32d4d-deb9-497a-a63b-968d555c1a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:36.912572 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc32d4d-deb9-497a-a63b-968d555c1a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:36.913027 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc32d4d-deb9-497a-a63b-968d555c1a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:36.913315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc32d4d-deb9-497a-a63b-968d555c1a12 admin admin] PATH_INFO: `/v3/projects/f3fdaa05e2c64f4e9a13076764ae8d68` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:36.914775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc32d4d-deb9-497a-a63b-968d555c1a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3fdaa05e2c64f4e9a13076764ae8d68)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:36.917357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc32d4d-deb9-497a-a63b-968d555c1a12 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:36.965793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:36.972155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1047/2086] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:36 2022] PUT /identity/v3/projects/b40b776d9da2486cb20dabb01e13bca0/users/66b03571917344ed86b57bc3f2795f6a/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:36.973179 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ea39b-257d-4e20-bc70-bb23e5c2b80c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:36.975173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-970ea39b-257d-4e20-bc70-bb23e5c2b80c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:37.034722 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ea39b-257d-4e20-bc70-bb23e5c2b80c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:37.044498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-cfc32d4d-deb9-497a-a63b-968d555c1a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3fdaa05e2c64f4e9a13076764ae8d68', 'request_id': 'req-cfc32d4d-deb9-497a-a63b-968d555c1a12'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.051420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-cfc32d4d-deb9-497a-a63b-968d555c1a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3fdaa05e2c64f4e9a13076764ae8d68', 'request_id': 'req-cfc32d4d-deb9-497a-a63b-968d555c1a12'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.062535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-cfc32d4d-deb9-497a-a63b-968d555c1a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3fdaa05e2c64f4e9a13076764ae8d68', 'request_id': 'req-cfc32d4d-deb9-497a-a63b-968d555c1a12'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.120939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c929d85-6936-4ed6-9dab-328aa5798023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:37.121744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c929d85-6936-4ed6-9dab-328aa5798023 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:37.122100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c929d85-6936-4ed6-9dab-328aa5798023 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:37.122453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c929d85-6936-4ed6-9dab-328aa5798023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:37.225675 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c929d85-6936-4ed6-9dab-328aa5798023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:37.227228 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c929d85-6936-4ed6-9dab-328aa5798023 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:37.235885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-cfc32d4d-deb9-497a-a63b-968d555c1a12 admin admin] The token cache is being invalidate because project f3fdaa05e2c64f4e9a13076764ae8d68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:37.237302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-cfc32d4d-deb9-497a-a63b-968d555c1a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.238879 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-cfc32d4d-deb9-497a-a63b-968d555c1a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.239666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1048/2087] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:37.240613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c929d85-6936-4ed6-9dab-328aa5798023 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:37.241954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4c929d85-6936-4ed6-9dab-328aa5798023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:37.242288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1040/2088] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:36 2022] DELETE /identity/v3/projects/f3fdaa05e2c64f4e9a13076764ae8d68 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:37.244916 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22c793-f722-4c9a-a7fb-239e551acd82 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:37.245201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22c793-f722-4c9a-a7fb-239e551acd82 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:37.246144 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22c793-f722-4c9a-a7fb-239e551acd82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:37.258787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c929d85-6936-4ed6-9dab-328aa5798023 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:37.265446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:37.270372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:37.270372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:37.270372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] PATH_INFO: `/v3/projects/2968a97e737f493d9468e1c3b48e24da` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:37.270372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2968a97e737f493d9468e1c3b48e24da)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:37.270372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:37.293089 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ad22c793-f722-4c9a-a7fb-239e551acd82 None None] MFA Rules not processed for user `66b03571917344ed86b57bc3f2795f6a`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:37.294337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ad22c793-f722-4c9a-a7fb-239e551acd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:37.391418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1041/2089] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:37.392404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22c793-f722-4c9a-a7fb-239e551acd82 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:37.393743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ad22c793-f722-4c9a-a7fb-239e551acd82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:37.411616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22c793-f722-4c9a-a7fb-239e551acd82 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:37.416317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:37.417353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:37.417697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:37.418044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] PATH_INFO: `/v3/users/c20f9d77e93d4096aff521448f8d4155` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:37.419418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c20f9d77e93d4096aff521448f8d4155)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:37.421654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:37.468949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2968a97e737f493d9468e1c3b48e24da', 'request_id': 'req-eb988328-2c0b-4445-a52d-9f021af8ae9d'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.478164 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2968a97e737f493d9468e1c3b48e24da', 'request_id': 'req-eb988328-2c0b-4445-a52d-9f021af8ae9d'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.484591 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2968a97e737f493d9468e1c3b48e24da', 'request_id': 'req-eb988328-2c0b-4445-a52d-9f021af8ae9d'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.605664 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] The token cache is being invalidate because project 2968a97e737f493d9468e1c3b48e24da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:37.605786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.606404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.608240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1049/2090] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:37 2022] DELETE /identity/v3/projects/2968a97e737f493d9468e1c3b48e24da => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:37.608992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:37.610712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:37.679873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb988328-2c0b-4445-a52d-9f021af8ae9d admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:37.685254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4983bee-0e21-4e21-a292-2503b6faa6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:37.685953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4983bee-0e21-4e21-a292-2503b6faa6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:37.686244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4983bee-0e21-4e21-a292-2503b6faa6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:37.686525 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4983bee-0e21-4e21-a292-2503b6faa6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:37.687234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4983bee-0e21-4e21-a292-2503b6faa6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:37.689200 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4983bee-0e21-4e21-a292-2503b6faa6c0 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:37.724566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c20f9d77e93d4096aff521448f8d4155'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.725237 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c20f9d77e93d4096aff521448f8d4155'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.725934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c20f9d77e93d4096aff521448f8d4155'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.799440 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1050/2091] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:37 2022] POST /identity/v3/projects => generated 383 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:37.800842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e4788-7a89-463c-ba1c-2f68dc256b6a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:37.801135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e4788-7a89-463c-ba1c-2f68dc256b6a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:37.801427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1e4788-7a89-463c-ba1c-2f68dc256b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:37.824616 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-2d1e4788-7a89-463c-ba1c-2f68dc256b6a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:37.825860 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2d1e4788-7a89-463c-ba1c-2f68dc256b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:37.827010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c20f9d77e93d4096aff521448f8d4155'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.838378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c20f9d77e93d4096aff521448f8d4155'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:37.886023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1042/2092] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:37 2022] DELETE /identity/v3/users/c20f9d77e93d4096aff521448f8d4155 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:37.888568 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:37.902721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:37.930036 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1051/2093] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:37.931221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e4788-7a89-463c-ba1c-2f68dc256b6a None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:37.937862 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2d1e4788-7a89-463c-ba1c-2f68dc256b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:37.964511 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1e4788-7a89-463c-ba1c-2f68dc256b6a None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:38.012145 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0143bdd5-d316-41a7-a458-55138e66799e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:38.018537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c92549-9580-4ada-8cbd-33e2d19883c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:38.019980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c92549-9580-4ada-8cbd-33e2d19883c1 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:38.025390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c92549-9580-4ada-8cbd-33e2d19883c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:38.025390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c92549-9580-4ada-8cbd-33e2d19883c1 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:38.025390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c92549-9580-4ada-8cbd-33e2d19883c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:38.026315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c92549-9580-4ada-8cbd-33e2d19883c1 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:38.100285 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:38.101368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:38.101833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:38.102159 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] PATH_INFO: `/v3/projects/48b97469d5774c21b6d501d48ab0f758` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:38.104293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=48b97469d5774c21b6d501d48ab0f758)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:38.106384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:38.129544 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1043/2094] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:37 2022] POST /identity/v3/users => generated 292 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:38.133790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82daf1-983e-4baa-9c56-8be9ae79ca33 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:38.134217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82daf1-983e-4baa-9c56-8be9ae79ca33 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:38.134619 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a82daf1-983e-4baa-9c56-8be9ae79ca33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:38.154367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-4a82daf1-983e-4baa-9c56-8be9ae79ca33 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:38.155587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-4a82daf1-983e-4baa-9c56-8be9ae79ca33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:38.164162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1044/2095] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:38.164958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82daf1-983e-4baa-9c56-8be9ae79ca33 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:38.175754 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a82daf1-983e-4baa-9c56-8be9ae79ca33 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:38.181387 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64537e3c-c870-4988-b21c-7924f044249b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:38.182059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64537e3c-c870-4988-b21c-7924f044249b admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:38.182348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64537e3c-c870-4988-b21c-7924f044249b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:38.182650 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64537e3c-c870-4988-b21c-7924f044249b admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:38.183468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64537e3c-c870-4988-b21c-7924f044249b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:38.185121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64537e3c-c870-4988-b21c-7924f044249b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:38.195953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1045/2096] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:38.196696 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64537e3c-c870-4988-b21c-7924f044249b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:38.210974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64537e3c-c870-4988-b21c-7924f044249b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:38.234523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb782f-cc3a-468e-b15d-a5ae31d83148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:38.234523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb782f-cc3a-468e-b15d-a5ae31d83148 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:38.234523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb782f-cc3a-468e-b15d-a5ae31d83148 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:38.234523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cb782f-cc3a-468e-b15d-a5ae31d83148 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:38.236464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb782f-cc3a-468e-b15d-a5ae31d83148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:38.237686 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb782f-cc3a-468e-b15d-a5ae31d83148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:38.242489 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cb782f-cc3a-468e-b15d-a5ae31d83148 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:38.260939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1046/2097] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:38.261864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb782f-cc3a-468e-b15d-a5ae31d83148 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:38.281431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cb782f-cc3a-468e-b15d-a5ae31d83148 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:38.292258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48b97469d5774c21b6d501d48ab0f758', 'request_id': 'req-3b6102be-a7b4-4274-9be3-a7980c320d6d'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:38.306225 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48b97469d5774c21b6d501d48ab0f758', 'request_id': 'req-3b6102be-a7b4-4274-9be3-a7980c320d6d'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:38.328543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48b97469d5774c21b6d501d48ab0f758', 'request_id': 'req-3b6102be-a7b4-4274-9be3-a7980c320d6d'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:38.362731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5e375-4ca4-451d-8a4f-021eab5af543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:38.363418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5e375-4ca4-451d-8a4f-021eab5af543 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:38.363701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5e375-4ca4-451d-8a4f-021eab5af543 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:38.364012 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5e375-4ca4-451d-8a4f-021eab5af543 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:38.364753 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5e375-4ca4-451d-8a4f-021eab5af543 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:38.366457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd5e375-4ca4-451d-8a4f-021eab5af543 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:38.378309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1047/2098] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:38.379305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5e375-4ca4-451d-8a4f-021eab5af543 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:38.406856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd5e375-4ca4-451d-8a4f-021eab5af543 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:38.413980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9571dfa-73c0-4e9a-9070-023a8b4b933f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:38.418613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9571dfa-73c0-4e9a-9070-023a8b4b933f admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:38.418613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9571dfa-73c0-4e9a-9070-023a8b4b933f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:38.418613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9571dfa-73c0-4e9a-9070-023a8b4b933f admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:38.418613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9571dfa-73c0-4e9a-9070-023a8b4b933f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:38.418613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9571dfa-73c0-4e9a-9070-023a8b4b933f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:38.454914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] The token cache is being invalidate because project 48b97469d5774c21b6d501d48ab0f758 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:38.455224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:38.455905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:38.457687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1052/2099] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:37 2022] DELETE /identity/v3/projects/48b97469d5774c21b6d501d48ab0f758 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:38.461522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:38.463384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:38.476841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6102be-a7b4-4274-9be3-a7980c320d6d admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:38.481568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c212d-5a3a-4697-bbc0-68cfb29e9a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:38.482440 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c212d-5a3a-4697-bbc0-68cfb29e9a51 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:38.482724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c212d-5a3a-4697-bbc0-68cfb29e9a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:38.483001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48c212d-5a3a-4697-bbc0-68cfb29e9a51 admin admin] PATH_INFO: `/v3/projects/d2f25b1e72964708bbc672ef81c6db02/users/0a8f12877ca949d0a2419bccddc2edb0/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:38.498484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c212d-5a3a-4697-bbc0-68cfb29e9a51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2f25b1e72964708bbc672ef81c6db02, user_id=0a8f12877ca949d0a2419bccddc2edb0, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:38.501213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48c212d-5a3a-4697-bbc0-68cfb29e9a51 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:38.546098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:38.560163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1048/2100] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:38 2022] POST /identity/v3/projects => generated 371 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:38.560163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9571dfa-73c0-4e9a-9070-023a8b4b933f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:38.560163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a9571dfa-73c0-4e9a-9070-023a8b4b933f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:38.611834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1053/2101] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:38 2022] PUT /identity/v3/projects/d2f25b1e72964708bbc672ef81c6db02/users/0a8f12877ca949d0a2419bccddc2edb0/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:38.611834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c212d-5a3a-4697-bbc0-68cfb29e9a51 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:38.611834 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c48c212d-5a3a-4697-bbc0-68cfb29e9a51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:38.648200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9571dfa-73c0-4e9a-9070-023a8b4b933f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:38.693323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48c212d-5a3a-4697-bbc0-68cfb29e9a51 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:38.700539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30461b3-d99c-475b-a566-79b107b679ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:38.701558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30461b3-d99c-475b-a566-79b107b679ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:38.701949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30461b3-d99c-475b-a566-79b107b679ec admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:38.703162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30461b3-d99c-475b-a566-79b107b679ec admin admin] PATH_INFO: `/v3/projects/06728cdedcbe433891fdf748273e96dc` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:38.704858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30461b3-d99c-475b-a566-79b107b679ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=06728cdedcbe433891fdf748273e96dc)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:38.708008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30461b3-d99c-475b-a566-79b107b679ec admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:38.715396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:38.717938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:38.717938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:38.717938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] PATH_INFO: `/v3/users/1ab0b345e12b4d95981acf69bf6637a0` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:38.718251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ab0b345e12b4d95981acf69bf6637a0)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:38.720227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:38.821064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:38.950132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e30461b3-d99c-475b-a566-79b107b679ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06728cdedcbe433891fdf748273e96dc', 'request_id': 'req-e30461b3-d99c-475b-a566-79b107b679ec'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:38.951769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ab0b345e12b4d95981acf69bf6637a0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:38.952585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ab0b345e12b4d95981acf69bf6637a0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:38.953268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ab0b345e12b4d95981acf69bf6637a0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:38.955942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e30461b3-d99c-475b-a566-79b107b679ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06728cdedcbe433891fdf748273e96dc', 'request_id': 'req-e30461b3-d99c-475b-a566-79b107b679ec'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:38.962757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e30461b3-d99c-475b-a566-79b107b679ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06728cdedcbe433891fdf748273e96dc', 'request_id': 'req-e30461b3-d99c-475b-a566-79b107b679ec'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:39.052942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ab0b345e12b4d95981acf69bf6637a0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:39.060482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ab0b345e12b4d95981acf69bf6637a0'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:39.081628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1049/2102] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:38 2022] DELETE /identity/v3/users/1ab0b345e12b4d95981acf69bf6637a0 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:39.082460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:39.083798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:39.140781 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:39.148708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e30461b3-d99c-475b-a566-79b107b679ec admin admin] The token cache is being invalidate because project 06728cdedcbe433891fdf748273e96dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:39.148998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e30461b3-d99c-475b-a566-79b107b679ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:39.150438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e30461b3-d99c-475b-a566-79b107b679ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:39.153096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1054/2103] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:38 2022] DELETE /identity/v3/projects/06728cdedcbe433891fdf748273e96dc => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:39.156909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab107419-fdc4-40a4-ab7b-b0eca54ac64e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:39.157024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909f24d-5a0c-49a7-8b90-c1c4ac7a509a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.157024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909f24d-5a0c-49a7-8b90-c1c4ac7a509a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.157024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c909f24d-5a0c-49a7-8b90-c1c4ac7a509a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.160256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d450fff-8eba-4449-91ae-7a70295cf6df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:39.160971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d450fff-8eba-4449-91ae-7a70295cf6df admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.161260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d450fff-8eba-4449-91ae-7a70295cf6df admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.161698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d450fff-8eba-4449-91ae-7a70295cf6df admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.162335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d450fff-8eba-4449-91ae-7a70295cf6df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:39.164369 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d450fff-8eba-4449-91ae-7a70295cf6df admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:39.184667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-c909f24d-5a0c-49a7-8b90-c1c4ac7a509a None None] MFA Rules not processed for user `0a8f12877ca949d0a2419bccddc2edb0`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:39.186017 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c909f24d-5a0c-49a7-8b90-c1c4ac7a509a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:39.253203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1055/2104] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:39.254635 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21c59-787b-45ed-9b3c-861a8f47c25d None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.254924 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21c59-787b-45ed-9b3c-861a8f47c25d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.255203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c21c59-787b-45ed-9b3c-861a8f47c25d None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.256721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1056/2105] 10.222.0.52 () {54 vars in 921 bytes} [Thu Jun 23 11:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:11:39.257190 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21c59-787b-45ed-9b3c-861a8f47c25d None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:39.259597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f3c21c59-787b-45ed-9b3c-861a8f47c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:39.271482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1050/2106] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:39 2022] POST /identity/v3/users => generated 286 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:39.274165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5bca-f985-4d3b-bbfc-0066f6896ca6 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.274682 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5bca-f985-4d3b-bbfc-0066f6896ca6 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.275205 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc5bca-f985-4d3b-bbfc-0066f6896ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.279540 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c21c59-787b-45ed-9b3c-861a8f47c25d None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:39.285811 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91da3ad3-f9a8-4406-8bdd-2cb144a623f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:39.286690 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3ad3-f9a8-4406-8bdd-2cb144a623f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.286981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3ad3-f9a8-4406-8bdd-2cb144a623f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.293361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da3ad3-f9a8-4406-8bdd-2cb144a623f3 admin admin] PATH_INFO: `/v3/users/9b9874ab7e7443db81dfde42b37d363f` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.293361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da3ad3-f9a8-4406-8bdd-2cb144a623f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b9874ab7e7443db81dfde42b37d363f)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:39.293361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91da3ad3-f9a8-4406-8bdd-2cb144a623f3 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:39.299791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ebcc5bca-f985-4d3b-bbfc-0066f6896ca6 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:39.301309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ebcc5bca-f985-4d3b-bbfc-0066f6896ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:39.331367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1051/2107] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:39.331367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc5bca-f985-4d3b-bbfc-0066f6896ca6 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:39.331367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ebcc5bca-f985-4d3b-bbfc-0066f6896ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:39.338711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc5bca-f985-4d3b-bbfc-0066f6896ca6 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:39.344522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9a4ea4-eb0f-4619-a7e3-c57310311d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:39.345242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a4ea4-eb0f-4619-a7e3-c57310311d0e admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.345526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a4ea4-eb0f-4619-a7e3-c57310311d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.345805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9a4ea4-eb0f-4619-a7e3-c57310311d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.346509 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a4ea4-eb0f-4619-a7e3-c57310311d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:39.348482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9a4ea4-eb0f-4619-a7e3-c57310311d0e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:39.429552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1052/2108] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:39 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:39.432111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b5721-2906-447d-859b-14de76a90cfd None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.432773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b5721-2906-447d-859b-14de76a90cfd None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.433363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b5721-2906-447d-859b-14de76a90cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.458858 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-987b5721-2906-447d-859b-14de76a90cfd None None] MFA Rules not processed for user `e838dd9aa24f4571b64719125610c528`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:39.460236 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-987b5721-2906-447d-859b-14de76a90cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:39.463638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-91da3ad3-f9a8-4406-8bdd-2cb144a623f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b9874ab7e7443db81dfde42b37d363f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:39.476332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-91da3ad3-f9a8-4406-8bdd-2cb144a623f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b9874ab7e7443db81dfde42b37d363f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:39.477298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-91da3ad3-f9a8-4406-8bdd-2cb144a623f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b9874ab7e7443db81dfde42b37d363f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:39.478648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-91da3ad3-f9a8-4406-8bdd-2cb144a623f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b9874ab7e7443db81dfde42b37d363f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:39.525367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1053/2109] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Jun 23 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:39.526367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b5721-2906-447d-859b-14de76a90cfd None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:39.527756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-987b5721-2906-447d-859b-14de76a90cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:39.574346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-91da3ad3-f9a8-4406-8bdd-2cb144a623f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b9874ab7e7443db81dfde42b37d363f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:39.592702 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1057/2110] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:39 2022] DELETE /identity/v3/users/9b9874ab7e7443db81dfde42b37d363f => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:39.594291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e92ee5-fc7b-49db-ab40-37d7d4ddace2 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.594687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e92ee5-fc7b-49db-ab40-37d7d4ddace2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.595411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e92ee5-fc7b-49db-ab40-37d7d4ddace2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.606859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b5721-2906-447d-859b-14de76a90cfd None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:39.618090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-26e92ee5-fc7b-49db-ab40-37d7d4ddace2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:39.619537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-26e92ee5-fc7b-49db-ab40-37d7d4ddace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:39.703336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e382d6e-46db-4f0c-81a9-92d826046682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:39.703557 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1058/2111] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:39.704397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e382d6e-46db-4f0c-81a9-92d826046682 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.704846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e382d6e-46db-4f0c-81a9-92d826046682 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.704946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e92ee5-fc7b-49db-ab40-37d7d4ddace2 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:39.705442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e382d6e-46db-4f0c-81a9-92d826046682 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.706414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e382d6e-46db-4f0c-81a9-92d826046682 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:39.708251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e382d6e-46db-4f0c-81a9-92d826046682 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:39.708958 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-26e92ee5-fc7b-49db-ab40-37d7d4ddace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:39.722059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1054/2112] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:39.722059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e382d6e-46db-4f0c-81a9-92d826046682 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:39.722059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-4e382d6e-46db-4f0c-81a9-92d826046682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:39.731658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e92ee5-fc7b-49db-ab40-37d7d4ddace2 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:39.740371 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c8b9a-1eae-481d-946c-5b26c166fbf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:39.741534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c8b9a-1eae-481d-946c-5b26c166fbf7 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.742046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c8b9a-1eae-481d-946c-5b26c166fbf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.742562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c8b9a-1eae-481d-946c-5b26c166fbf7 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.743957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c8b9a-1eae-481d-946c-5b26c166fbf7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:39.747792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3c8b9a-1eae-481d-946c-5b26c166fbf7 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:39.794378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e382d6e-46db-4f0c-81a9-92d826046682 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:39.799687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b52785-22a0-4db0-bfc0-5fa45546e041 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e838dd9aa24f4571b64719125610c528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:39.800777 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b52785-22a0-4db0-bfc0-5fa45546e041 service placement] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.800777 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b52785-22a0-4db0-bfc0-5fa45546e041 service placement] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.801034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b52785-22a0-4db0-bfc0-5fa45546e041 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.810057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b52785-22a0-4db0-bfc0-5fa45546e041 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:39.811665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b52785-22a0-4db0-bfc0-5fa45546e041 service placement] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:39.822904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1055/2113] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:39.824029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b52785-22a0-4db0-bfc0-5fa45546e041 service placement] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:39.825571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-95b52785-22a0-4db0-bfc0-5fa45546e041 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:39.839947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b52785-22a0-4db0-bfc0-5fa45546e041 service placement] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:39.844998 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:39.845854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.846140 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.846416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] PATH_INFO: `/v3/projects/74b19975eec640739ec6f5d583ddebb7` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.847606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b19975eec640739ec6f5d583ddebb7)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:39.849548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:39.874691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1059/2114] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:39 2022] POST /identity/v3/users => generated 299 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:39.875765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c8b9a-1eae-481d-946c-5b26c166fbf7 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:39.886435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3c8b9a-1eae-481d-946c-5b26c166fbf7 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:39.891742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fbf13-53a3-4d9a-82af-73c08ff4f80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:39.892463 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fbf13-53a3-4d9a-82af-73c08ff4f80b admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.892870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fbf13-53a3-4d9a-82af-73c08ff4f80b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.893151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400fbf13-53a3-4d9a-82af-73c08ff4f80b admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.894063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fbf13-53a3-4d9a-82af-73c08ff4f80b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:39.894368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fbf13-53a3-4d9a-82af-73c08ff4f80b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:39.896091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400fbf13-53a3-4d9a-82af-73c08ff4f80b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:39.909453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1060/2115] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:39.910289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fbf13-53a3-4d9a-82af-73c08ff4f80b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:39.920329 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400fbf13-53a3-4d9a-82af-73c08ff4f80b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:39.924953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cb0d6-31a1-4072-adf2-d78d56733046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:39.925649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cb0d6-31a1-4072-adf2-d78d56733046 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.925931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cb0d6-31a1-4072-adf2-d78d56733046 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.926209 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cb0d6-31a1-4072-adf2-d78d56733046 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.926932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cb0d6-31a1-4072-adf2-d78d56733046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:39.928721 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cb0d6-31a1-4072-adf2-d78d56733046 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:39.939651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1061/2116] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:39.940235 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cb0d6-31a1-4072-adf2-d78d56733046 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:39.960702 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cb0d6-31a1-4072-adf2-d78d56733046 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:39.970356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21785ccd-a759-44ce-baf5-f688ae336f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:39.971020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21785ccd-a759-44ce-baf5-f688ae336f28 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:39.971299 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21785ccd-a759-44ce-baf5-f688ae336f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:39.971644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21785ccd-a759-44ce-baf5-f688ae336f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:39.972658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21785ccd-a759-44ce-baf5-f688ae336f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:39.974500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21785ccd-a759-44ce-baf5-f688ae336f28 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:39.994118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1062/2117] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:39.995790 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21785ccd-a759-44ce-baf5-f688ae336f28 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:40.020477 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b19975eec640739ec6f5d583ddebb7', 'request_id': 'req-57cb9f27-e890-4d10-bed0-017c4d56e53c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:40.024515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21785ccd-a759-44ce-baf5-f688ae336f28 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:40.031122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b19975eec640739ec6f5d583ddebb7', 'request_id': 'req-57cb9f27-e890-4d10-bed0-017c4d56e53c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:40.039371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b19975eec640739ec6f5d583ddebb7', 'request_id': 'req-57cb9f27-e890-4d10-bed0-017c4d56e53c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:40.099070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec473cc5-c21a-4276-a92a-00b1b1647fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:40.099728 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec473cc5-c21a-4276-a92a-00b1b1647fbf admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.100048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec473cc5-c21a-4276-a92a-00b1b1647fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.100326 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec473cc5-c21a-4276-a92a-00b1b1647fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.101010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec473cc5-c21a-4276-a92a-00b1b1647fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:40.103405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec473cc5-c21a-4276-a92a-00b1b1647fbf admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:40.162997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] The token cache is being invalidate because project 74b19975eec640739ec6f5d583ddebb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:40.163395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:40.164106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:40.166337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1056/2118] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:39 2022] DELETE /identity/v3/projects/74b19975eec640739ec6f5d583ddebb7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:40.167079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:40.168395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:40.180074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:40.183554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cb9f27-e890-4d10-bed0-017c4d56e53c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:40.188310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a499a-ad16-429e-b1b5-449d6dce36c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:40.189202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a499a-ad16-429e-b1b5-449d6dce36c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.189489 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a499a-ad16-429e-b1b5-449d6dce36c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.189771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a499a-ad16-429e-b1b5-449d6dce36c1 admin admin] PATH_INFO: `/v3/projects/83a719dd8fdc4a1a838d1da6de88fad8/users/dbb1a907aaee40de9c87dbfe96a6ebd7/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.204781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a499a-ad16-429e-b1b5-449d6dce36c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83a719dd8fdc4a1a838d1da6de88fad8, user_id=dbb1a907aaee40de9c87dbfe96a6ebd7, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:40.207552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a499a-ad16-429e-b1b5-449d6dce36c1 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:40.244401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1063/2119] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:39 2022] POST /identity/v3/projects => generated 393 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:40.245362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec473cc5-c21a-4276-a92a-00b1b1647fbf admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:40.247270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ec473cc5-c21a-4276-a92a-00b1b1647fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:40.317462 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec473cc5-c21a-4276-a92a-00b1b1647fbf admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:40.318733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1057/2120] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:40 2022] PUT /identity/v3/projects/83a719dd8fdc4a1a838d1da6de88fad8/users/dbb1a907aaee40de9c87dbfe96a6ebd7/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:40.320143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a499a-ad16-429e-b1b5-449d6dce36c1 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:40.322010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c64a499a-ad16-429e-b1b5-449d6dce36c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:40.381877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ae867-66be-4b1e-b6a6-8a770bcb0f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:40.382826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ae867-66be-4b1e-b6a6-8a770bcb0f87 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.383109 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ae867-66be-4b1e-b6a6-8a770bcb0f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.383386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ae867-66be-4b1e-b6a6-8a770bcb0f87 admin admin] PATH_INFO: `/v3/projects/6ffd09ac271b4279bd78f199bbe87dc1/users/a8a9a157c4a54f378a2436b4cd7e8782/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.389577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a499a-ad16-429e-b1b5-449d6dce36c1 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:40.394458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:40.395320 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.395639 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.395947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c admin admin] PATH_INFO: `/v3/projects/c5df3f0dc5e549b1a3c97b1ce2e59912` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.397198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5df3f0dc5e549b1a3c97b1ce2e59912)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:40.398621 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ae867-66be-4b1e-b6a6-8a770bcb0f87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffd09ac271b4279bd78f199bbe87dc1, user_id=a8a9a157c4a54f378a2436b4cd7e8782, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:40.399133 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:40.402487 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ae867-66be-4b1e-b6a6-8a770bcb0f87 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:40.407065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:40.516277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1064/2121] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:40 2022] PUT /identity/v3/projects/6ffd09ac271b4279bd78f199bbe87dc1/users/a8a9a157c4a54f378a2436b4cd7e8782/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:40.517602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942f842-1224-483e-a057-ac7ebc94c707 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.517886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942f842-1224-483e-a057-ac7ebc94c707 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.518181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b942f842-1224-483e-a057-ac7ebc94c707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.536430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b942f842-1224-483e-a057-ac7ebc94c707 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:40.537635 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b942f842-1224-483e-a057-ac7ebc94c707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:40.571250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5df3f0dc5e549b1a3c97b1ce2e59912', 'request_id': 'req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:40.587036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5df3f0dc5e549b1a3c97b1ce2e59912', 'request_id': 'req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:40.593197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5df3f0dc5e549b1a3c97b1ce2e59912', 'request_id': 'req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:40.615527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1065/2122] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:40.616398 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942f842-1224-483e-a057-ac7ebc94c707 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:40.617760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b942f842-1224-483e-a057-ac7ebc94c707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:40.629358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b942f842-1224-483e-a057-ac7ebc94c707 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:40.688082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a163b-f5c5-43eb-b978-aa630a750d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:40.688897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a163b-f5c5-43eb-b978-aa630a750d92 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.689188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a163b-f5c5-43eb-b978-aa630a750d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.689471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a163b-f5c5-43eb-b978-aa630a750d92 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.690254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a163b-f5c5-43eb-b978-aa630a750d92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:40.692402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181a163b-f5c5-43eb-b978-aa630a750d92 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:40.705096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c admin admin] The token cache is being invalidate because project c5df3f0dc5e549b1a3c97b1ce2e59912 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:40.705968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:40.709125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-64c5dba2-f3e8-42fa-a5a1-dcab5655033c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:40.709125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1058/2123] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:40 2022] DELETE /identity/v3/projects/c5df3f0dc5e549b1a3c97b1ce2e59912 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:40.709125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5ee8f-e407-4677-aca3-c4d16671447f None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.709412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5ee8f-e407-4677-aca3-c4d16671447f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.709689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e5ee8f-e407-4677-aca3-c4d16671447f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.728801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-82e5ee8f-e407-4677-aca3-c4d16671447f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:40.729925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-82e5ee8f-e407-4677-aca3-c4d16671447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:40.737975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1059/2124] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:40.738846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5ee8f-e407-4677-aca3-c4d16671447f None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:40.740121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-82e5ee8f-e407-4677-aca3-c4d16671447f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:40.752246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e5ee8f-e407-4677-aca3-c4d16671447f None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:40.756931 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87232d-7213-49b1-9493-1f43f66ff1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:40.757692 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87232d-7213-49b1-9493-1f43f66ff1e1 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.757903 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87232d-7213-49b1-9493-1f43f66ff1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.758144 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87232d-7213-49b1-9493-1f43f66ff1e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.758877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87232d-7213-49b1-9493-1f43f66ff1e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:40.761005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87232d-7213-49b1-9493-1f43f66ff1e1 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:40.771151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1060/2125] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:40.772502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be85dc1-750c-46c8-bc62-76cb4bc5eefb None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.779284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be85dc1-750c-46c8-bc62-76cb4bc5eefb None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.779284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be85dc1-750c-46c8-bc62-76cb4bc5eefb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.791432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0be85dc1-750c-46c8-bc62-76cb4bc5eefb None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:40.792693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0be85dc1-750c-46c8-bc62-76cb4bc5eefb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:40.801254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1061/2126] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:40.802461 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8340363-6992-4439-85a5-d5a468c124d5 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.802753 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8340363-6992-4439-85a5-d5a468c124d5 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.803034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8340363-6992-4439-85a5-d5a468c124d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.820907 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-e8340363-6992-4439-85a5-d5a468c124d5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:40.822660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e8340363-6992-4439-85a5-d5a468c124d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:40.830911 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1062/2127] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:40.831690 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8340363-6992-4439-85a5-d5a468c124d5 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:40.833048 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e8340363-6992-4439-85a5-d5a468c124d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:40.859723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1066/2128] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:40 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:40.860574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a163b-f5c5-43eb-b978-aa630a750d92 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:40.871507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a163b-f5c5-43eb-b978-aa630a750d92 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:40.876330 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cc681-f441-44b7-96b8-9cdcdbb290fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:40.877223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc681-f441-44b7-96b8-9cdcdbb290fb admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.877518 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc681-f441-44b7-96b8-9cdcdbb290fb admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.877780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cc681-f441-44b7-96b8-9cdcdbb290fb admin admin] PATH_INFO: `/v3/projects/6ffd09ac271b4279bd78f199bbe87dc1/users/a8a9a157c4a54f378a2436b4cd7e8782/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.880154 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cc681-f441-44b7-96b8-9cdcdbb290fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ffd09ac271b4279bd78f199bbe87dc1, user_id=a8a9a157c4a54f378a2436b4cd7e8782, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:40.882994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cc681-f441-44b7-96b8-9cdcdbb290fb admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:40.892336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8340363-6992-4439-85a5-d5a468c124d5 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:40.894533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1067/2129] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:40 2022] PUT /identity/v3/projects/6ffd09ac271b4279bd78f199bbe87dc1/users/a8a9a157c4a54f378a2436b4cd7e8782/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:40.895488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cc681-f441-44b7-96b8-9cdcdbb290fb admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:40.955822 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa19f6-c01e-4f9f-a956-96dbcfbdf4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:40.956490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa19f6-c01e-4f9f-a956-96dbcfbdf4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.956776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa19f6-c01e-4f9f-a956-96dbcfbdf4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.957054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa19f6-c01e-4f9f-a956-96dbcfbdf4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.966759 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cc681-f441-44b7-96b8-9cdcdbb290fb admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:40.966905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa19f6-c01e-4f9f-a956-96dbcfbdf4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:40.968325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa19f6-c01e-4f9f-a956-96dbcfbdf4f8 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:40.971478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221be56-ef0a-4c41-ac39-9ec175fbd724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:40.972173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221be56-ef0a-4c41-ac39-9ec175fbd724 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.972448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221be56-ef0a-4c41-ac39-9ec175fbd724 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.972718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221be56-ef0a-4c41-ac39-9ec175fbd724 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.973421 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221be56-ef0a-4c41-ac39-9ec175fbd724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:40.973722 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221be56-ef0a-4c41-ac39-9ec175fbd724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:40.975355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221be56-ef0a-4c41-ac39-9ec175fbd724 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:40.978838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1063/2130] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:40.980004 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c57878-2a22-48df-8422-319bb8eeec11 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:40.980475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c57878-2a22-48df-8422-319bb8eeec11 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:40.980626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c57878-2a22-48df-8422-319bb8eeec11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:40.991699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1068/2131] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:40.992827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221be56-ef0a-4c41-ac39-9ec175fbd724 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:40.995151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8221be56-ef0a-4c41-ac39-9ec175fbd724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:41.001534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-01c57878-2a22-48df-8422-319bb8eeec11 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:41.002552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-01c57878-2a22-48df-8422-319bb8eeec11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:41.008890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221be56-ef0a-4c41-ac39-9ec175fbd724 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.011609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1064/2132] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:41.012906 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64e831-22a6-415d-a6b8-83824ae0cbec None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.013194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64e831-22a6-415d-a6b8-83824ae0cbec None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.013473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc64e831-22a6-415d-a6b8-83824ae0cbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.017441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d67001-d05b-4a6c-a8f0-b006adb78c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.026161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d67001-d05b-4a6c-a8f0-b006adb78c3d admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.026161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d67001-d05b-4a6c-a8f0-b006adb78c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.026161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d67001-d05b-4a6c-a8f0-b006adb78c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.026161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d67001-d05b-4a6c-a8f0-b006adb78c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.026161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d67001-d05b-4a6c-a8f0-b006adb78c3d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.031338 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1069/2133] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:41.032138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d67001-d05b-4a6c-a8f0-b006adb78c3d admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.040537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-cc64e831-22a6-415d-a6b8-83824ae0cbec None None] MFA Rules not processed for user `a8a9a157c4a54f378a2436b4cd7e8782`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:41.041740 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-cc64e831-22a6-415d-a6b8-83824ae0cbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:41.042836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d67001-d05b-4a6c-a8f0-b006adb78c3d admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.047498 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970bb81-01bd-46ec-b4ce-2bf0ea209a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.048233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970bb81-01bd-46ec-b4ce-2bf0ea209a17 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.048452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970bb81-01bd-46ec-b4ce-2bf0ea209a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.048730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8970bb81-01bd-46ec-b4ce-2bf0ea209a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.049418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970bb81-01bd-46ec-b4ce-2bf0ea209a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.051305 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8970bb81-01bd-46ec-b4ce-2bf0ea209a17 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.122709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1065/2134] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:41 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:41.123573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64e831-22a6-415d-a6b8-83824ae0cbec None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.138495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc64e831-22a6-415d-a6b8-83824ae0cbec None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.143853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05226af-fa53-4ab8-8340-ac4536fb008b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.144318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05226af-fa53-4ab8-8340-ac4536fb008b admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.144603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05226af-fa53-4ab8-8340-ac4536fb008b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.145024 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05226af-fa53-4ab8-8340-ac4536fb008b admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.145798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05226af-fa53-4ab8-8340-ac4536fb008b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:41.146107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05226af-fa53-4ab8-8340-ac4536fb008b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.147822 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05226af-fa53-4ab8-8340-ac4536fb008b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.164517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1066/2135] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:41.164811 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1070/2136] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:41 2022] POST /identity/v3/projects => generated 369 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:41.165704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970bb81-01bd-46ec-b4ce-2bf0ea209a17 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.166231 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05226af-fa53-4ab8-8340-ac4536fb008b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.175885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8970bb81-01bd-46ec-b4ce-2bf0ea209a17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:41.180392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05226af-fa53-4ab8-8340-ac4536fb008b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.241430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8970bb81-01bd-46ec-b4ce-2bf0ea209a17 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.246392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10088a58-1db1-4461-8a11-fc8e811ce4e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.247064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10088a58-1db1-4461-8a11-fc8e811ce4e4 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.247344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10088a58-1db1-4461-8a11-fc8e811ce4e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.247619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10088a58-1db1-4461-8a11-fc8e811ce4e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.248270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084265-367e-4448-ab43-a33096d9a693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.248922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084265-367e-4448-ab43-a33096d9a693 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.249181 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084265-367e-4448-ab43-a33096d9a693 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.249460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa084265-367e-4448-ab43-a33096d9a693 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.249615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-10088a58-1db1-4461-8a11-fc8e811ce4e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:41.250252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa084265-367e-4448-ab43-a33096d9a693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.251892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa084265-367e-4448-ab43-a33096d9a693 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.265144 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1067/2137] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:41.265932 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084265-367e-4448-ab43-a33096d9a693 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.276222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa084265-367e-4448-ab43-a33096d9a693 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.281251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4542d3-c17c-4fd7-a7a1-b7ab982f3e0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.281909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4542d3-c17c-4fd7-a7a1-b7ab982f3e0f admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.282191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4542d3-c17c-4fd7-a7a1-b7ab982f3e0f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.282472 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4542d3-c17c-4fd7-a7a1-b7ab982f3e0f admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.283168 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4542d3-c17c-4fd7-a7a1-b7ab982f3e0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.285114 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4542d3-c17c-4fd7-a7a1-b7ab982f3e0f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.312272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10088a58-1db1-4461-8a11-fc8e811ce4e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.313767 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10088a58-1db1-4461-8a11-fc8e811ce4e4 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.323052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1071/2138] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:41.323858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10088a58-1db1-4461-8a11-fc8e811ce4e4 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.336645 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10088a58-1db1-4461-8a11-fc8e811ce4e4 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.344890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e6293-6947-4609-be97-9a26f175cc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.346593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e6293-6947-4609-be97-9a26f175cc67 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.347021 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e6293-6947-4609-be97-9a26f175cc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.347466 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61e6293-6947-4609-be97-9a26f175cc67 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.348426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e6293-6947-4609-be97-9a26f175cc67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.350955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61e6293-6947-4609-be97-9a26f175cc67 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.373707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1068/2139] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:41 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:41.393743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4542d3-c17c-4fd7-a7a1-b7ab982f3e0f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.482562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4542d3-c17c-4fd7-a7a1-b7ab982f3e0f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.489469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fc69d-23b7-4ac2-97bb-b437134de266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.490367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fc69d-23b7-4ac2-97bb-b437134de266 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.490655 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fc69d-23b7-4ac2-97bb-b437134de266 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.490937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fc69d-23b7-4ac2-97bb-b437134de266 admin admin] PATH_INFO: `/v3/projects/4a01091817c548febfd754a5e676a02c/users/c3f93d42665d4d3cb0076fd06ea7c45d/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.504889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1072/2140] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:41 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:41.504889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e6293-6947-4609-be97-9a26f175cc67 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.507862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fc69d-23b7-4ac2-97bb-b437134de266 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a01091817c548febfd754a5e676a02c, user_id=c3f93d42665d4d3cb0076fd06ea7c45d, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.510637 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fc69d-23b7-4ac2-97bb-b437134de266 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.515067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61e6293-6947-4609-be97-9a26f175cc67 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.520146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0a16b-d0c3-4e70-b911-9834819f4756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.520859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0a16b-d0c3-4e70-b911-9834819f4756 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.521149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0a16b-d0c3-4e70-b911-9834819f4756 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.521428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad0a16b-d0c3-4e70-b911-9834819f4756 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.522139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0a16b-d0c3-4e70-b911-9834819f4756 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.524175 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad0a16b-d0c3-4e70-b911-9834819f4756 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.689793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1073/2141] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:41 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:41.690801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0a16b-d0c3-4e70-b911-9834819f4756 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.703678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1069/2142] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:41 2022] PUT /identity/v3/projects/4a01091817c548febfd754a5e676a02c/users/c3f93d42665d4d3cb0076fd06ea7c45d/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:41.703678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fc69d-23b7-4ac2-97bb-b437134de266 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.704368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad0a16b-d0c3-4e70-b911-9834819f4756 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.770988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d18110b-561f-4679-a3f2-1423fef83e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.771727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18110b-561f-4679-a3f2-1423fef83e29 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.772278 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18110b-561f-4679-a3f2-1423fef83e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.772728 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d18110b-561f-4679-a3f2-1423fef83e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.773493 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18110b-561f-4679-a3f2-1423fef83e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.776022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d18110b-561f-4679-a3f2-1423fef83e29 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.778486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fc69d-23b7-4ac2-97bb-b437134de266 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.784241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58568b71-484c-4a3d-ac09-f2430f0643bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.784928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58568b71-484c-4a3d-ac09-f2430f0643bb admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.785212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58568b71-484c-4a3d-ac09-f2430f0643bb admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.786721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58568b71-484c-4a3d-ac09-f2430f0643bb admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.786721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58568b71-484c-4a3d-ac09-f2430f0643bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.787940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58568b71-484c-4a3d-ac09-f2430f0643bb admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.792531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1074/2143] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:41.792531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd6c4c-fafd-407b-8f64-fa317db65bf2 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.792531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd6c4c-fafd-407b-8f64-fa317db65bf2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.792531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd6c4c-fafd-407b-8f64-fa317db65bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.800263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1070/2144] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:41.800809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58568b71-484c-4a3d-ac09-f2430f0643bb admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.811739 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58568b71-484c-4a3d-ac09-f2430f0643bb admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.817214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1c677-30a4-4a10-9b33-0e61fb96d34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.819253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1c677-30a4-4a10-9b33-0e61fb96d34b admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.819253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1c677-30a4-4a10-9b33-0e61fb96d34b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.819253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1c677-30a4-4a10-9b33-0e61fb96d34b admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.819485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1c677-30a4-4a10-9b33-0e61fb96d34b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.821441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1c677-30a4-4a10-9b33-0e61fb96d34b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.825062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5edd6c4c-fafd-407b-8f64-fa317db65bf2 None None] MFA Rules not processed for user `c3f93d42665d4d3cb0076fd06ea7c45d`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:41.826579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5edd6c4c-fafd-407b-8f64-fa317db65bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:41.835976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1071/2145] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:41.835976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1c677-30a4-4a10-9b33-0e61fb96d34b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.848315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1c677-30a4-4a10-9b33-0e61fb96d34b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.853747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52fdd7-75a3-4093-8e5e-39721ee0b613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.854443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52fdd7-75a3-4093-8e5e-39721ee0b613 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.854884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52fdd7-75a3-4093-8e5e-39721ee0b613 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.855170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b52fdd7-75a3-4093-8e5e-39721ee0b613 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.856137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52fdd7-75a3-4093-8e5e-39721ee0b613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.857848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b52fdd7-75a3-4093-8e5e-39721ee0b613 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.869626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1072/2146] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:41.872883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52fdd7-75a3-4093-8e5e-39721ee0b613 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.880957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b52fdd7-75a3-4093-8e5e-39721ee0b613 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.886022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74771dc0-d89f-4b4f-b916-5ddcd137741e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.886925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74771dc0-d89f-4b4f-b916-5ddcd137741e admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.887212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74771dc0-d89f-4b4f-b916-5ddcd137741e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.887491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74771dc0-d89f-4b4f-b916-5ddcd137741e admin admin] PATH_INFO: `/v3/projects/f9412e2625a24d41908cc634e37b25ea/users/80028ef3526e48cda016a9eec4bb5ee2/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.903452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74771dc0-d89f-4b4f-b916-5ddcd137741e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9412e2625a24d41908cc634e37b25ea, user_id=80028ef3526e48cda016a9eec4bb5ee2, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.906238 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74771dc0-d89f-4b4f-b916-5ddcd137741e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:41.917317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1075/2147] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:41.921146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd6c4c-fafd-407b-8f64-fa317db65bf2 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:41.932907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edd6c4c-fafd-407b-8f64-fa317db65bf2 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:41.938539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2600d90-b4f6-4cd1-9a59-d01bbe4cba6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:41.939442 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600d90-b4f6-4cd1-9a59-d01bbe4cba6e admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:41.939888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600d90-b4f6-4cd1-9a59-d01bbe4cba6e admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:41.940176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2600d90-b4f6-4cd1-9a59-d01bbe4cba6e admin admin] PATH_INFO: `/v3/projects/52d337d92f2b463eb96fe92501a0c4cc/users/bdc5ef02c9fd4b2888239b9b19ae4d5e/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:41.956560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2600d90-b4f6-4cd1-9a59-d01bbe4cba6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52d337d92f2b463eb96fe92501a0c4cc, user_id=bdc5ef02c9fd4b2888239b9b19ae4d5e, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:41.959259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2600d90-b4f6-4cd1-9a59-d01bbe4cba6e admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:42.014504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1073/2148] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:41 2022] PUT /identity/v3/projects/f9412e2625a24d41908cc634e37b25ea/users/80028ef3526e48cda016a9eec4bb5ee2/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:42.015407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74771dc0-d89f-4b4f-b916-5ddcd137741e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:42.060677 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1076/2149] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:41 2022] PUT /identity/v3/projects/52d337d92f2b463eb96fe92501a0c4cc/users/bdc5ef02c9fd4b2888239b9b19ae4d5e/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:42.062705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4ddb8-41a5-4677-937b-77b0ef2e5ad6 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:42.062997 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4ddb8-41a5-4677-937b-77b0ef2e5ad6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:42.063273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a4ddb8-41a5-4677-937b-77b0ef2e5ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:42.085188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74771dc0-d89f-4b4f-b916-5ddcd137741e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:42.096340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-09a4ddb8-41a5-4677-937b-77b0ef2e5ad6 None None] MFA Rules not processed for user `80028ef3526e48cda016a9eec4bb5ee2`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:42.097783 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-09a4ddb8-41a5-4677-937b-77b0ef2e5ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:42.152252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a1fba-aa13-43d8-8271-c93898d4b178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:42.153099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a1fba-aa13-43d8-8271-c93898d4b178 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:42.153382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a1fba-aa13-43d8-8271-c93898d4b178 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:42.153667 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a1fba-aa13-43d8-8271-c93898d4b178 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:42.154367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a1fba-aa13-43d8-8271-c93898d4b178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:42.156562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a1fba-aa13-43d8-8271-c93898d4b178 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:42.185105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1077/2150] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:42.187028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7768ae-0255-4dd5-b006-a66275712521 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:42.187760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7768ae-0255-4dd5-b006-a66275712521 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:42.188073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7768ae-0255-4dd5-b006-a66275712521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:42.218514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-de7768ae-0255-4dd5-b006-a66275712521 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:42.219477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-de7768ae-0255-4dd5-b006-a66275712521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:42.227381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1078/2151] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:42.228256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7768ae-0255-4dd5-b006-a66275712521 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:42.229585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-de7768ae-0255-4dd5-b006-a66275712521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:42.269473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1074/2152] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:42 2022] POST /identity/v3/projects => generated 393 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:42.269473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a1fba-aa13-43d8-8271-c93898d4b178 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:42.290572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7768ae-0255-4dd5-b006-a66275712521 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:42.345086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a1fba-aa13-43d8-8271-c93898d4b178 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:42.351932 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe497c3-6291-46ff-9578-3df5bc28121b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:42.353656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe497c3-6291-46ff-9578-3df5bc28121b service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:42.353945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe497c3-6291-46ff-9578-3df5bc28121b service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:42.354256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe497c3-6291-46ff-9578-3df5bc28121b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:42.379049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f92133-1898-405d-b326-60d01b331ca1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5211ed409a3f43d281bca44382aa03fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:42.380034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92133-1898-405d-b326-60d01b331ca1 service glance] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:42.380328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92133-1898-405d-b326-60d01b331ca1 service glance] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:42.380607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f92133-1898-405d-b326-60d01b331ca1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:42.409325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:42.452691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f92133-1898-405d-b326-60d01b331ca1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:42.456065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f92133-1898-405d-b326-60d01b331ca1 service glance] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:42.467409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1079/2153] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:42 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:42.467976 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f92133-1898-405d-b326-60d01b331ca1 service glance] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:42.501837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe497c3-6291-46ff-9578-3df5bc28121b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:42.504541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe497c3-6291-46ff-9578-3df5bc28121b service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:42.519454 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1075/2154] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:42.551696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:42.556622 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f92133-1898-405d-b326-60d01b331ca1 service glance] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:42.562113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5df43b-7826-4eb0-b6da-6b7440f4007a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:42.562835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5df43b-7826-4eb0-b6da-6b7440f4007a admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:42.563126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5df43b-7826-4eb0-b6da-6b7440f4007a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:42.563406 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5df43b-7826-4eb0-b6da-6b7440f4007a admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:42.564170 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5df43b-7826-4eb0-b6da-6b7440f4007a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:42.566111 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5df43b-7826-4eb0-b6da-6b7440f4007a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:42.648385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1080/2155] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:42 2022] POST /identity/v3/users => generated 303 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:42.649653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe497c3-6291-46ff-9578-3df5bc28121b service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:42.660702 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe497c3-6291-46ff-9578-3df5bc28121b service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:42.666291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3db0b-27f8-4cc4-8c42-d0c206e3a483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:42.667099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3db0b-27f8-4cc4-8c42-d0c206e3a483 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:42.667447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3db0b-27f8-4cc4-8c42-d0c206e3a483 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:42.667726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd3db0b-27f8-4cc4-8c42-d0c206e3a483 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:42.668496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3db0b-27f8-4cc4-8c42-d0c206e3a483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:42.670139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd3db0b-27f8-4cc4-8c42-d0c206e3a483 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:42.682717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1076/2156] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:11:42.686791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5df43b-7826-4eb0-b6da-6b7440f4007a admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:42.699829 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5df43b-7826-4eb0-b6da-6b7440f4007a admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:42.707522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2857f684-e492-47cb-927d-b9824661a13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:42.709415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857f684-e492-47cb-927d-b9824661a13d admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:42.709706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857f684-e492-47cb-927d-b9824661a13d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:42.709985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2857f684-e492-47cb-927d-b9824661a13d admin admin] PATH_INFO: `/v3/projects/2c28e87c6c9b477e8030637d5c85302a/users/8386d0021e8546da9eb735d018c71970/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:42.730191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857f684-e492-47cb-927d-b9824661a13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c28e87c6c9b477e8030637d5c85302a, user_id=8386d0021e8546da9eb735d018c71970, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:42.735235 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2857f684-e492-47cb-927d-b9824661a13d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:42.838234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1081/2157] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:42 2022] PUT /identity/v3/projects/2c28e87c6c9b477e8030637d5c85302a/users/8386d0021e8546da9eb735d018c71970/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:42.844634 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3db0b-27f8-4cc4-8c42-d0c206e3a483 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:42.854361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd3db0b-27f8-4cc4-8c42-d0c206e3a483 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:42.893382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06504a80-10f4-4ef2-af2e-7a28a7cb3058 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:42.893687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06504a80-10f4-4ef2-af2e-7a28a7cb3058 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:42.893939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06504a80-10f4-4ef2-af2e-7a28a7cb3058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:42.922147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4c448-8721-46e9-9b5e-ffd75ec1990b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:42.924348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4c448-8721-46e9-9b5e-ffd75ec1990b admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:42.924642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4c448-8721-46e9-9b5e-ffd75ec1990b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:42.924921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d4c448-8721-46e9-9b5e-ffd75ec1990b admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:42.925761 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4c448-8721-46e9-9b5e-ffd75ec1990b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:42.927589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d4c448-8721-46e9-9b5e-ffd75ec1990b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:42.932511 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-06504a80-10f4-4ef2-af2e-7a28a7cb3058 None None] MFA Rules not processed for user `dbb1a907aaee40de9c87dbfe96a6ebd7`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:42.934450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-06504a80-10f4-4ef2-af2e-7a28a7cb3058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:42.943683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1077/2158] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:42 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:11:42.946274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4c448-8721-46e9-9b5e-ffd75ec1990b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:42.970627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d4c448-8721-46e9-9b5e-ffd75ec1990b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:42.978334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8acb13-ba51-4119-ac89-0da647983022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:42.979261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8acb13-ba51-4119-ac89-0da647983022 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:42.979547 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8acb13-ba51-4119-ac89-0da647983022 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:42.979836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8acb13-ba51-4119-ac89-0da647983022 admin admin] PATH_INFO: `/v3/projects/2c28e87c6c9b477e8030637d5c85302a/users/8386d0021e8546da9eb735d018c71970/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:42.982776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8acb13-ba51-4119-ac89-0da647983022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c28e87c6c9b477e8030637d5c85302a, user_id=8386d0021e8546da9eb735d018c71970, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:42.986316 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8acb13-ba51-4119-ac89-0da647983022 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:43.010316 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1078/2159] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:42 2022] PUT /identity/v3/projects/2c28e87c6c9b477e8030637d5c85302a/users/8386d0021e8546da9eb735d018c71970/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:43.012411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e93f6f-cecf-4f2e-8c23-6056770d6407 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:43.012699 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e93f6f-cecf-4f2e-8c23-6056770d6407 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:43.012977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e93f6f-cecf-4f2e-8c23-6056770d6407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:43.024954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1082/2160] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:43.036779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06504a80-10f4-4ef2-af2e-7a28a7cb3058 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:43.038245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-06504a80-10f4-4ef2-af2e-7a28a7cb3058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:43.048171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-29e93f6f-cecf-4f2e-8c23-6056770d6407 None None] MFA Rules not processed for user `8386d0021e8546da9eb735d018c71970`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:43.051438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-29e93f6f-cecf-4f2e-8c23-6056770d6407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:43.100589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06504a80-10f4-4ef2-af2e-7a28a7cb3058 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:43.122276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1079/2161] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:43 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:43.150153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa30839-dc52-4437-8327-e3ebd6ab17b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:43.150954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa30839-dc52-4437-8327-e3ebd6ab17b9 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:43.151241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa30839-dc52-4437-8327-e3ebd6ab17b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:43.151520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa30839-dc52-4437-8327-e3ebd6ab17b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:43.209939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa30839-dc52-4437-8327-e3ebd6ab17b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:43.211764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa30839-dc52-4437-8327-e3ebd6ab17b9 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:43.225896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1083/2162] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:11:43.448441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e93f6f-cecf-4f2e-8c23-6056770d6407 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:43.450601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e93f6f-cecf-4f2e-8c23-6056770d6407 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:43.454253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c38b06-ec3e-4568-8f40-9584c784d2ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:43.454897 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c38b06-ec3e-4568-8f40-9584c784d2ce service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:43.455180 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c38b06-ec3e-4568-8f40-9584c784d2ce service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:43.455455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c38b06-ec3e-4568-8f40-9584c784d2ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:43.467883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c38b06-ec3e-4568-8f40-9584c784d2ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:43.469404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c38b06-ec3e-4568-8f40-9584c784d2ce service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:43.482431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1080/2163] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:43 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:43.583941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:43.632852 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa30839-dc52-4437-8327-e3ebd6ab17b9 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:43.648586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa30839-dc52-4437-8327-e3ebd6ab17b9 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:43.658441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd7e8b-7368-49a0-a96d-9ed823a9c332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:43.658441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd7e8b-7368-49a0-a96d-9ed823a9c332 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:43.658441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd7e8b-7368-49a0-a96d-9ed823a9c332 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:43.658441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd7e8b-7368-49a0-a96d-9ed823a9c332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:43.749050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd7e8b-7368-49a0-a96d-9ed823a9c332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:43.750677 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fd7e8b-7368-49a0-a96d-9ed823a9c332 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:43.760981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1084/2164] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:43 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:44.547752 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c38b06-ec3e-4568-8f40-9584c784d2ce service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:44.558825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c38b06-ec3e-4568-8f40-9584c784d2ce service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:44.563693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d20e6-7a6e-49b6-baee-3c0d21a58511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:44.564573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d20e6-7a6e-49b6-baee-3c0d21a58511 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:44.564863 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d20e6-7a6e-49b6-baee-3c0d21a58511 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:44.565141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149d20e6-7a6e-49b6-baee-3c0d21a58511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:44.567032 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-149d20e6-7a6e-49b6-baee-3c0d21a58511 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:44.676101 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d20e6-7a6e-49b6-baee-3c0d21a58511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:44.677900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149d20e6-7a6e-49b6-baee-3c0d21a58511 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:44.692640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1081/2165] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:45.236299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:45.505852 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff4e58-42a9-4c55-b044-a068aa9c6c47 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:45.506357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff4e58-42a9-4c55-b044-a068aa9c6c47 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:45.506357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccff4e58-42a9-4c55-b044-a068aa9c6c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:45.527185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-ccff4e58-42a9-4c55-b044-a068aa9c6c47 None None] MFA Rules not processed for user `dbb1a907aaee40de9c87dbfe96a6ebd7`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:45.534033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ccff4e58-42a9-4c55-b044-a068aa9c6c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:45.539782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1085/2166] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:46.562957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:46.672255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d20e6-7a6e-49b6-baee-3c0d21a58511 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:46.690283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149d20e6-7a6e-49b6-baee-3c0d21a58511 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:46.697022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d052b-43e0-4440-84a9-ce40cdc1a0e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:46.698848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d052b-43e0-4440-84a9-ce40cdc1a0e8 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:46.699462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d052b-43e0-4440-84a9-ce40cdc1a0e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:46.699934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d052b-43e0-4440-84a9-ce40cdc1a0e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:46.796669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d052b-43e0-4440-84a9-ce40cdc1a0e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:46.798808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d052b-43e0-4440-84a9-ce40cdc1a0e8 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:46.817319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1082/2167] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:46 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:48.871378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:49.875135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67562dd4-8786-4bd4-9e0d-a1b52e78884d None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:49.876064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67562dd4-8786-4bd4-9e0d-a1b52e78884d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:49.880969 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67562dd4-8786-4bd4-9e0d-a1b52e78884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:49.916222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-67562dd4-8786-4bd4-9e0d-a1b52e78884d None None] MFA Rules not processed for user `bdc5ef02c9fd4b2888239b9b19ae4d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:49.917477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-67562dd4-8786-4bd4-9e0d-a1b52e78884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:49.938636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d052b-43e0-4440-84a9-ce40cdc1a0e8 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:50.016981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1086/2168] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:49 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:50.025619 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d052b-43e0-4440-84a9-ce40cdc1a0e8 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:50.025619 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:50.025935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:50.026335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:50.026620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] PATH_INFO: `/v3/users/c3f93d42665d4d3cb0076fd06ea7c45d` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:50.027855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f93d42665d4d3cb0076fd06ea7c45d)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:50.029808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:50.037082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67562dd4-8786-4bd4-9e0d-a1b52e78884d None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:50.038451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-67562dd4-8786-4bd4-9e0d-a1b52e78884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:50.114379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67562dd4-8786-4bd4-9e0d-a1b52e78884d None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:50.120798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b8048-04f4-40b0-bc92-9f941a724547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:50.121463 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b8048-04f4-40b0-bc92-9f941a724547 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:50.121737 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b8048-04f4-40b0-bc92-9f941a724547 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:50.122959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b8048-04f4-40b0-bc92-9f941a724547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:50.131271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b8048-04f4-40b0-bc92-9f941a724547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:50.133073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b8048-04f4-40b0-bc92-9f941a724547 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:50.143268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1087/2169] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:11:50.389817 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f93d42665d4d3cb0076fd06ea7c45d'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:50.390452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f93d42665d4d3cb0076fd06ea7c45d'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:50.394229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f93d42665d4d3cb0076fd06ea7c45d'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:50.482939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f93d42665d4d3cb0076fd06ea7c45d'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:50.493838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f93d42665d4d3cb0076fd06ea7c45d'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:50.494970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:50.515374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1083/2170] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:49 2022] DELETE /identity/v3/users/c3f93d42665d4d3cb0076fd06ea7c45d => generated 0 bytes in 577 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:11:50.519861 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a626a-2cd9-4c6d-8020-025afccec37d None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:50.520166 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a626a-2cd9-4c6d-8020-025afccec37d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:50.520466 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a626a-2cd9-4c6d-8020-025afccec37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:50.545098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-442a626a-2cd9-4c6d-8020-025afccec37d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:50.545098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-442a626a-2cd9-4c6d-8020-025afccec37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:50.659306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1088/2171] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:50.670441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:50.670441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:50.760548 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce3861-226b-47e5-8e54-df8d99b28b41 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:50.769968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dd1a1-9151-4c22-9c67-db52cc8f8cc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:50.771076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dd1a1-9151-4c22-9c67-db52cc8f8cc2 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:50.771648 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dd1a1-9151-4c22-9c67-db52cc8f8cc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:50.772894 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751dd1a1-9151-4c22-9c67-db52cc8f8cc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:50.798340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dd1a1-9151-4c22-9c67-db52cc8f8cc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:50.798340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751dd1a1-9151-4c22-9c67-db52cc8f8cc2 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:50.820612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1084/2172] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:51.718760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a626a-2cd9-4c6d-8020-025afccec37d None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:51.720295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-442a626a-2cd9-4c6d-8020-025afccec37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:51.733236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a626a-2cd9-4c6d-8020-025afccec37d None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:51.738347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:51.739244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:51.739532 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:51.739950 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] PATH_INFO: `/v3/projects/4a01091817c548febfd754a5e676a02c` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:51.741308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a01091817c548febfd754a5e676a02c)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:51.743933 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:51.934552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a01091817c548febfd754a5e676a02c', 'request_id': 'req-4f7f683c-cecf-4c08-b774-57efbb17c998'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:51.945932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a01091817c548febfd754a5e676a02c', 'request_id': 'req-4f7f683c-cecf-4c08-b774-57efbb17c998'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:51.954700 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a01091817c548febfd754a5e676a02c', 'request_id': 'req-4f7f683c-cecf-4c08-b774-57efbb17c998'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:52.054127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] The token cache is being invalidate because project 4a01091817c548febfd754a5e676a02c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:52.054422 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:52.055266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:52.057447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1089/2173] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:51 2022] DELETE /identity/v3/projects/4a01091817c548febfd754a5e676a02c => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:52.061524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dd1a1-9151-4c22-9c67-db52cc8f8cc2 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:52.073893 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751dd1a1-9151-4c22-9c67-db52cc8f8cc2 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:52.204134 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7925225-567f-42cf-b662-a00bd4e0cac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:52.205345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7925225-567f-42cf-b662-a00bd4e0cac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:52.206164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7925225-567f-42cf-b662-a00bd4e0cac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:52.206980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7925225-567f-42cf-b662-a00bd4e0cac5 admin admin] PATH_INFO: `/v3/users/8386d0021e8546da9eb735d018c71970` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:52.211351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7925225-567f-42cf-b662-a00bd4e0cac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8386d0021e8546da9eb735d018c71970)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:52.219067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7925225-567f-42cf-b662-a00bd4e0cac5 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:52.498845 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f7925225-567f-42cf-b662-a00bd4e0cac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8386d0021e8546da9eb735d018c71970'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:52.500017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f7925225-567f-42cf-b662-a00bd4e0cac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8386d0021e8546da9eb735d018c71970'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:52.500828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f7925225-567f-42cf-b662-a00bd4e0cac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8386d0021e8546da9eb735d018c71970'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:52.579856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f7925225-567f-42cf-b662-a00bd4e0cac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8386d0021e8546da9eb735d018c71970'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:52.608268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f7925225-567f-42cf-b662-a00bd4e0cac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8386d0021e8546da9eb735d018c71970'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:52.653003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1085/2174] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:52 2022] DELETE /identity/v3/users/8386d0021e8546da9eb735d018c71970 => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:52.753538 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:52.933053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:52.936113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:52.952573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7f683c-cecf-4c08-b774-57efbb17c998 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:53.102093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:53.103323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:53.103796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:53.104585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] PATH_INFO: `/v3/users/66b03571917344ed86b57bc3f2795f6a` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:53.108486 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66b03571917344ed86b57bc3f2795f6a)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:53.111170 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:53.335251 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66b03571917344ed86b57bc3f2795f6a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:53.351328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66b03571917344ed86b57bc3f2795f6a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:53.352811 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66b03571917344ed86b57bc3f2795f6a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:53.353877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66b03571917344ed86b57bc3f2795f6a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:53.499371 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66b03571917344ed86b57bc3f2795f6a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:53.520038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1090/2175] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:52 2022] DELETE /identity/v3/users/66b03571917344ed86b57bc3f2795f6a => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:53.523311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e4b19-2aff-40c6-9e79-b9fd5e03bc8e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:53.523960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e4b19-2aff-40c6-9e79-b9fd5e03bc8e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:53.524696 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e4b19-2aff-40c6-9e79-b9fd5e03bc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:53.543874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-c08e4b19-2aff-40c6-9e79-b9fd5e03bc8e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:53.566364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c08e4b19-2aff-40c6-9e79-b9fd5e03bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:53.720382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1086/2176] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:53.734893 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:53.737035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:53.838152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:53.843824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca34fa35-1451-401c-9d0f-0e5d20c5ab93 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:53.853385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d0bea2-c8c1-4cbd-83ab-1dfce9c6ac7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:53.853385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0bea2-c8c1-4cbd-83ab-1dfce9c6ac7f service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:53.853385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0bea2-c8c1-4cbd-83ab-1dfce9c6ac7f service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:53.853385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d0bea2-c8c1-4cbd-83ab-1dfce9c6ac7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:53.869039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0bea2-c8c1-4cbd-83ab-1dfce9c6ac7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:53.870605 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d0bea2-c8c1-4cbd-83ab-1dfce9c6ac7f service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:53.884405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1091/2177] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:11:53.916781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e4b19-2aff-40c6-9e79-b9fd5e03bc8e None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:53.918304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c08e4b19-2aff-40c6-9e79-b9fd5e03bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:53.967470 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e4b19-2aff-40c6-9e79-b9fd5e03bc8e None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:53.980407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c6ac70-f8dc-44bd-a568-0c11dd858637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:53.981564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ac70-f8dc-44bd-a568-0c11dd858637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:53.981836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ac70-f8dc-44bd-a568-0c11dd858637 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:53.982146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c6ac70-f8dc-44bd-a568-0c11dd858637 admin admin] PATH_INFO: `/v3/projects/2c28e87c6c9b477e8030637d5c85302a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:53.988282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6ac70-f8dc-44bd-a568-0c11dd858637 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c28e87c6c9b477e8030637d5c85302a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:53.996635 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c6ac70-f8dc-44bd-a568-0c11dd858637 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:54.192061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d5c6ac70-f8dc-44bd-a568-0c11dd858637 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c28e87c6c9b477e8030637d5c85302a', 'request_id': 'req-d5c6ac70-f8dc-44bd-a568-0c11dd858637'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:54.200006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d5c6ac70-f8dc-44bd-a568-0c11dd858637 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c28e87c6c9b477e8030637d5c85302a', 'request_id': 'req-d5c6ac70-f8dc-44bd-a568-0c11dd858637'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:54.208018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d5c6ac70-f8dc-44bd-a568-0c11dd858637 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c28e87c6c9b477e8030637d5c85302a', 'request_id': 'req-d5c6ac70-f8dc-44bd-a568-0c11dd858637'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:54.386542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d5c6ac70-f8dc-44bd-a568-0c11dd858637 admin admin] The token cache is being invalidate because project 2c28e87c6c9b477e8030637d5c85302a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:54.387194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d5c6ac70-f8dc-44bd-a568-0c11dd858637 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:54.388307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d5c6ac70-f8dc-44bd-a568-0c11dd858637 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:54.390725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1087/2178] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:53 2022] DELETE /identity/v3/projects/2c28e87c6c9b477e8030637d5c85302a => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:54.396705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681ac41-2136-4551-9bab-9a4932f68c55 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:54.397260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681ac41-2136-4551-9bab-9a4932f68c55 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:54.398041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681ac41-2136-4551-9bab-9a4932f68c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:54.419229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3681ac41-2136-4551-9bab-9a4932f68c55 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:54.420510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3681ac41-2136-4551-9bab-9a4932f68c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:54.551524 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1092/2179] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:11:54.564821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc845-3bd3-4f7b-840e-e87a6aa49ff7 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:54.566197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc845-3bd3-4f7b-840e-e87a6aa49ff7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:54.567065 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84dc845-3bd3-4f7b-840e-e87a6aa49ff7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:54.636076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-e84dc845-3bd3-4f7b-840e-e87a6aa49ff7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:54.637324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e84dc845-3bd3-4f7b-840e-e87a6aa49ff7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:54.647037 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1088/2180] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:54.657531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681ac41-2136-4551-9bab-9a4932f68c55 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:54.670424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681ac41-2136-4551-9bab-9a4932f68c55 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:54.675609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fedf8c-0da0-48b7-b26f-33b4a88d468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:54.676649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fedf8c-0da0-48b7-b26f-33b4a88d468a admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:54.676933 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fedf8c-0da0-48b7-b26f-33b4a88d468a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:54.677388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fedf8c-0da0-48b7-b26f-33b4a88d468a admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:54.678119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fedf8c-0da0-48b7-b26f-33b4a88d468a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:11:54.678528 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fedf8c-0da0-48b7-b26f-33b4a88d468a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:54.680843 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fedf8c-0da0-48b7-b26f-33b4a88d468a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:54.708557 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1093/2181] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:11:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:11:54.709730 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dc845-3bd3-4f7b-840e-e87a6aa49ff7 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:54.720357 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84dc845-3bd3-4f7b-840e-e87a6aa49ff7 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:54.732507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333c01e-b57e-4d76-9bc9-595213030e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:54.733434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333c01e-b57e-4d76-9bc9-595213030e3f admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:54.733708 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333c01e-b57e-4d76-9bc9-595213030e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:54.733989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4333c01e-b57e-4d76-9bc9-595213030e3f admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:54.734700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333c01e-b57e-4d76-9bc9-595213030e3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:54.737071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4333c01e-b57e-4d76-9bc9-595213030e3f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:54.777406 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ced180-bc4e-4daf-ab53-b8f394fd9208 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:54.777777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ced180-bc4e-4daf-ab53-b8f394fd9208 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:54.778128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ced180-bc4e-4daf-ab53-b8f394fd9208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:54.798211 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-e5ced180-bc4e-4daf-ab53-b8f394fd9208 None None] MFA Rules not processed for user `bdc5ef02c9fd4b2888239b9b19ae4d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:54.800077 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e5ced180-bc4e-4daf-ab53-b8f394fd9208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:54.876352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1094/2182] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:54.877751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ced180-bc4e-4daf-ab53-b8f394fd9208 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:54.881593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e5ced180-bc4e-4daf-ab53-b8f394fd9208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:54.887549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1089/2183] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:54 2022] POST /identity/v3/projects => generated 365 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:11:54.892439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333c01e-b57e-4d76-9bc9-595213030e3f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:54.910670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ced180-bc4e-4daf-ab53-b8f394fd9208 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:54.985953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4333c01e-b57e-4d76-9bc9-595213030e3f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:54.989138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:54.990113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:54.990471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:54.990808 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] PATH_INFO: `/v3/projects/b40b776d9da2486cb20dabb01e13bca0` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:54.991873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fa0e0-c3e3-429f-9880-15d8ecb90d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:54.992180 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] RBAC: Authorizing `identity:delete_project(project_id=b40b776d9da2486cb20dabb01e13bca0)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:54.992673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fa0e0-c3e3-429f-9880-15d8ecb90d3d admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:54.992996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fa0e0-c3e3-429f-9880-15d8ecb90d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:54.993277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007fa0e0-c3e3-429f-9880-15d8ecb90d3d admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:54.994407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fa0e0-c3e3-429f-9880-15d8ecb90d3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:54.994565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:54.997820 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007fa0e0-c3e3-429f-9880-15d8ecb90d3d admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:55.190866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1090/2184] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:54 2022] POST /identity/v3/users => generated 283 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:55.198198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fa0e0-c3e3-429f-9880-15d8ecb90d3d admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:55.209164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007fa0e0-c3e3-429f-9880-15d8ecb90d3d admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:55.213919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4866a6-c093-4a1d-a24c-7c7125fbef5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:55.214589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4866a6-c093-4a1d-a24c-7c7125fbef5f admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:55.214870 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4866a6-c093-4a1d-a24c-7c7125fbef5f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:55.215146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4866a6-c093-4a1d-a24c-7c7125fbef5f admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:55.215910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4866a6-c093-4a1d-a24c-7c7125fbef5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:55.217518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4866a6-c093-4a1d-a24c-7c7125fbef5f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:55.230562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1091/2185] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:11:55.234469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4866a6-c093-4a1d-a24c-7c7125fbef5f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:55.249436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4866a6-c093-4a1d-a24c-7c7125fbef5f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:55.251082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b40b776d9da2486cb20dabb01e13bca0', 'request_id': 'req-a72091fb-d044-4054-9394-6ca4fb51fbce'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:55.261204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b40b776d9da2486cb20dabb01e13bca0', 'request_id': 'req-a72091fb-d044-4054-9394-6ca4fb51fbce'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:55.278906 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b40b776d9da2486cb20dabb01e13bca0', 'request_id': 'req-a72091fb-d044-4054-9394-6ca4fb51fbce'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:55.325462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400b8c7-b653-46fb-a981-632991ec7f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:55.326243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400b8c7-b653-46fb-a981-632991ec7f12 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:55.326536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400b8c7-b653-46fb-a981-632991ec7f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:55.326811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4400b8c7-b653-46fb-a981-632991ec7f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:55.327553 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400b8c7-b653-46fb-a981-632991ec7f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:55.329217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4400b8c7-b653-46fb-a981-632991ec7f12 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:55.344056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1092/2186] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:55.345045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400b8c7-b653-46fb-a981-632991ec7f12 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:55.355596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4400b8c7-b653-46fb-a981-632991ec7f12 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:55.360596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168d2750-6150-4f1f-bce8-1da1a5cabe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:55.361576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d2750-6150-4f1f-bce8-1da1a5cabe7e admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:55.361923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d2750-6150-4f1f-bce8-1da1a5cabe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:55.362392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168d2750-6150-4f1f-bce8-1da1a5cabe7e admin admin] PATH_INFO: `/v3/projects/a1b2ee26e1e84489a1eb6a2f8b78d06f/users/0c408dd32b304de390266688501e6dcb/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:55.379623 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d2750-6150-4f1f-bce8-1da1a5cabe7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b2ee26e1e84489a1eb6a2f8b78d06f, user_id=0c408dd32b304de390266688501e6dcb, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:55.383440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168d2750-6150-4f1f-bce8-1da1a5cabe7e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:55.417448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] The token cache is being invalidate because project b40b776d9da2486cb20dabb01e13bca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:55.417448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:55.417448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:55.417448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1095/2187] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:54 2022] DELETE /identity/v3/projects/b40b776d9da2486cb20dabb01e13bca0 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:55.420763 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:55.422820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:55.438859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72091fb-d044-4054-9394-6ca4fb51fbce admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:55.444509 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:55.445727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:55.446884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:55.447229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] PATH_INFO: `/v3/users/0a8f12877ca949d0a2419bccddc2edb0` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:55.448684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a8f12877ca949d0a2419bccddc2edb0)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:55.450918 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:55.554075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1093/2188] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:55 2022] PUT /identity/v3/projects/a1b2ee26e1e84489a1eb6a2f8b78d06f/users/0c408dd32b304de390266688501e6dcb/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:55.565651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d1b6e-9988-4c03-ba25-1194645535dd None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:55.566500 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d1b6e-9988-4c03-ba25-1194645535dd None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:55.566500 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d1b6e-9988-4c03-ba25-1194645535dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:55.594350 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-bb5d1b6e-9988-4c03-ba25-1194645535dd None None] MFA Rules not processed for user `0c408dd32b304de390266688501e6dcb`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:55.595676 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-bb5d1b6e-9988-4c03-ba25-1194645535dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:55.664027 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1094/2189] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:55.668951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d1b6e-9988-4c03-ba25-1194645535dd None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:55.670247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-bb5d1b6e-9988-4c03-ba25-1194645535dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:55.740871 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5d1b6e-9988-4c03-ba25-1194645535dd None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:55.746167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debab7d9-e1ae-4213-8a80-57f7cc6f82c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:55.746835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debab7d9-e1ae-4213-8a80-57f7cc6f82c3 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:55.747122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debab7d9-e1ae-4213-8a80-57f7cc6f82c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:55.747408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debab7d9-e1ae-4213-8a80-57f7cc6f82c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:55.748161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debab7d9-e1ae-4213-8a80-57f7cc6f82c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:55.750186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debab7d9-e1ae-4213-8a80-57f7cc6f82c3 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:55.815845 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a8f12877ca949d0a2419bccddc2edb0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:55.827660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a8f12877ca949d0a2419bccddc2edb0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:55.828371 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a8f12877ca949d0a2419bccddc2edb0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:55.829107 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a8f12877ca949d0a2419bccddc2edb0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:55.926134 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1095/2190] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:11:55 2022] POST /identity/v3/projects => generated 365 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:11:55.929870 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debab7d9-e1ae-4213-8a80-57f7cc6f82c3 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:55.931846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-debab7d9-e1ae-4213-8a80-57f7cc6f82c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:55.944511 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a8f12877ca949d0a2419bccddc2edb0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:55.974624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1096/2191] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:55 2022] DELETE /identity/v3/users/0a8f12877ca949d0a2419bccddc2edb0 => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:11:56.044864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debab7d9-e1ae-4213-8a80-57f7cc6f82c3 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:56.117773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f199fd2-9d4d-4e66-8586-9dd7252ae7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:56.118611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f199fd2-9d4d-4e66-8586-9dd7252ae7db admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:56.121950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f199fd2-9d4d-4e66-8586-9dd7252ae7db admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:56.121950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f199fd2-9d4d-4e66-8586-9dd7252ae7db admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:56.121950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f199fd2-9d4d-4e66-8586-9dd7252ae7db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:56.121950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f199fd2-9d4d-4e66-8586-9dd7252ae7db admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:56.311638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1096/2192] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:11:55 2022] POST /identity/v3/users => generated 289 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:11:56.314241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:56.326177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceb6cb-3485-45b9-bc44-fb051b51bb41 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:56.331650 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1dd94-5aa7-4c41-97a6-c390fce5e527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:56.332541 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1dd94-5aa7-4c41-97a6-c390fce5e527 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:56.332836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1dd94-5aa7-4c41-97a6-c390fce5e527 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:56.333294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb1dd94-5aa7-4c41-97a6-c390fce5e527 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:56.334042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1dd94-5aa7-4c41-97a6-c390fce5e527 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:56.335699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb1dd94-5aa7-4c41-97a6-c390fce5e527 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:56.346520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1097/2193] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:11:56.350727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f199fd2-9d4d-4e66-8586-9dd7252ae7db admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:56.361043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f199fd2-9d4d-4e66-8586-9dd7252ae7db admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:56.366884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa6ace-61fe-4802-b09c-f5c6102bf4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:56.367907 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa6ace-61fe-4802-b09c-f5c6102bf4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:56.368379 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa6ace-61fe-4802-b09c-f5c6102bf4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:56.368664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa6ace-61fe-4802-b09c-f5c6102bf4e2 admin admin] PATH_INFO: `/v3/projects/fb3a4eb1e4304d0e88e432903220cc8b/users/c0219aaa3ca8476590e051a92218a136/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:56.386769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa6ace-61fe-4802-b09c-f5c6102bf4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3a4eb1e4304d0e88e432903220cc8b, user_id=c0219aaa3ca8476590e051a92218a136, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:56.389557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa6ace-61fe-4802-b09c-f5c6102bf4e2 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:56.467100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1dd94-5aa7-4c41-97a6-c390fce5e527 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:56.469298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3cb1dd94-5aa7-4c41-97a6-c390fce5e527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:56.482916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb1dd94-5aa7-4c41-97a6-c390fce5e527 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:56.495717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:56.496044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:56.496297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:56.497840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1097/2194] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:56 2022] PUT /identity/v3/projects/fb3a4eb1e4304d0e88e432903220cc8b/users/c0219aaa3ca8476590e051a92218a136/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:56.500874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] PATH_INFO: `/v3/projects/d2f25b1e72964708bbc672ef81c6db02` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:56.502184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2f25b1e72964708bbc672ef81c6db02)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:56.502707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa6ace-61fe-4802-b09c-f5c6102bf4e2 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:56.504937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:56.581220 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa6ace-61fe-4802-b09c-f5c6102bf4e2 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:56.604538 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb95613-51ab-4ebc-b7c2-bd2af942e5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:56.604538 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb95613-51ab-4ebc-b7c2-bd2af942e5da admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:56.604538 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb95613-51ab-4ebc-b7c2-bd2af942e5da admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:56.604538 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb95613-51ab-4ebc-b7c2-bd2af942e5da admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:56.606815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb95613-51ab-4ebc-b7c2-bd2af942e5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:56.606815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb95613-51ab-4ebc-b7c2-bd2af942e5da admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:56.606815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1098/2195] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:11:56 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:11:56.609567 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb95613-51ab-4ebc-b7c2-bd2af942e5da admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:56.621063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb95613-51ab-4ebc-b7c2-bd2af942e5da admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:56.626639 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1b7cc2-b3a8-4bd3-b3be-d08070ac6a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:56.627797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b7cc2-b3a8-4bd3-b3be-d08070ac6a7f admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:56.628298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b7cc2-b3a8-4bd3-b3be-d08070ac6a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:56.628703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1b7cc2-b3a8-4bd3-b3be-d08070ac6a7f admin admin] PATH_INFO: `/v3/projects/fb3a4eb1e4304d0e88e432903220cc8b/users/c0219aaa3ca8476590e051a92218a136/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:56.631936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b7cc2-b3a8-4bd3-b3be-d08070ac6a7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3a4eb1e4304d0e88e432903220cc8b, user_id=c0219aaa3ca8476590e051a92218a136, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:56.635893 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1b7cc2-b3a8-4bd3-b3be-d08070ac6a7f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:56.651263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1099/2196] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:11:56 2022] PUT /identity/v3/projects/fb3a4eb1e4304d0e88e432903220cc8b/users/c0219aaa3ca8476590e051a92218a136/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:11:56.661638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2d31a-4c6f-4863-943c-627a79b0ee71 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:56.661932 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2d31a-4c6f-4863-943c-627a79b0ee71 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:56.662218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2d31a-4c6f-4863-943c-627a79b0ee71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:56.750182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0fc2d31a-4c6f-4863-943c-627a79b0ee71 None None] MFA Rules not processed for user `c0219aaa3ca8476590e051a92218a136`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:11:56.750182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0fc2d31a-4c6f-4863-943c-627a79b0ee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:56.762733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1100/2197] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:11:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:11:56.774828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2d31a-4c6f-4863-943c-627a79b0ee71 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:56.776821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0fc2d31a-4c6f-4863-943c-627a79b0ee71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:56.834656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2d31a-4c6f-4863-943c-627a79b0ee71 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:56.838499 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148ed19-ab02-4495-9072-5ba57d8c3b92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:56.839147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148ed19-ab02-4495-9072-5ba57d8c3b92 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:56.839429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148ed19-ab02-4495-9072-5ba57d8c3b92 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:56.839702 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7148ed19-ab02-4495-9072-5ba57d8c3b92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:56.849128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148ed19-ab02-4495-9072-5ba57d8c3b92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:56.850587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7148ed19-ab02-4495-9072-5ba57d8c3b92 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:56.862589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1101/2198] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:11:56.927822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2f25b1e72964708bbc672ef81c6db02', 'request_id': 'req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:56.927822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2f25b1e72964708bbc672ef81c6db02', 'request_id': 'req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:56.927822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2f25b1e72964708bbc672ef81c6db02', 'request_id': 'req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:57.236555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:11:57.249820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] The token cache is being invalidate because project d2f25b1e72964708bbc672ef81c6db02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:57.249820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:57.249820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:57.249820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1098/2199] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:56 2022] DELETE /identity/v3/projects/d2f25b1e72964708bbc672ef81c6db02 => generated 0 bytes in 782 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:57.255750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148ed19-ab02-4495-9072-5ba57d8c3b92 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:57.328882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7148ed19-ab02-4495-9072-5ba57d8c3b92 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:57.384383 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:57.385261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:57.385531 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:57.385805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] PATH_INFO: `/v3/users/a8a9a157c4a54f378a2436b4cd7e8782` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:57.386998 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a9a157c4a54f378a2436b4cd7e8782)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:57.389053 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:57.447084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:57.448790 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:57.507789 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e3a73d-7ab6-42a2-8870-e1c58b7bb743 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:57.511391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda88d4-405a-486f-bc53-3667d6d5dc77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:57.512062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda88d4-405a-486f-bc53-3667d6d5dc77 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:57.512349 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda88d4-405a-486f-bc53-3667d6d5dc77 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:57.512626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda88d4-405a-486f-bc53-3667d6d5dc77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:57.514437 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5eda88d4-405a-486f-bc53-3667d6d5dc77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:57.575908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda88d4-405a-486f-bc53-3667d6d5dc77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:57.581867 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda88d4-405a-486f-bc53-3667d6d5dc77 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:57.595392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1099/2200] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:11:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:11:57.668757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a9a157c4a54f378a2436b4cd7e8782'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:57.669717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a9a157c4a54f378a2436b4cd7e8782'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:57.670397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a9a157c4a54f378a2436b4cd7e8782'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:57.761835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a9a157c4a54f378a2436b4cd7e8782'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:57.769941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a9a157c4a54f378a2436b4cd7e8782'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:57.796495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1102/2201] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:11:57 2022] DELETE /identity/v3/users/a8a9a157c4a54f378a2436b4cd7e8782 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:58.463725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda88d4-405a-486f-bc53-3667d6d5dc77 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:11:58.465448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5eda88d4-405a-486f-bc53-3667d6d5dc77 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:11:58.481668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda88d4-405a-486f-bc53-3667d6d5dc77 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:11:58.568332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:11:58.568332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:11:58.568332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:11:58.568332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e admin admin] PATH_INFO: `/v3/projects/6ffd09ac271b4279bd78f199bbe87dc1` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:11:58.569237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ffd09ac271b4279bd78f199bbe87dc1)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:11:58.569237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:11:58.753337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ffd09ac271b4279bd78f199bbe87dc1', 'request_id': 'req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:58.759104 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ffd09ac271b4279bd78f199bbe87dc1', 'request_id': 'req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:58.765786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ffd09ac271b4279bd78f199bbe87dc1', 'request_id': 'req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:58.877223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e admin admin] The token cache is being invalidate because project 6ffd09ac271b4279bd78f199bbe87dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:11:58.882448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:58.882448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-7fa4189e-c68d-4a5b-8ae0-37aa2323b04e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:11:58.882448 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1100/2202] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:11:58 2022] DELETE /identity/v3/projects/6ffd09ac271b4279bd78f199bbe87dc1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:11:59.105786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:02.350598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:03.916694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:04.910641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:04.912105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:04.925280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d998be-7bb1-414b-8bfa-fc42a6e6ad3d admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:04.983320 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:04.984218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:04.984450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:04.984779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] PATH_INFO: `/v3/users/0c408dd32b304de390266688501e6dcb` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:04.985968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c408dd32b304de390266688501e6dcb)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:04.988203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:05.196035 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c408dd32b304de390266688501e6dcb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:05.196765 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c408dd32b304de390266688501e6dcb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:05.197399 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c408dd32b304de390266688501e6dcb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:05.270508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c408dd32b304de390266688501e6dcb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:05.280962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c408dd32b304de390266688501e6dcb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:05.317310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1103/2203] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:12:04 2022] DELETE /identity/v3/users/0c408dd32b304de390266688501e6dcb => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:12:05.318780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5acca9-2948-4f79-ba0c-ffb8226f3b39 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:05.319258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5acca9-2948-4f79-ba0c-ffb8226f3b39 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:05.319336 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5acca9-2948-4f79-ba0c-ffb8226f3b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:05.340745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-9d5acca9-2948-4f79-ba0c-ffb8226f3b39 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:05.342456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-9d5acca9-2948-4f79-ba0c-ffb8226f3b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:05.426096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1101/2204] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:05.437876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:05.442571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:05.594291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc1a047-5cb0-4c55-91c7-d3c2e9a8cb13 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:05.594291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e7547-1d80-46a0-b3fc-9d8adcf2280b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:05.594558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e7547-1d80-46a0-b3fc-9d8adcf2280b service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:05.594848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e7547-1d80-46a0-b3fc-9d8adcf2280b service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:05.595132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45e7547-1d80-46a0-b3fc-9d8adcf2280b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:05.606762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e7547-1d80-46a0-b3fc-9d8adcf2280b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:05.608293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45e7547-1d80-46a0-b3fc-9d8adcf2280b service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:05.626467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1104/2205] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:12:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:12:05.933459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:06.141606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5acca9-2948-4f79-ba0c-ffb8226f3b39 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:06.143552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-9d5acca9-2948-4f79-ba0c-ffb8226f3b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:06.166057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5acca9-2948-4f79-ba0c-ffb8226f3b39 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:06.179035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:06.179035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:06.179035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:06.179035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] PATH_INFO: `/v3/projects/a1b2ee26e1e84489a1eb6a2f8b78d06f` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:06.180513 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b2ee26e1e84489a1eb6a2f8b78d06f)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:06.183133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:06.430135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b2ee26e1e84489a1eb6a2f8b78d06f', 'request_id': 'req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:06.436284 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b2ee26e1e84489a1eb6a2f8b78d06f', 'request_id': 'req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:06.442512 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b2ee26e1e84489a1eb6a2f8b78d06f', 'request_id': 'req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:06.603409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] The token cache is being invalidate because project a1b2ee26e1e84489a1eb6a2f8b78d06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:12:06.603734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:06.604485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:06.606374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1102/2206] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:12:06 2022] DELETE /identity/v3/projects/a1b2ee26e1e84489a1eb6a2f8b78d06f => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:12:06.610698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e7547-1d80-46a0-b3fc-9d8adcf2280b service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:06.621513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45e7547-1d80-46a0-b3fc-9d8adcf2280b service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:06.694681 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97d34d0-fe33-4783-ab58-c2b1dc478b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:06.695918 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d34d0-fe33-4783-ab58-c2b1dc478b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:06.696204 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d34d0-fe33-4783-ab58-c2b1dc478b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:06.696485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97d34d0-fe33-4783-ab58-c2b1dc478b98 admin admin] PATH_INFO: `/v3/users/c0219aaa3ca8476590e051a92218a136` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:06.698254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d34d0-fe33-4783-ab58-c2b1dc478b98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0219aaa3ca8476590e051a92218a136)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:06.700486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97d34d0-fe33-4783-ab58-c2b1dc478b98 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:06.946568 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c97d34d0-fe33-4783-ab58-c2b1dc478b98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0219aaa3ca8476590e051a92218a136'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:06.947256 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c97d34d0-fe33-4783-ab58-c2b1dc478b98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0219aaa3ca8476590e051a92218a136'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:06.947906 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c97d34d0-fe33-4783-ab58-c2b1dc478b98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0219aaa3ca8476590e051a92218a136'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:07.029615 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c97d34d0-fe33-4783-ab58-c2b1dc478b98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0219aaa3ca8476590e051a92218a136'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:07.037307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c97d34d0-fe33-4783-ab58-c2b1dc478b98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0219aaa3ca8476590e051a92218a136'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:07.055531 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1105/2207] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:12:06 2022] DELETE /identity/v3/users/c0219aaa3ca8476590e051a92218a136 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:12:07.412773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:07.540702 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:07.542786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:07.563707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74dd8c2f-1aa4-4986-ab75-8b7fa1d6be42 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:07.630378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954838ec-6186-41c7-9826-793ded07aa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:07.631422 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954838ec-6186-41c7-9826-793ded07aa94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:07.631880 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954838ec-6186-41c7-9826-793ded07aa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:07.632339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954838ec-6186-41c7-9826-793ded07aa94 admin admin] PATH_INFO: `/v3/projects/fb3a4eb1e4304d0e88e432903220cc8b` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:07.633705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954838ec-6186-41c7-9826-793ded07aa94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3a4eb1e4304d0e88e432903220cc8b)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:07.636562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954838ec-6186-41c7-9826-793ded07aa94 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:07.788142 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-954838ec-6186-41c7-9826-793ded07aa94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3a4eb1e4304d0e88e432903220cc8b', 'request_id': 'req-954838ec-6186-41c7-9826-793ded07aa94'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:07.816068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-954838ec-6186-41c7-9826-793ded07aa94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3a4eb1e4304d0e88e432903220cc8b', 'request_id': 'req-954838ec-6186-41c7-9826-793ded07aa94'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:07.823964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-954838ec-6186-41c7-9826-793ded07aa94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3a4eb1e4304d0e88e432903220cc8b', 'request_id': 'req-954838ec-6186-41c7-9826-793ded07aa94'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:07.925773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-954838ec-6186-41c7-9826-793ded07aa94 admin admin] The token cache is being invalidate because project fb3a4eb1e4304d0e88e432903220cc8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:12:07.925773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-954838ec-6186-41c7-9826-793ded07aa94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:07.925773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-954838ec-6186-41c7-9826-793ded07aa94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:07.925773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1103/2208] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:12:07 2022] DELETE /identity/v3/projects/fb3a4eb1e4304d0e88e432903220cc8b => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:12:07.929643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a92601-e14a-448a-8feb-768418815d66 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:07.929952 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a92601-e14a-448a-8feb-768418815d66 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:07.930225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a92601-e14a-448a-8feb-768418815d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:07.958630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-33a92601-e14a-448a-8feb-768418815d66 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:07.960139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-33a92601-e14a-448a-8feb-768418815d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:08.021476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1106/2209] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:12:08.030161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05180b06-d000-456f-9f38-ab363057fb39 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:08.030452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05180b06-d000-456f-9f38-ab363057fb39 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:08.030733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05180b06-d000-456f-9f38-ab363057fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:08.049793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-05180b06-d000-456f-9f38-ab363057fb39 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:08.052015 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-05180b06-d000-456f-9f38-ab363057fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:08.059377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1104/2210] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:08.063839 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a92601-e14a-448a-8feb-768418815d66 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:08.074696 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a92601-e14a-448a-8feb-768418815d66 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:08.079718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04532371-bab0-450f-8d68-efa7a8b6b0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:08.080674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04532371-bab0-450f-8d68-efa7a8b6b0ac admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:08.081542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04532371-bab0-450f-8d68-efa7a8b6b0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:08.081542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04532371-bab0-450f-8d68-efa7a8b6b0ac admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:08.081976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04532371-bab0-450f-8d68-efa7a8b6b0ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:12:08.082284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04532371-bab0-450f-8d68-efa7a8b6b0ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:08.083948 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04532371-bab0-450f-8d68-efa7a8b6b0ac admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:08.098113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1107/2211] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:12:08.102753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05180b06-d000-456f-9f38-ab363057fb39 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:08.112773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05180b06-d000-456f-9f38-ab363057fb39 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:08.117468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4417262-0c33-4c93-908a-8a4ec080da1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:08.118125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4417262-0c33-4c93-908a-8a4ec080da1e admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:08.118406 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4417262-0c33-4c93-908a-8a4ec080da1e admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:08.118684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4417262-0c33-4c93-908a-8a4ec080da1e admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:08.119400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4417262-0c33-4c93-908a-8a4ec080da1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:08.121377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4417262-0c33-4c93-908a-8a4ec080da1e admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:08.243465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1105/2212] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:12:08 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:12:08.247459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04532371-bab0-450f-8d68-efa7a8b6b0ac admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:08.257904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04532371-bab0-450f-8d68-efa7a8b6b0ac admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:08.340121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bf2c1-4b84-4511-afde-45af16993397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:08.340923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bf2c1-4b84-4511-afde-45af16993397 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:08.341515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bf2c1-4b84-4511-afde-45af16993397 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:08.341901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21bf2c1-4b84-4511-afde-45af16993397 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:08.342785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bf2c1-4b84-4511-afde-45af16993397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:08.344896 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21bf2c1-4b84-4511-afde-45af16993397 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:08.512525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1108/2213] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:12:08 2022] POST /identity/v3/users => generated 291 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:12:08.516875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4417262-0c33-4c93-908a-8a4ec080da1e admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:08.540141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4417262-0c33-4c93-908a-8a4ec080da1e admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:08.547608 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a8775-f6cf-4024-8071-db5890f99acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:08.549401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a8775-f6cf-4024-8071-db5890f99acb admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:08.549689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a8775-f6cf-4024-8071-db5890f99acb admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:08.549973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a8775-f6cf-4024-8071-db5890f99acb admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:08.554363 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a8775-f6cf-4024-8071-db5890f99acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:08.556025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38a8775-f6cf-4024-8071-db5890f99acb admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:08.575261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1106/2214] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:12:08.576447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bf2c1-4b84-4511-afde-45af16993397 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:08.597310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21bf2c1-4b84-4511-afde-45af16993397 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:08.603467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51062afa-25e6-4f35-88df-b5d02e829e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:08.607191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062afa-25e6-4f35-88df-b5d02e829e81 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:08.607191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062afa-25e6-4f35-88df-b5d02e829e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:08.607191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51062afa-25e6-4f35-88df-b5d02e829e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:08.607191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51062afa-25e6-4f35-88df-b5d02e829e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:08.607495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51062afa-25e6-4f35-88df-b5d02e829e81 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:08.618148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1109/2215] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:12:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:12:08.622961 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a8775-f6cf-4024-8071-db5890f99acb admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:08.633327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a8775-f6cf-4024-8071-db5890f99acb admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:08.637123 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:08.642993 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde890d-082b-4b40-b1b6-658ccbd33d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:08.644130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde890d-082b-4b40-b1b6-658ccbd33d10 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:08.645286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde890d-082b-4b40-b1b6-658ccbd33d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:08.645286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebde890d-082b-4b40-b1b6-658ccbd33d10 admin admin] PATH_INFO: `/v3/projects/c42a89c05ee34a30af7d57c6c345fd24/users/f747e0f4444b4aefa10d1c58d674522b/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:08.662859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde890d-082b-4b40-b1b6-658ccbd33d10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42a89c05ee34a30af7d57c6c345fd24, user_id=f747e0f4444b4aefa10d1c58d674522b, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:08.666291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebde890d-082b-4b40-b1b6-658ccbd33d10 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:08.756535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1107/2216] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:12:08 2022] PUT /identity/v3/projects/c42a89c05ee34a30af7d57c6c345fd24/users/f747e0f4444b4aefa10d1c58d674522b/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:12:08.762173 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5466d-cf78-4106-a3b5-ba7e9154d655 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:08.765793 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5466d-cf78-4106-a3b5-ba7e9154d655 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:08.765793 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5466d-cf78-4106-a3b5-ba7e9154d655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:08.781686 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-97c5466d-cf78-4106-a3b5-ba7e9154d655 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:08.783731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-97c5466d-cf78-4106-a3b5-ba7e9154d655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:08.850096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1110/2217] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:08.859761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde890d-082b-4b40-b1b6-658ccbd33d10 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:08.861554 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ebde890d-082b-4b40-b1b6-658ccbd33d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:08.917598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebde890d-082b-4b40-b1b6-658ccbd33d10 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:08.921435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cecb2-1179-426f-a18d-02d0ce0dc50d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:08.922068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cecb2-1179-426f-a18d-02d0ce0dc50d service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:08.922347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cecb2-1179-426f-a18d-02d0ce0dc50d service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:08.922620 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3cecb2-1179-426f-a18d-02d0ce0dc50d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:08.932761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cecb2-1179-426f-a18d-02d0ce0dc50d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:08.934194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3cecb2-1179-426f-a18d-02d0ce0dc50d service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:08.943590 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1108/2218] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:12:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:12:10.402722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7684d-3381-4412-afb9-b7c7f4556a68 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:10.403346 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7684d-3381-4412-afb9-b7c7f4556a68 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:10.403346 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7684d-3381-4412-afb9-b7c7f4556a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:10.433035 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-eea7684d-3381-4412-afb9-b7c7f4556a68 None None] MFA Rules not processed for user `f747e0f4444b4aefa10d1c58d674522b`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:10.434371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-eea7684d-3381-4412-afb9-b7c7f4556a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:10.501447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1111/2219] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:10.513020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cecb2-1179-426f-a18d-02d0ce0dc50d service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:10.514546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ae3cecb2-1179-426f-a18d-02d0ce0dc50d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:10.571588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3cecb2-1179-426f-a18d-02d0ce0dc50d service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:10.575720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afb209-05f0-47ec-ad2d-7ab4014a321b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:10.576403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afb209-05f0-47ec-ad2d-7ab4014a321b service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:10.576686 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afb209-05f0-47ec-ad2d-7ab4014a321b service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:10.576971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afb209-05f0-47ec-ad2d-7ab4014a321b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:10.589766 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afb209-05f0-47ec-ad2d-7ab4014a321b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:10.591234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afb209-05f0-47ec-ad2d-7ab4014a321b service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:10.602643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1109/2220] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:12:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:12:10.830688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:10.921475 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:12.477656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91d1ff-7fa0-4b01-be9e-1d3fd5cc5933 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:12.478159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91d1ff-7fa0-4b01-be9e-1d3fd5cc5933 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:12.478250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91d1ff-7fa0-4b01-be9e-1d3fd5cc5933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:12.496811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ee91d1ff-7fa0-4b01-be9e-1d3fd5cc5933 None None] MFA Rules not processed for user `f747e0f4444b4aefa10d1c58d674522b`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:12.498143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ee91d1ff-7fa0-4b01-be9e-1d3fd5cc5933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:12.505814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1112/2221] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:12.848587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:12.864468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:13.767309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afb209-05f0-47ec-ad2d-7ab4014a321b service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:13.769151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-56afb209-05f0-47ec-ad2d-7ab4014a321b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:13.787750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afb209-05f0-47ec-ad2d-7ab4014a321b service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:13.792859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:13.793922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:13.794203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:13.794478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] PATH_INFO: `/v3/users/80028ef3526e48cda016a9eec4bb5ee2` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:13.796016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80028ef3526e48cda016a9eec4bb5ee2)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:13.797960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:13.916027 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:14.021812 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:14.055438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80028ef3526e48cda016a9eec4bb5ee2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:14.114420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80028ef3526e48cda016a9eec4bb5ee2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:14.115349 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80028ef3526e48cda016a9eec4bb5ee2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:14.118943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80028ef3526e48cda016a9eec4bb5ee2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:14.235673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80028ef3526e48cda016a9eec4bb5ee2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:14.294295 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1110/2222] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:12:13 2022] DELETE /identity/v3/users/80028ef3526e48cda016a9eec4bb5ee2 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:12:14.299135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba9457-df24-43de-99e0-08e4e9ca5092 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:14.299426 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba9457-df24-43de-99e0-08e4e9ca5092 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:14.299732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eba9457-df24-43de-99e0-08e4e9ca5092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:14.320705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-9eba9457-df24-43de-99e0-08e4e9ca5092 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:14.321985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9eba9457-df24-43de-99e0-08e4e9ca5092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:14.397266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1113/2223] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:14.408534 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:14.411325 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:14.496014 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b2211-4374-4d8b-ae62-3cfd5fed27f4 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:14.500297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab54bdbb-1542-44ab-8401-c4d2a51b72ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:14.501103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54bdbb-1542-44ab-8401-c4d2a51b72ef service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:14.501494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54bdbb-1542-44ab-8401-c4d2a51b72ef service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:14.501876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab54bdbb-1542-44ab-8401-c4d2a51b72ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:14.512760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54bdbb-1542-44ab-8401-c4d2a51b72ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:14.514475 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab54bdbb-1542-44ab-8401-c4d2a51b72ef service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:14.525730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1111/2224] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:12:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:12:15.322731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba9457-df24-43de-99e0-08e4e9ca5092 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:15.324811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9eba9457-df24-43de-99e0-08e4e9ca5092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:15.347476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eba9457-df24-43de-99e0-08e4e9ca5092 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:15.365533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d92975-f678-4eff-bbe1-12010b6e5112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:15.366422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d92975-f678-4eff-bbe1-12010b6e5112 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:15.366703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d92975-f678-4eff-bbe1-12010b6e5112 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:15.367000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d92975-f678-4eff-bbe1-12010b6e5112 admin admin] PATH_INFO: `/v3/projects/f9412e2625a24d41908cc634e37b25ea` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:15.368314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d92975-f678-4eff-bbe1-12010b6e5112 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9412e2625a24d41908cc634e37b25ea)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:15.370847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d92975-f678-4eff-bbe1-12010b6e5112 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:15.499923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-82d92975-f678-4eff-bbe1-12010b6e5112 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9412e2625a24d41908cc634e37b25ea', 'request_id': 'req-82d92975-f678-4eff-bbe1-12010b6e5112'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:15.512697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-82d92975-f678-4eff-bbe1-12010b6e5112 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9412e2625a24d41908cc634e37b25ea', 'request_id': 'req-82d92975-f678-4eff-bbe1-12010b6e5112'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:15.521043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-82d92975-f678-4eff-bbe1-12010b6e5112 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9412e2625a24d41908cc634e37b25ea', 'request_id': 'req-82d92975-f678-4eff-bbe1-12010b6e5112'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:15.671090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-82d92975-f678-4eff-bbe1-12010b6e5112 admin admin] The token cache is being invalidate because project f9412e2625a24d41908cc634e37b25ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:12:15.671412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-82d92975-f678-4eff-bbe1-12010b6e5112 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:15.672183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-82d92975-f678-4eff-bbe1-12010b6e5112 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:12:15.677550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1114/2225] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:12:15 2022] DELETE /identity/v3/projects/f9412e2625a24d41908cc634e37b25ea => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:12:15.682233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb98cf3-cf08-4c3f-942e-3657ffc1b6cb None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:15.682769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb98cf3-cf08-4c3f-942e-3657ffc1b6cb None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:15.682769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb98cf3-cf08-4c3f-942e-3657ffc1b6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:15.709537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-abb98cf3-cf08-4c3f-942e-3657ffc1b6cb None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:15.710787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-abb98cf3-cf08-4c3f-942e-3657ffc1b6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:15.781156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1112/2226] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:15.789068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d539f1-56e3-4f0d-ba00-566e6781bb08 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:15.789355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d539f1-56e3-4f0d-ba00-566e6781bb08 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:15.789631 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d539f1-56e3-4f0d-ba00-566e6781bb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:15.812821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-c8d539f1-56e3-4f0d-ba00-566e6781bb08 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:15.824276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c8d539f1-56e3-4f0d-ba00-566e6781bb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:15.842422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1115/2227] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:15.846759 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb98cf3-cf08-4c3f-942e-3657ffc1b6cb None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:15.858056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb98cf3-cf08-4c3f-942e-3657ffc1b6cb None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:15.862907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcef550a-0751-43a8-beb8-6f908e389c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:15.863835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef550a-0751-43a8-beb8-6f908e389c6e admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:15.864206 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef550a-0751-43a8-beb8-6f908e389c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:15.864486 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcef550a-0751-43a8-beb8-6f908e389c6e admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:15.865285 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef550a-0751-43a8-beb8-6f908e389c6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:12:15.865559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef550a-0751-43a8-beb8-6f908e389c6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:15.867158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcef550a-0751-43a8-beb8-6f908e389c6e admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:15.880674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1113/2228] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:12:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:12:15.885713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d539f1-56e3-4f0d-ba00-566e6781bb08 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:15.896396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d539f1-56e3-4f0d-ba00-566e6781bb08 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:15.903150 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4936-f945-4e8f-941e-9dd9a9956399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:15.904078 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4936-f945-4e8f-941e-9dd9a9956399 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:15.904438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4936-f945-4e8f-941e-9dd9a9956399 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:15.904972 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd4936-f945-4e8f-941e-9dd9a9956399 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:15.905856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd4936-f945-4e8f-941e-9dd9a9956399 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:15.907949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd4936-f945-4e8f-941e-9dd9a9956399 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:15.913526 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:15.933802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a910f94-5ea8-41e5-9480-1196a340b90c None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:15.934095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a910f94-5ea8-41e5-9480-1196a340b90c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:15.934374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a910f94-5ea8-41e5-9480-1196a340b90c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:15.953586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-0a910f94-5ea8-41e5-9480-1196a340b90c None None] MFA Rules not processed for user `dbb1a907aaee40de9c87dbfe96a6ebd7`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:15.954843 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0a910f94-5ea8-41e5-9480-1196a340b90c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:16.011754 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1114/2229] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:12:16.045344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1116/2230] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:12:15 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:12:16.048222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a910f94-5ea8-41e5-9480-1196a340b90c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:16.060347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a910f94-5ea8-41e5-9480-1196a340b90c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:16.071459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:16.161520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a016b-f157-490e-b2cf-ea19574f564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:16.162038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a016b-f157-490e-b2cf-ea19574f564c admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:16.162323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a016b-f157-490e-b2cf-ea19574f564c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:16.162598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a016b-f157-490e-b2cf-ea19574f564c admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:16.163291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a016b-f157-490e-b2cf-ea19574f564c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:16.165936 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a016b-f157-490e-b2cf-ea19574f564c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:16.262356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1115/2231] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:12:16 2022] POST /identity/v3/users => generated 292 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:12:16.263616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4936-f945-4e8f-941e-9dd9a9956399 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:16.276935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd4936-f945-4e8f-941e-9dd9a9956399 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:16.282324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa881-d08d-4e80-86f3-a1e0671cd099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:16.283007 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa881-d08d-4e80-86f3-a1e0671cd099 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:16.283296 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa881-d08d-4e80-86f3-a1e0671cd099 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:16.283579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45fa881-d08d-4e80-86f3-a1e0671cd099 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:16.284378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fa881-d08d-4e80-86f3-a1e0671cd099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:16.286016 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45fa881-d08d-4e80-86f3-a1e0671cd099 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:16.302549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1117/2232] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:12:16.303664 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a016b-f157-490e-b2cf-ea19574f564c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:16.314827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a016b-f157-490e-b2cf-ea19574f564c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:16.335088 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3c4b19-9d1f-4b6e-b739-bca3244a6e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:16.335784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c4b19-9d1f-4b6e-b739-bca3244a6e0a admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:16.336106 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c4b19-9d1f-4b6e-b739-bca3244a6e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:16.336390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3c4b19-9d1f-4b6e-b739-bca3244a6e0a admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:16.337157 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c4b19-9d1f-4b6e-b739-bca3244a6e0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:16.339371 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3c4b19-9d1f-4b6e-b739-bca3244a6e0a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:16.364149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1116/2233] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:12:16.365616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa881-d08d-4e80-86f3-a1e0671cd099 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:16.376055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45fa881-d08d-4e80-86f3-a1e0671cd099 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:16.381072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e650ed7-2235-4f22-aa21-554b452f0d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:16.382216 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e650ed7-2235-4f22-aa21-554b452f0d73 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:16.382368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e650ed7-2235-4f22-aa21-554b452f0d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:16.382773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e650ed7-2235-4f22-aa21-554b452f0d73 admin admin] PATH_INFO: `/v3/projects/81090c9a4f4c4cf1b2438be6e36fd13b/users/3901560256c4484497b2323aadcbe60a/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:16.414255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e650ed7-2235-4f22-aa21-554b452f0d73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81090c9a4f4c4cf1b2438be6e36fd13b, user_id=3901560256c4484497b2323aadcbe60a, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:16.417761 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e650ed7-2235-4f22-aa21-554b452f0d73 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:16.637893 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1118/2234] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:12:16 2022] PUT /identity/v3/projects/81090c9a4f4c4cf1b2438be6e36fd13b/users/3901560256c4484497b2323aadcbe60a/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:12:16.643496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8351321-7fcc-4dda-a5d9-7558317967fd None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:16.643801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8351321-7fcc-4dda-a5d9-7558317967fd None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:16.644095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8351321-7fcc-4dda-a5d9-7558317967fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:16.662139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-f8351321-7fcc-4dda-a5d9-7558317967fd None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:16.663401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f8351321-7fcc-4dda-a5d9-7558317967fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:16.738749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1117/2235] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:16.766953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e650ed7-2235-4f22-aa21-554b452f0d73 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:16.768692 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9e650ed7-2235-4f22-aa21-554b452f0d73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:16.829904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e650ed7-2235-4f22-aa21-554b452f0d73 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:16.833735 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee42c5c-00ca-472f-af15-3773765456af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:16.834418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42c5c-00ca-472f-af15-3773765456af service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:16.834694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42c5c-00ca-472f-af15-3773765456af service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:16.834976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee42c5c-00ca-472f-af15-3773765456af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:16.849092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee42c5c-00ca-472f-af15-3773765456af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:16.850812 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee42c5c-00ca-472f-af15-3773765456af service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:16.874880 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1119/2236] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:12:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:12:17.973292 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:18.581585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:18.681168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:21.156938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:21.287223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:22.013176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:24.178393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:24.487023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:24.824586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1392fbb-05cc-43b1-b374-4bb7558cb9ef None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:24.825353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1392fbb-05cc-43b1-b374-4bb7558cb9ef None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:24.825754 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1392fbb-05cc-43b1-b374-4bb7558cb9ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:24.845947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-c1392fbb-05cc-43b1-b374-4bb7558cb9ef None None] MFA Rules not processed for user `1d6b0c12ebad40eaafec09b662e228c4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:24.847239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c1392fbb-05cc-43b1-b374-4bb7558cb9ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:24.940842 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1118/2237] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:26.201627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:26.757033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:27.312644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789403be-a8c3-47f9-9dc0-f733604093b1 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:27.313926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789403be-a8c3-47f9-9dc0-f733604093b1 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:27.315266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789403be-a8c3-47f9-9dc0-f733604093b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:27.351159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-789403be-a8c3-47f9-9dc0-f733604093b1 None None] MFA Rules not processed for user `3901560256c4484497b2323aadcbe60a`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:27.353097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-789403be-a8c3-47f9-9dc0-f733604093b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:27.449482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1120/2238] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:27.454400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1392fbb-05cc-43b1-b374-4bb7558cb9ef None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:27.473420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1392fbb-05cc-43b1-b374-4bb7558cb9ef None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:27.479213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44877c9-2533-46e4-9652-79355fab8b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:27.480078 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44877c9-2533-46e4-9652-79355fab8b95 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:27.485080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44877c9-2533-46e4-9652-79355fab8b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:27.485080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44877c9-2533-46e4-9652-79355fab8b95 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:27.485080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44877c9-2533-46e4-9652-79355fab8b95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:27.485080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44877c9-2533-46e4-9652-79355fab8b95 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:27.683453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1119/2239] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:12:27 2022] POST /identity/v3/projects => generated 385 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:12:27.687323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789403be-a8c3-47f9-9dc0-f733604093b1 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:27.700879 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789403be-a8c3-47f9-9dc0-f733604093b1 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:27.768347 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5d945-3553-4896-804e-cafec0be99a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:27.769381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5d945-3553-4896-804e-cafec0be99a2 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:27.769878 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5d945-3553-4896-804e-cafec0be99a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:27.770721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5d945-3553-4896-804e-cafec0be99a2 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:27.771679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5d945-3553-4896-804e-cafec0be99a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:27.775909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5d945-3553-4896-804e-cafec0be99a2 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:28.149675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1121/2240] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:12:27 2022] POST /identity/v3/users => generated 299 bytes in 458 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:12:28.152964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44877c9-2533-46e4-9652-79355fab8b95 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:28.163769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44877c9-2533-46e4-9652-79355fab8b95 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:28.169637 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57bb39-2659-4da4-96e6-31c22887d76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:28.170415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57bb39-2659-4da4-96e6-31c22887d76b admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:28.170606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57bb39-2659-4da4-96e6-31c22887d76b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:28.171237 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb57bb39-2659-4da4-96e6-31c22887d76b admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:28.172936 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57bb39-2659-4da4-96e6-31c22887d76b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:28.174266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb57bb39-2659-4da4-96e6-31c22887d76b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:28.188204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1120/2241] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:12:28.192507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5d945-3553-4896-804e-cafec0be99a2 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:28.204264 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5d945-3553-4896-804e-cafec0be99a2 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:28.209686 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6a046-fee1-4007-90f0-6bd52fd1e333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:28.210794 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6a046-fee1-4007-90f0-6bd52fd1e333 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:28.211240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6a046-fee1-4007-90f0-6bd52fd1e333 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:28.211735 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e6a046-fee1-4007-90f0-6bd52fd1e333 admin admin] PATH_INFO: `/v3/projects/325fb866eb654386a4c415416fba4e5d/users/9e6aeb519e7049d9bf4c319a5a9972b0/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:28.234944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6a046-fee1-4007-90f0-6bd52fd1e333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325fb866eb654386a4c415416fba4e5d, user_id=9e6aeb519e7049d9bf4c319a5a9972b0, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:28.237909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e6a046-fee1-4007-90f0-6bd52fd1e333 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:28.358706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1122/2242] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:12:28 2022] PUT /identity/v3/projects/325fb866eb654386a4c415416fba4e5d/users/9e6aeb519e7049d9bf4c319a5a9972b0/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:12:28.362550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57bb39-2659-4da4-96e6-31c22887d76b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:28.374018 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb57bb39-2659-4da4-96e6-31c22887d76b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:28.458985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44a8f3-ab6e-498e-bf71-bb2ec74062de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:28.459687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44a8f3-ab6e-498e-bf71-bb2ec74062de admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:28.460393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44a8f3-ab6e-498e-bf71-bb2ec74062de admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:28.460393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44a8f3-ab6e-498e-bf71-bb2ec74062de admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:28.461472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44a8f3-ab6e-498e-bf71-bb2ec74062de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:28.463353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44a8f3-ab6e-498e-bf71-bb2ec74062de admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:28.495197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1121/2243] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:12:28.499407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6a046-fee1-4007-90f0-6bd52fd1e333 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:28.517091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e6a046-fee1-4007-90f0-6bd52fd1e333 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:28.545440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe307b8c-430d-422e-8a3b-c81583b9cb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:28.546468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe307b8c-430d-422e-8a3b-c81583b9cb22 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:28.546592 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe307b8c-430d-422e-8a3b-c81583b9cb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:28.546857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe307b8c-430d-422e-8a3b-c81583b9cb22 admin admin] PATH_INFO: `/v3/projects/325fb866eb654386a4c415416fba4e5d/users/9e6aeb519e7049d9bf4c319a5a9972b0/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:28.552700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe307b8c-430d-422e-8a3b-c81583b9cb22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=325fb866eb654386a4c415416fba4e5d, user_id=9e6aeb519e7049d9bf4c319a5a9972b0, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:28.583613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe307b8c-430d-422e-8a3b-c81583b9cb22 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:28.622755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1123/2244] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:12:28 2022] PUT /identity/v3/projects/325fb866eb654386a4c415416fba4e5d/users/9e6aeb519e7049d9bf4c319a5a9972b0/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:12:29.296188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b717-03a4-4988-a30c-3ff111f9b6d9 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:29.296757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b717-03a4-4988-a30c-3ff111f9b6d9 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:29.296757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a802b717-03a4-4988-a30c-3ff111f9b6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:29.331051 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-a802b717-03a4-4988-a30c-3ff111f9b6d9 None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:29.332253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a802b717-03a4-4988-a30c-3ff111f9b6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:29.442221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1122/2245] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:12:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:29.546495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe307b8c-430d-422e-8a3b-c81583b9cb22 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:29.550183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-fe307b8c-430d-422e-8a3b-c81583b9cb22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:29.723891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe307b8c-430d-422e-8a3b-c81583b9cb22 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:29.740989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181747c-e894-4d4a-8ed7-f22df7bf4ee1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:29.740989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181747c-e894-4d4a-8ed7-f22df7bf4ee1 service swift] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:29.740989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181747c-e894-4d4a-8ed7-f22df7bf4ee1 service swift] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:29.741419 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f181747c-e894-4d4a-8ed7-f22df7bf4ee1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:29.754563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181747c-e894-4d4a-8ed7-f22df7bf4ee1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:29.756536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f181747c-e894-4d4a-8ed7-f22df7bf4ee1 service swift] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:29.798775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:29.814716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1124/2246] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:12:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:12:31.835470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:33.543589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:34.173613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:34.669221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:36.686512 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:37.177857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:37.866256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:39.455638 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653685ef-8ee2-44e8-af27-f83b0e66ed79 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:39.456753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653685ef-8ee2-44e8-af27-f83b0e66ed79 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:39.457200 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653685ef-8ee2-44e8-af27-f83b0e66ed79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:39.510064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-653685ef-8ee2-44e8-af27-f83b0e66ed79 None None] MFA Rules not processed for user `9e6aeb519e7049d9bf4c319a5a9972b0`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:39.511546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-653685ef-8ee2-44e8-af27-f83b0e66ed79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:39.669449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1123/2247] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:12:39 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:40.134373 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:41.201217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:42.177987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:42.218136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:43.276585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:43.469364 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:44.831525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:45.875974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:47.013701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181747c-e894-4d4a-8ed7-f22df7bf4ee1 service swift] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:47.015207 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f181747c-e894-4d4a-8ed7-f22df7bf4ee1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:47.128219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f181747c-e894-4d4a-8ed7-f22df7bf4ee1 service swift] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:47.132508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e83ec4-9f79-4276-8559-a1ca97b96628 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5211ed409a3f43d281bca44382aa03fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:47.138225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e83ec4-9f79-4276-8559-a1ca97b96628 service glance] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:47.138225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e83ec4-9f79-4276-8559-a1ca97b96628 service glance] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:47.138225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e83ec4-9f79-4276-8559-a1ca97b96628 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:47.179074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:47.203865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e83ec4-9f79-4276-8559-a1ca97b96628 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:47.205582 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e83ec4-9f79-4276-8559-a1ca97b96628 service glance] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:47.216337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1125/2248] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:12:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:12:47.513132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6496b-11cc-448b-bed0-32e6f6a596e1 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:47.513132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6496b-11cc-448b-bed0-32e6f6a596e1 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:47.513132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb6496b-11cc-448b-bed0-32e6f6a596e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:47.541455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-bdb6496b-11cc-448b-bed0-32e6f6a596e1 None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:47.542102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-bdb6496b-11cc-448b-bed0-32e6f6a596e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:47.549977 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1124/2249] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:12:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:47.563495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e83ec4-9f79-4276-8559-a1ca97b96628 service glance] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:47.576886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e83ec4-9f79-4276-8559-a1ca97b96628 service glance] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:47.582661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95354a0c-2d00-4db3-b8c7-1aaf89017588 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:47.583695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95354a0c-2d00-4db3-b8c7-1aaf89017588 service swift] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:47.584206 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95354a0c-2d00-4db3-b8c7-1aaf89017588 service swift] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:47.584671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95354a0c-2d00-4db3-b8c7-1aaf89017588 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:47.594099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95354a0c-2d00-4db3-b8c7-1aaf89017588 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:47.595713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95354a0c-2d00-4db3-b8c7-1aaf89017588 service swift] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:47.604932 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1126/2250] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:12:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:12:48.121671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:48.563403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:48.646713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:48.710685 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:49.096271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba082fd-768f-47c3-9ef3-019c66d16750 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:49.097025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba082fd-768f-47c3-9ef3-019c66d16750 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:49.097465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba082fd-768f-47c3-9ef3-019c66d16750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:49.143159 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-8ba082fd-768f-47c3-9ef3-019c66d16750 None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:49.154838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8ba082fd-768f-47c3-9ef3-019c66d16750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:49.178216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1125/2251] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:12:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:12:49.193466 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95354a0c-2d00-4db3-b8c7-1aaf89017588 service swift] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:12:49.208804 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95354a0c-2d00-4db3-b8c7-1aaf89017588 service swift] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:12:49.214682 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7701635-6057-4655-8a7a-af46a50d30e9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:12:49.219224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7701635-6057-4655-8a7a-af46a50d30e9 service swift] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:49.219748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7701635-6057-4655-8a7a-af46a50d30e9 service swift] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:49.226307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7701635-6057-4655-8a7a-af46a50d30e9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:49.244924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7701635-6057-4655-8a7a-af46a50d30e9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:12:49.251863 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7701635-6057-4655-8a7a-af46a50d30e9 service swift] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:12:49.282612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1127/2252] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:12:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:12:49.372216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:49.480538 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:49.772538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:50.417428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:50.515000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:51.132906 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:51.260336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:52.046376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:53.178442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:53.321471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:55.680949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:55.720795 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:55.833450 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019d73-9d73-43cd-bac9-1be8aa820638 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:55.833845 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019d73-9d73-43cd-bac9-1be8aa820638 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:55.834134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae019d73-9d73-43cd-bac9-1be8aa820638 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:55.835628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1126/2253] 10.222.0.52 () {54 vars in 921 bytes} [Thu Jun 23 11:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:12:55.843687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ae9b-e2df-4502-a9d5-bcd9189b2bbc None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:12:55.844247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ae9b-e2df-4502-a9d5-bcd9189b2bbc None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:12:55.844695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a57ae9b-e2df-4502-a9d5-bcd9189b2bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:12:55.963834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-5a57ae9b-e2df-4502-a9d5-bcd9189b2bbc None None] MFA Rules not processed for user `a020e7fe06574a108b46f9f48bddc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:12:55.967674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5a57ae9b-e2df-4502-a9d5-bcd9189b2bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:12:56.125754 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1128/2254] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Jun 23 11:12:55 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:12:56.295522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:56.543243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:56.836466 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:57.200115 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:57.344509 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:57.755277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:58.034791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:58.989909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:12:59.965669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:00.293423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea61be-ca06-45bb-ad83-d1c65cd45a4a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:00.293713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea61be-ca06-45bb-ad83-d1c65cd45a4a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:00.294014 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea61be-ca06-45bb-ad83-d1c65cd45a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:00.325935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:00.370712 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-2dea61be-ca06-45bb-ad83-d1c65cd45a4a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:00.372327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2dea61be-ca06-45bb-ad83-d1c65cd45a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:00.498060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1127/2255] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Jun 23 11:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:13:00.518307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57ae9b-e2df-4502-a9d5-bcd9189b2bbc None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:00.521473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5a57ae9b-e2df-4502-a9d5-bcd9189b2bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:00.532174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:00.546422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a57ae9b-e2df-4502-a9d5-bcd9189b2bbc None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:00.554488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9e383a-dcea-4ac5-96a5-efe07f84109c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:00.557127 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e383a-dcea-4ac5-96a5-efe07f84109c service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:00.557127 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e383a-dcea-4ac5-96a5-efe07f84109c service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:00.557127 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9e383a-dcea-4ac5-96a5-efe07f84109c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:00.565976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e383a-dcea-4ac5-96a5-efe07f84109c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:00.567603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9e383a-dcea-4ac5-96a5-efe07f84109c service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:00.592959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1129/2256] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:13:00.719275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea61be-ca06-45bb-ad83-d1c65cd45a4a None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:00.721160 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2dea61be-ca06-45bb-ad83-d1c65cd45a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:00.754076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea61be-ca06-45bb-ad83-d1c65cd45a4a None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:00.766668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d888b0a-c7ad-44d8-86f2-2a3213422f75 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5211ed409a3f43d281bca44382aa03fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:00.767398 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d888b0a-c7ad-44d8-86f2-2a3213422f75 service glance] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:00.767684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d888b0a-c7ad-44d8-86f2-2a3213422f75 service glance] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:00.768176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d888b0a-c7ad-44d8-86f2-2a3213422f75 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:00.782941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d888b0a-c7ad-44d8-86f2-2a3213422f75 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:00.784593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d888b0a-c7ad-44d8-86f2-2a3213422f75 service glance] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:00.799065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1128/2257] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:13:00.885785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ed1b-c8c5-44d7-a701-cf2a864e0337 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:00.886115 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ed1b-c8c5-44d7-a701-cf2a864e0337 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:00.886355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2505ed1b-c8c5-44d7-a701-cf2a864e0337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:00.909481 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-2505ed1b-c8c5-44d7-a701-cf2a864e0337 None None] MFA Rules not processed for user `3901560256c4484497b2323aadcbe60a`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:00.911748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2505ed1b-c8c5-44d7-a701-cf2a864e0337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:00.919788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1130/2258] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:13:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:13:00.960210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:01.024836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85739a-3b26-4a40-abe1-c6ddcbdd86c1 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:01.031375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85739a-3b26-4a40-abe1-c6ddcbdd86c1 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:01.031375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf85739a-3b26-4a40-abe1-c6ddcbdd86c1 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:01.031375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1129/2259] 10.222.0.52 () {54 vars in 921 bytes} [Thu Jun 23 11:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:13:01.033033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f991934-65f2-4d01-9b92-6738a7b65e13 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:01.033343 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f991934-65f2-4d01-9b92-6738a7b65e13 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:01.033641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f991934-65f2-4d01-9b92-6738a7b65e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:01.057894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:01.116056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-7f991934-65f2-4d01-9b92-6738a7b65e13 None None] MFA Rules not processed for user `2d903a8e2ce4489fa7f5b7479ff0b7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:01.119534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7f991934-65f2-4d01-9b92-6738a7b65e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:01.224026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:01.257697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:01.263078 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1131/2260] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Jun 23 11:13:01 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:13:01.275607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85739a-3b26-4a40-abe1-c6ddcbdd86c1 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:01.277374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-bf85739a-3b26-4a40-abe1-c6ddcbdd86c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:01.299949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf85739a-3b26-4a40-abe1-c6ddcbdd86c1 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:01.307824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903b06c0-f6a2-4c85-acbd-7bfedd159985 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:01.312075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b06c0-f6a2-4c85-acbd-7bfedd159985 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:01.312075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b06c0-f6a2-4c85-acbd-7bfedd159985 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:01.312075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903b06c0-f6a2-4c85-acbd-7bfedd159985 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:01.317772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b06c0-f6a2-4c85-acbd-7bfedd159985 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:01.319720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903b06c0-f6a2-4c85-acbd-7bfedd159985 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:01.331785 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1130/2261] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:13:01.385180 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:01.418426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:01.495172 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164a28-730b-4120-ae45-e4b07b129b09 None None] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:01.495580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164a28-730b-4120-ae45-e4b07b129b09 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:01.496381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce164a28-730b-4120-ae45-e4b07b129b09 None None] PATH_INFO: `/` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:01.498437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1132/2262] 10.222.0.52 () {54 vars in 921 bytes} [Thu Jun 23 11:13:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:13:01.515630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91762aba-20d0-4ffd-a5c7-835752308232 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:01.516163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91762aba-20d0-4ffd-a5c7-835752308232 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:01.516477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91762aba-20d0-4ffd-a5c7-835752308232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:01.539560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-91762aba-20d0-4ffd-a5c7-835752308232 None None] MFA Rules not processed for user `a020e7fe06574a108b46f9f48bddc4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:01.541989 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:01.542739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-91762aba-20d0-4ffd-a5c7-835752308232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:01.557753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1131/2263] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Jun 23 11:13:01 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:13:01.569018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce164a28-730b-4120-ae45-e4b07b129b09 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:01.587235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:01.599074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce164a28-730b-4120-ae45-e4b07b129b09 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:01.607376 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce30aa7a-d39e-422d-ab9a-d0e51c259a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:01.609192 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30aa7a-d39e-422d-ab9a-d0e51c259a1c service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:01.612152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30aa7a-d39e-422d-ab9a-d0e51c259a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:01.614920 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce30aa7a-d39e-422d-ab9a-d0e51c259a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:01.631139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30aa7a-d39e-422d-ab9a-d0e51c259a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:01.633439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce30aa7a-d39e-422d-ab9a-d0e51c259a1c service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:01.647297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1133/2264] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:13:01.697619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:01.806704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:01.920437 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:02.274929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:02.354932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:02.829131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:02.898158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:03.560368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:03.761672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:04.080587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:04.384352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:04.452283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:04.663615 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:04.923506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:05.155283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:05.470172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:05.775003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:06.141183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bfac3-a10c-4fcc-8a04-dbc9b992c2da None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:06.141759 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bfac3-a10c-4fcc-8a04-dbc9b992c2da None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:06.141759 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4bfac3-a10c-4fcc-8a04-dbc9b992c2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:06.200386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-1d4bfac3-a10c-4fcc-8a04-dbc9b992c2da None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:06.201872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1d4bfac3-a10c-4fcc-8a04-dbc9b992c2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:06.214776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f9574-53c7-4f6c-8a07-20f48c12b07e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:06.215429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f9574-53c7-4f6c-8a07-20f48c12b07e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:06.215573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f9574-53c7-4f6c-8a07-20f48c12b07e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:06.217984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1132/2265] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:13:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:13:06.240969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-480f9574-53c7-4f6c-8a07-20f48c12b07e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:06.243306 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-480f9574-53c7-4f6c-8a07-20f48c12b07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:06.249290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bfac3-a10c-4fcc-8a04-dbc9b992c2da None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:06.264774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1134/2266] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Jun 23 11:13:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:13:06.274691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4bfac3-a10c-4fcc-8a04-dbc9b992c2da None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:06.282207 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f9574-53c7-4f6c-8a07-20f48c12b07e None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:06.283142 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0107c4-d515-4044-9c63-a4714988bfc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:06.285589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0107c4-d515-4044-9c63-a4714988bfc9 service swift] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:06.286096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0107c4-d515-4044-9c63-a4714988bfc9 service swift] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:06.286372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0107c4-d515-4044-9c63-a4714988bfc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:06.286677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-480f9574-53c7-4f6c-8a07-20f48c12b07e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:06.300967 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0107c4-d515-4044-9c63-a4714988bfc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:06.303135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0107c4-d515-4044-9c63-a4714988bfc9 service swift] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:06.310972 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f9574-53c7-4f6c-8a07-20f48c12b07e None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:06.317416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1133/2267] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:13:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:13:06.323216 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ad09d-4cf5-4cf9-b7e1-6a446e8f817e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:06.323755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ad09d-4cf5-4cf9-b7e1-6a446e8f817e service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:06.323755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ad09d-4cf5-4cf9-b7e1-6a446e8f817e service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:06.324017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928ad09d-4cf5-4cf9-b7e1-6a446e8f817e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:06.333745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ad09d-4cf5-4cf9-b7e1-6a446e8f817e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:06.335364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928ad09d-4cf5-4cf9-b7e1-6a446e8f817e service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:06.350782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1135/2268] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:13:06.400420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:06.544093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:07.743584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:07.910079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:08.417741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:08.616355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:08.708884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:08.754524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:10.041060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7100-0875-405c-b7db-860a6a2f6a85 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:10.041060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7100-0875-405c-b7db-860a6a2f6a85 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:10.041060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dba7100-0875-405c-b7db-860a6a2f6a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:10.060245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-8dba7100-0875-405c-b7db-860a6a2f6a85 None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:10.061576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8dba7100-0875-405c-b7db-860a6a2f6a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:10.069466 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1134/2269] 10.222.0.52 () {58 vars in 967 bytes} [Thu Jun 23 11:13:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:13:10.093436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ad09d-4cf5-4cf9-b7e1-6a446e8f817e service nova] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:10.106751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928ad09d-4cf5-4cf9-b7e1-6a446e8f817e service nova] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:10.112057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3b9855-859d-4e7d-9f7a-c67088c77f44 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:10.112792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b9855-859d-4e7d-9f7a-c67088c77f44 service swift] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:10.113090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b9855-859d-4e7d-9f7a-c67088c77f44 service swift] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:10.113540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3b9855-859d-4e7d-9f7a-c67088c77f44 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:10.122485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b9855-859d-4e7d-9f7a-c67088c77f44 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:10.124156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3b9855-859d-4e7d-9f7a-c67088c77f44 service swift] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:10.132862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1136/2270] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:13:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:13:14.983208 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db9bc3-5dcc-4da8-bf9b-35b02923f768 None None] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:14.984341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db9bc3-5dcc-4da8-bf9b-35b02923f768 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:14.984812 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db9bc3-5dcc-4da8-bf9b-35b02923f768 None None] PATH_INFO: `/` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:14.987543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1135/2271] 10.222.0.52 () {54 vars in 921 bytes} [Thu Jun 23 11:13:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 23 11:13:15.000741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dd9f3-bba0-4036-8986-09a3fe9e8478 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:15.001869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dd9f3-bba0-4036-8986-09a3fe9e8478 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:15.002972 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5dd9f3-bba0-4036-8986-09a3fe9e8478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:15.084418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-6e5dd9f3-bba0-4036-8986-09a3fe9e8478 None None] MFA Rules not processed for user `e838dd9aa24f4571b64719125610c528`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:15.085705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-6e5dd9f3-bba0-4036-8986-09a3fe9e8478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:15.188876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1137/2272] 10.222.0.52 () {58 vars in 1018 bytes} [Thu Jun 23 11:13:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:13:15.201427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db9bc3-5dcc-4da8-bf9b-35b02923f768 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:15.204784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e4db9bc3-5dcc-4da8-bf9b-35b02923f768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:15.227059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dd9f3-bba0-4036-8986-09a3fe9e8478 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:15.229060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-6e5dd9f3-bba0-4036-8986-09a3fe9e8478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:15.234920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db9bc3-5dcc-4da8-bf9b-35b02923f768 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:15.240437 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f8d01-94e3-4a90-be5c-46b7bf237ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:15.242530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f8d01-94e3-4a90-be5c-46b7bf237ae8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:15.242823 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f8d01-94e3-4a90-be5c-46b7bf237ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:15.243169 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f8d01-94e3-4a90-be5c-46b7bf237ae8 admin admin] PATH_INFO: `/v3/users/dbb1a907aaee40de9c87dbfe96a6ebd7` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:15.244648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f8d01-94e3-4a90-be5c-46b7bf237ae8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbb1a907aaee40de9c87dbfe96a6ebd7)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:15.246601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f8d01-94e3-4a90-be5c-46b7bf237ae8 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:15.260896 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5dd9f3-bba0-4036-8986-09a3fe9e8478 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:15.269814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b11dea-fd01-436b-9b9d-d4a037055487 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e838dd9aa24f4571b64719125610c528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:15.270736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b11dea-fd01-436b-9b9d-d4a037055487 service placement] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:15.271196 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b11dea-fd01-436b-9b9d-d4a037055487 service placement] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:15.271845 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b11dea-fd01-436b-9b9d-d4a037055487 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:15.284594 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b11dea-fd01-436b-9b9d-d4a037055487 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:15.286796 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b11dea-fd01-436b-9b9d-d4a037055487 service placement] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:15.300674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1138/2273] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:13:15.536813 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-8e5f8d01-94e3-4a90-be5c-46b7bf237ae8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbb1a907aaee40de9c87dbfe96a6ebd7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:13:15.551572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-8e5f8d01-94e3-4a90-be5c-46b7bf237ae8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbb1a907aaee40de9c87dbfe96a6ebd7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:13:15.552491 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-8e5f8d01-94e3-4a90-be5c-46b7bf237ae8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbb1a907aaee40de9c87dbfe96a6ebd7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:13:15.553108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-8e5f8d01-94e3-4a90-be5c-46b7bf237ae8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbb1a907aaee40de9c87dbfe96a6ebd7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:13:15.696511 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-8e5f8d01-94e3-4a90-be5c-46b7bf237ae8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbb1a907aaee40de9c87dbfe96a6ebd7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:13:15.710198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1136/2274] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:13:15 2022] DELETE /identity/v3/users/dbb1a907aaee40de9c87dbfe96a6ebd7 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:13:16.031598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b11dea-fd01-436b-9b9d-d4a037055487 service placement] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:16.044853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b11dea-fd01-436b-9b9d-d4a037055487 service placement] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:16.059370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:16.108257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:16.113414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:16.113414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:16.113414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] PATH_INFO: `/v3/projects/83a719dd8fdc4a1a838d1da6de88fad8` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:16.113414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] RBAC: Authorizing `identity:delete_project(project_id=83a719dd8fdc4a1a838d1da6de88fad8)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:16.113414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:16.395151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83a719dd8fdc4a1a838d1da6de88fad8', 'request_id': 'req-2f909145-1a7f-46bd-9c21-bcfc4c7159db'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:13:16.401995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83a719dd8fdc4a1a838d1da6de88fad8', 'request_id': 'req-2f909145-1a7f-46bd-9c21-bcfc4c7159db'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:13:16.408729 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83a719dd8fdc4a1a838d1da6de88fad8', 'request_id': 'req-2f909145-1a7f-46bd-9c21-bcfc4c7159db'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:13:16.497306 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] The token cache is being invalidate because project 83a719dd8fdc4a1a838d1da6de88fad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:13:16.497599 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:13:16.498263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:13:16.503086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1139/2275] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:13:16 2022] DELETE /identity/v3/projects/83a719dd8fdc4a1a838d1da6de88fad8 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:13:17.703270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c49fd3-2442-450b-a641-35a76c253e0e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:17.703270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c49fd3-2442-450b-a641-35a76c253e0e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:17.703270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c49fd3-2442-450b-a641-35a76c253e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:17.723242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-48c49fd3-2442-450b-a641-35a76c253e0e None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:17.724869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-48c49fd3-2442-450b-a641-35a76c253e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:17.794520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1137/2276] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:13:17 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:13:17.801187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:17.802661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:17.896403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f909145-1a7f-46bd-9c21-bcfc4c7159db admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:17.905004 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea0b97-a539-4099-9ea4-40a9b74356e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:17.905782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea0b97-a539-4099-9ea4-40a9b74356e5 service swift] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:17.906069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea0b97-a539-4099-9ea4-40a9b74356e5 service swift] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:17.906384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea0b97-a539-4099-9ea4-40a9b74356e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:17.917914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea0b97-a539-4099-9ea4-40a9b74356e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:17.919649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea0b97-a539-4099-9ea4-40a9b74356e5 service swift] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:17.929620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1140/2277] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:13:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:13:22.303331 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e433c3-e327-4e12-a0ad-8b9ffbe0b103 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:22.305827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e433c3-e327-4e12-a0ad-8b9ffbe0b103 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:22.305827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e433c3-e327-4e12-a0ad-8b9ffbe0b103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:22.328310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-58e433c3-e327-4e12-a0ad-8b9ffbe0b103 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:22.329617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-58e433c3-e327-4e12-a0ad-8b9ffbe0b103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:22.393658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1138/2278] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Jun 23 11:13:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:13:22.527929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea0b97-a539-4099-9ea4-40a9b74356e5 service swift] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:22.527929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-eaea0b97-a539-4099-9ea4-40a9b74356e5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:22.568973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:22.602483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea0b97-a539-4099-9ea4-40a9b74356e5 service swift] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:22.608023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dbc8a8-d9e2-4ec0-b3ee-a456a58ee139 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:22.608678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbc8a8-d9e2-4ec0-b3ee-a456a58ee139 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:22.608967 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbc8a8-d9e2-4ec0-b3ee-a456a58ee139 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:22.609248 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dbc8a8-d9e2-4ec0-b3ee-a456a58ee139 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:22.618996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbc8a8-d9e2-4ec0-b3ee-a456a58ee139 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:22.620820 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dbc8a8-d9e2-4ec0-b3ee-a456a58ee139 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:22.632317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1141/2279] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:13:32.385639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:32.730406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=18 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:33.314141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e433c3-e327-4e12-a0ad-8b9ffbe0b103 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:33.315988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-58e433c3-e327-4e12-a0ad-8b9ffbe0b103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:33.413820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e433c3-e327-4e12-a0ad-8b9ffbe0b103 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:33.421772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edefbd-4c68-4ffb-99a0-652d3e4905a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e838dd9aa24f4571b64719125610c528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:33.422685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edefbd-4c68-4ffb-99a0-652d3e4905a6 service placement] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:33.423124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edefbd-4c68-4ffb-99a0-652d3e4905a6 service placement] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:33.423568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35edefbd-4c68-4ffb-99a0-652d3e4905a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:33.426862 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-35edefbd-4c68-4ffb-99a0-652d3e4905a6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:33.457831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edefbd-4c68-4ffb-99a0-652d3e4905a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:33.458942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35edefbd-4c68-4ffb-99a0-652d3e4905a6 service placement] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:33.474445 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1139/2280] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:13:34.078460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be53881-be88-4257-9efd-7a89c9ace383 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:34.078916 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be53881-be88-4257-9efd-7a89c9ace383 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:34.079027 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be53881-be88-4257-9efd-7a89c9ace383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:34.098319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-9be53881-be88-4257-9efd-7a89c9ace383 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:34.099537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9be53881-be88-4257-9efd-7a89c9ace383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:34.108251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1142/2281] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Jun 23 11:13:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:13:34.146225 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edefbd-4c68-4ffb-99a0-652d3e4905a6 service placement] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:34.162477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35edefbd-4c68-4ffb-99a0-652d3e4905a6 service placement] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:34.166131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb96fb-63fa-40c6-9bbe-dc319133c26e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:34.166861 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb96fb-63fa-40c6-9bbe-dc319133c26e service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:34.167205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb96fb-63fa-40c6-9bbe-dc319133c26e service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:34.167551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb96fb-63fa-40c6-9bbe-dc319133c26e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:34.177261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb96fb-63fa-40c6-9bbe-dc319133c26e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:34.179955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb96fb-63fa-40c6-9bbe-dc319133c26e service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:34.199473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1140/2282] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:13:36.036274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbb211-25c7-432e-9c2e-76e91fc2193b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:36.036788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbb211-25c7-432e-9c2e-76e91fc2193b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:36.036886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddbb211-25c7-432e-9c2e-76e91fc2193b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:36.056705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-1ddbb211-25c7-432e-9c2e-76e91fc2193b None None] MFA Rules not processed for user `bdc5ef02c9fd4b2888239b9b19ae4d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:36.058019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-1ddbb211-25c7-432e-9c2e-76e91fc2193b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:36.114041 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1143/2283] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:13:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:13:37.211787 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b52cd3-2112-4624-b156-44450156a550 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:37.212791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b52cd3-2112-4624-b156-44450156a550 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:37.212987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b52cd3-2112-4624-b156-44450156a550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:37.270983 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-92b52cd3-2112-4624-b156-44450156a550 None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:37.272277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-92b52cd3-2112-4624-b156-44450156a550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:37.295289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1141/2284] 10.222.0.52 () {58 vars in 967 bytes} [Thu Jun 23 11:13:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:13:37.320156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbb211-25c7-432e-9c2e-76e91fc2193b None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:37.342792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddbb211-25c7-432e-9c2e-76e91fc2193b None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:37.348005 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b2a70-b61e-46b4-baee-22ba81509211 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:37.348673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b2a70-b61e-46b4-baee-22ba81509211 service swift] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:37.348952 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b2a70-b61e-46b4-baee-22ba81509211 service swift] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:37.349223 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081b2a70-b61e-46b4-baee-22ba81509211 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:37.358877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b2a70-b61e-46b4-baee-22ba81509211 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:37.360545 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081b2a70-b61e-46b4-baee-22ba81509211 service swift] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:37.369056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1144/2285] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:13:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:13:39.398526 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7913a1-7749-4a77-9d96-c0428369af42 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:39.399115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7913a1-7749-4a77-9d96-c0428369af42 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:39.399115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7913a1-7749-4a77-9d96-c0428369af42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:39.419027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-8b7913a1-7749-4a77-9d96-c0428369af42 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:39.423701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8b7913a1-7749-4a77-9d96-c0428369af42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:39.429692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1142/2286] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Jun 23 11:13:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:13:39.456579 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b2a70-b61e-46b4-baee-22ba81509211 service swift] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:39.470009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081b2a70-b61e-46b4-baee-22ba81509211 service swift] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:39.475739 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e835650-30b8-4ac4-9994-62f43acecd7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:39.476435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e835650-30b8-4ac4-9994-62f43acecd7d service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:39.476717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e835650-30b8-4ac4-9994-62f43acecd7d service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:39.476994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e835650-30b8-4ac4-9994-62f43acecd7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:39.490578 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e835650-30b8-4ac4-9994-62f43acecd7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:39.492843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e835650-30b8-4ac4-9994-62f43acecd7d service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:39.504415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1145/2287] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:13:43.266843 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7913a1-7749-4a77-9d96-c0428369af42 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:43.269838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8b7913a1-7749-4a77-9d96-c0428369af42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:43.349803 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7913a1-7749-4a77-9d96-c0428369af42 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:43.359028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f999a6-37e4-4825-b10a-ec67c8665e16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:43.359688 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f999a6-37e4-4825-b10a-ec67c8665e16 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:43.360007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f999a6-37e4-4825-b10a-ec67c8665e16 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:43.360321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f999a6-37e4-4825-b10a-ec67c8665e16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:43.363603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-93f999a6-37e4-4825-b10a-ec67c8665e16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:43.422959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:43.443436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f999a6-37e4-4825-b10a-ec67c8665e16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:43.446229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f999a6-37e4-4825-b10a-ec67c8665e16 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:43.462303 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1143/2288] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:13:44.720509 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48935-2ce1-4802-84df-0c310c96ea28 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:44.721041 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48935-2ce1-4802-84df-0c310c96ea28 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:44.721136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c48935-2ce1-4802-84df-0c310c96ea28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:44.739921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-70c48935-2ce1-4802-84df-0c310c96ea28 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:13:44.741173 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-70c48935-2ce1-4802-84df-0c310c96ea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:13:44.749674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1146/2289] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Jun 23 11:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:13:44.774968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f999a6-37e4-4825-b10a-ec67c8665e16 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:13:44.787716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f999a6-37e4-4825-b10a-ec67c8665e16 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:13:44.794431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163260ad-1a3c-4b6f-a53f-aa3bac5c0b76 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:13:44.795081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163260ad-1a3c-4b6f-a53f-aa3bac5c0b76 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:13:44.795362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163260ad-1a3c-4b6f-a53f-aa3bac5c0b76 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:13:44.795642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163260ad-1a3c-4b6f-a53f-aa3bac5c0b76 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:13:44.805796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163260ad-1a3c-4b6f-a53f-aa3bac5c0b76 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:13:44.807511 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163260ad-1a3c-4b6f-a53f-aa3bac5c0b76 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:13:44.819216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1144/2290] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:13:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:13:54.734428 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=47 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:13:54.813350 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=15 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:14:05.228327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddf737-39f0-439c-aaf1-9875c48e95a5 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:05.228864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddf737-39f0-439c-aaf1-9875c48e95a5 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:05.228864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cddf737-39f0-439c-aaf1-9875c48e95a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:05.246702 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-8cddf737-39f0-439c-aaf1-9875c48e95a5 None None] MFA Rules not processed for user `f747e0f4444b4aefa10d1c58d674522b`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:14:05.248036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8cddf737-39f0-439c-aaf1-9875c48e95a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:14:05.303393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1147/2291] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:14:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:14:09.383858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977e860-b8d7-4f95-b518-5017eff69aa2 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:09.384730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977e860-b8d7-4f95-b518-5017eff69aa2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:09.385195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3977e860-b8d7-4f95-b518-5017eff69aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:09.434105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3977e860-b8d7-4f95-b518-5017eff69aa2 None None] MFA Rules not processed for user `1d6b0c12ebad40eaafec09b662e228c4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:14:09.436869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3977e860-b8d7-4f95-b518-5017eff69aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:14:09.496195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1145/2292] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:14:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:14:15.296593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=25 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:14:19.488956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=25 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:14:30.229620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6bc68-2f05-4798-a383-fd11136d4a08 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:30.230112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6bc68-2f05-4798-a383-fd11136d4a08 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:30.230212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a6bc68-2f05-4798-a383-fd11136d4a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:30.256758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-02a6bc68-2f05-4798-a383-fd11136d4a08 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:14:30.260642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-02a6bc68-2f05-4798-a383-fd11136d4a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:14:30.268653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1148/2293] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Jun 23 11:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:14:30.284252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977e860-b8d7-4f95-b518-5017eff69aa2 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:14:30.285791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3977e860-b8d7-4f95-b518-5017eff69aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:14:30.302710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3977e860-b8d7-4f95-b518-5017eff69aa2 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:14:30.308393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978c2137-4a6c-492a-bad9-c7239f224ccf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:14:30.316502 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c2137-4a6c-492a-bad9-c7239f224ccf service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:30.316502 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c2137-4a6c-492a-bad9-c7239f224ccf service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:30.316502 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978c2137-4a6c-492a-bad9-c7239f224ccf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:30.319367 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c2137-4a6c-492a-bad9-c7239f224ccf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:14:30.321001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978c2137-4a6c-492a-bad9-c7239f224ccf service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:14:30.336179 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1146/2294] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:14:34.116861 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13ac67-4e4c-407f-bad5-8d5da9c803f3 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:34.117378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13ac67-4e4c-407f-bad5-8d5da9c803f3 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:34.117488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13ac67-4e4c-407f-bad5-8d5da9c803f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:34.134906 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-3a13ac67-4e4c-407f-bad5-8d5da9c803f3 None None] MFA Rules not processed for user `54404c13a1cf4d4eab0082fbfdd2bc58`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:14:34.136180 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3a13ac67-4e4c-407f-bad5-8d5da9c803f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:14:34.195762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1149/2295] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:14:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:14:34.760640 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9609f-fd94-4025-910c-c50075a61f31 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:34.761201 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9609f-fd94-4025-910c-c50075a61f31 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:34.761201 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad9609f-fd94-4025-910c-c50075a61f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:34.780134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3ad9609f-fd94-4025-910c-c50075a61f31 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:14:34.783300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3ad9609f-fd94-4025-910c-c50075a61f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:14:34.789393 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1147/2296] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Jun 23 11:14:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:14:34.816033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13ac67-4e4c-407f-bad5-8d5da9c803f3 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:14:34.830158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13ac67-4e4c-407f-bad5-8d5da9c803f3 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:14:34.835924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4afaf4-390b-415d-8eeb-06bd586732f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:14:34.836577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4afaf4-390b-415d-8eeb-06bd586732f2 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:34.836865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4afaf4-390b-415d-8eeb-06bd586732f2 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:34.837146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4afaf4-390b-415d-8eeb-06bd586732f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:34.845887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4afaf4-390b-415d-8eeb-06bd586732f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:14:34.847564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4afaf4-390b-415d-8eeb-06bd586732f2 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:14:34.857610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1150/2297] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:14:38.592816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f39b0-59ad-4053-86cc-cd6e075bba93 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:38.593270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f39b0-59ad-4053-86cc-cd6e075bba93 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:38.593429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f39b0-59ad-4053-86cc-cd6e075bba93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:38.612533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-317f39b0-59ad-4053-86cc-cd6e075bba93 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:14:38.613743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-317f39b0-59ad-4053-86cc-cd6e075bba93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:14:38.621971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1148/2298] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Jun 23 11:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:14:38.637770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4afaf4-390b-415d-8eeb-06bd586732f2 service nova] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:14:38.648813 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4afaf4-390b-415d-8eeb-06bd586732f2 service nova] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:14:38.654662 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63cbf5-e8c1-4ee4-81a9-183ab1a70b3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:14:38.655313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63cbf5-e8c1-4ee4-81a9-183ab1a70b3d service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:38.656525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63cbf5-e8c1-4ee4-81a9-183ab1a70b3d service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:38.656525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe63cbf5-e8c1-4ee4-81a9-183ab1a70b3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:38.665958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63cbf5-e8c1-4ee4-81a9-183ab1a70b3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:14:38.668307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe63cbf5-e8c1-4ee4-81a9-183ab1a70b3d service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:14:38.680621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1151/2299] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:14:42.878427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208c648-0a9f-402e-be9c-d6a4934f6db6 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:42.879275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208c648-0a9f-402e-be9c-d6a4934f6db6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:42.879275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c208c648-0a9f-402e-be9c-d6a4934f6db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:42.898098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-c208c648-0a9f-402e-be9c-d6a4934f6db6 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:14:42.899368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c208c648-0a9f-402e-be9c-d6a4934f6db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:14:42.907301 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1149/2300] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Jun 23 11:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:14:42.923681 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63cbf5-e8c1-4ee4-81a9-183ab1a70b3d service nova] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:14:42.935130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe63cbf5-e8c1-4ee4-81a9-183ab1a70b3d service nova] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:14:42.941575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437a98d-cf7c-4b03-9476-2321e6abbdb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:14:42.942152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437a98d-cf7c-4b03-9476-2321e6abbdb3 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:42.942438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437a98d-cf7c-4b03-9476-2321e6abbdb3 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:42.942720 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c437a98d-cf7c-4b03-9476-2321e6abbdb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:42.951308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437a98d-cf7c-4b03-9476-2321e6abbdb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:14:42.952942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c437a98d-cf7c-4b03-9476-2321e6abbdb3 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:14:42.963130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1152/2301] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:14:48.265381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef096c-6774-4a8b-a277-7c44437a51bd None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:48.265932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef096c-6774-4a8b-a277-7c44437a51bd None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:48.266023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ef096c-6774-4a8b-a277-7c44437a51bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:48.284704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-13ef096c-6774-4a8b-a277-7c44437a51bd None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:14:48.285908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-13ef096c-6774-4a8b-a277-7c44437a51bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:14:48.293796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1150/2302] 10.222.0.23 () {58 vars in 1016 bytes} [Thu Jun 23 11:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:14:48.308892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437a98d-cf7c-4b03-9476-2321e6abbdb3 service nova] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:14:48.325887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c437a98d-cf7c-4b03-9476-2321e6abbdb3 service nova] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:14:48.332793 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a779c3-43a3-4f57-ba64-01f60a86f463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:14:48.333440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a779c3-43a3-4f57-ba64-01f60a86f463 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:48.333912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a779c3-43a3-4f57-ba64-01f60a86f463 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:48.334197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a779c3-43a3-4f57-ba64-01f60a86f463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:48.343210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a779c3-43a3-4f57-ba64-01f60a86f463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:14:48.344847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a779c3-43a3-4f57-ba64-01f60a86f463 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:14:48.356069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1153/2303] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:14:54.627354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeb5c7-5cdb-448f-a552-875c1a828fc8 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:14:54.627890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeb5c7-5cdb-448f-a552-875c1a828fc8 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:14:54.627987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aeb5c7-5cdb-448f-a552-875c1a828fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:14:54.645819 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-f2aeb5c7-5cdb-448f-a552-875c1a828fc8 None None] MFA Rules not processed for user `6617f968cd214435a1efcb401ba33e38`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:14:54.647036 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f2aeb5c7-5cdb-448f-a552-875c1a828fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:14:54.700753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1151/2304] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:14:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:14:58.350653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=52 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:04.693994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=43 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:09.141922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bb64d-ef3a-4d61-aff0-429d6004f974 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:09.142395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bb64d-ef3a-4d61-aff0-429d6004f974 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:09.142489 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22bb64d-ef3a-4d61-aff0-429d6004f974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:09.160843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b22bb64d-ef3a-4d61-aff0-429d6004f974 None None] MFA Rules not processed for user `bdc5ef02c9fd4b2888239b9b19ae4d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:15:09.162065 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b22bb64d-ef3a-4d61-aff0-429d6004f974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:09.169189 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1154/2305] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:15:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:15:17.060210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aeb5c7-5cdb-448f-a552-875c1a828fc8 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:17.061804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f2aeb5c7-5cdb-448f-a552-875c1a828fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:17.075183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aeb5c7-5cdb-448f-a552-875c1a828fc8 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:17.078994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be96709-f28e-480f-91bd-6d4c47cc5bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:17.079661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be96709-f28e-480f-91bd-6d4c47cc5bec service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:17.079982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be96709-f28e-480f-91bd-6d4c47cc5bec service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:17.080377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be96709-f28e-480f-91bd-6d4c47cc5bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:17.082790 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5be96709-f28e-480f-91bd-6d4c47cc5bec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:17.097216 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be96709-f28e-480f-91bd-6d4c47cc5bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:17.098537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be96709-f28e-480f-91bd-6d4c47cc5bec service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:17.110368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1152/2306] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:15:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:15:18.848690 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bb64d-ef3a-4d61-aff0-429d6004f974 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:18.850218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b22bb64d-ef3a-4d61-aff0-429d6004f974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:18.932672 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22bb64d-ef3a-4d61-aff0-429d6004f974 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:18.936292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52f03b-ff7b-4d2c-824e-978d0d4fc24b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:18.936935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52f03b-ff7b-4d2c-824e-978d0d4fc24b service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:18.937217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52f03b-ff7b-4d2c-824e-978d0d4fc24b service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:18.937497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52f03b-ff7b-4d2c-824e-978d0d4fc24b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:18.939577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2a52f03b-ff7b-4d2c-824e-978d0d4fc24b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:18.953244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52f03b-ff7b-4d2c-824e-978d0d4fc24b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:18.954665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52f03b-ff7b-4d2c-824e-978d0d4fc24b service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:18.966059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1155/2307] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:15:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:15:25.298523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be96709-f28e-480f-91bd-6d4c47cc5bec service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:25.300581 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5be96709-f28e-480f-91bd-6d4c47cc5bec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:25.315560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be96709-f28e-480f-91bd-6d4c47cc5bec service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:25.320290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbed1ec-068b-4c45-8e03-3d6fd7709624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:25.321168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed1ec-068b-4c45-8e03-3d6fd7709624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:25.321461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed1ec-068b-4c45-8e03-3d6fd7709624 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:25.321734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbed1ec-068b-4c45-8e03-3d6fd7709624 admin admin] PATH_INFO: `/v3/users/f747e0f4444b4aefa10d1c58d674522b` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:25.322994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbed1ec-068b-4c45-8e03-3d6fd7709624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f747e0f4444b4aefa10d1c58d674522b)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:25.325084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbed1ec-068b-4c45-8e03-3d6fd7709624 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:25.564439 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0dbed1ec-068b-4c45-8e03-3d6fd7709624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f747e0f4444b4aefa10d1c58d674522b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:25.582423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0dbed1ec-068b-4c45-8e03-3d6fd7709624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f747e0f4444b4aefa10d1c58d674522b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:25.583193 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0dbed1ec-068b-4c45-8e03-3d6fd7709624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f747e0f4444b4aefa10d1c58d674522b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:25.583983 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0dbed1ec-068b-4c45-8e03-3d6fd7709624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f747e0f4444b4aefa10d1c58d674522b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:25.691597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0dbed1ec-068b-4c45-8e03-3d6fd7709624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f747e0f4444b4aefa10d1c58d674522b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:25.708640 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1153/2308] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:15:25 2022] DELETE /identity/v3/users/f747e0f4444b4aefa10d1c58d674522b => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:15:25.939876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52f03b-ff7b-4d2c-824e-978d0d4fc24b service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:25.952107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52f03b-ff7b-4d2c-824e-978d0d4fc24b service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:26.024435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:26.025311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:26.025592 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:26.025869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094 admin admin] PATH_INFO: `/v3/projects/c42a89c05ee34a30af7d57c6c345fd24` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:26.027170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42a89c05ee34a30af7d57c6c345fd24)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:26.029168 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:26.201664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42a89c05ee34a30af7d57c6c345fd24', 'request_id': 'req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:26.208406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42a89c05ee34a30af7d57c6c345fd24', 'request_id': 'req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:26.213917 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42a89c05ee34a30af7d57c6c345fd24', 'request_id': 'req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:26.308090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094 admin admin] The token cache is being invalidate because project c42a89c05ee34a30af7d57c6c345fd24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:15:26.308381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:26.309069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7192ec2e-d2dd-4d07-bc87-8c2fc2c40094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:26.310676 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1156/2309] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:15:25 2022] DELETE /identity/v3/projects/c42a89c05ee34a30af7d57c6c345fd24 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:15:26.316584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04ed21-0375-43d9-966f-63cc1ef31c30 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:26.317065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04ed21-0375-43d9-966f-63cc1ef31c30 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:26.317158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04ed21-0375-43d9-966f-63cc1ef31c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:26.334669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-bc04ed21-0375-43d9-966f-63cc1ef31c30 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:15:26.335914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-bc04ed21-0375-43d9-966f-63cc1ef31c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:26.394970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1154/2310] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:15:26.403093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7241a-818d-4c0c-ad3a-b0602c87ec2e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:26.403388 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7241a-818d-4c0c-ad3a-b0602c87ec2e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:26.403674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7241a-818d-4c0c-ad3a-b0602c87ec2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:26.416181 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:26.422435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ded7241a-818d-4c0c-ad3a-b0602c87ec2e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:15:26.424294 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ded7241a-818d-4c0c-ad3a-b0602c87ec2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:26.432463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1157/2311] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:15:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:15:26.436715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04ed21-0375-43d9-966f-63cc1ef31c30 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:26.447469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04ed21-0375-43d9-966f-63cc1ef31c30 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:26.452252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ce981-4fba-467c-97ec-8cbf12802304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:26.452871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ce981-4fba-467c-97ec-8cbf12802304 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:26.453158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ce981-4fba-467c-97ec-8cbf12802304 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:26.453438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ce981-4fba-467c-97ec-8cbf12802304 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:26.454162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ce981-4fba-467c-97ec-8cbf12802304 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:15:26.454470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ce981-4fba-467c-97ec-8cbf12802304 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:26.456138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ce981-4fba-467c-97ec-8cbf12802304 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:26.467550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1155/2312] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:15:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:15:26.471768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7241a-818d-4c0c-ad3a-b0602c87ec2e None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:26.480850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded7241a-818d-4c0c-ad3a-b0602c87ec2e None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:26.485540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0292a7-4a69-47e1-8dc8-bf44a21ce738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:26.486784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0292a7-4a69-47e1-8dc8-bf44a21ce738 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:26.487067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0292a7-4a69-47e1-8dc8-bf44a21ce738 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:26.487341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0292a7-4a69-47e1-8dc8-bf44a21ce738 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:26.488062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0292a7-4a69-47e1-8dc8-bf44a21ce738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:26.490067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0292a7-4a69-47e1-8dc8-bf44a21ce738 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:26.588779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1158/2313] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:15:26 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:15:26.592741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ce981-4fba-467c-97ec-8cbf12802304 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:26.603293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ce981-4fba-467c-97ec-8cbf12802304 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:26.647677 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:26.661103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed6bdb-f838-4ebe-ba1a-b2567e4aeaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:26.661797 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed6bdb-f838-4ebe-ba1a-b2567e4aeaf2 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:26.662076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed6bdb-f838-4ebe-ba1a-b2567e4aeaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:26.662375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ed6bdb-f838-4ebe-ba1a-b2567e4aeaf2 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:26.663067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed6bdb-f838-4ebe-ba1a-b2567e4aeaf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:26.665100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ed6bdb-f838-4ebe-ba1a-b2567e4aeaf2 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:26.798032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1156/2314] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:15:26 2022] POST /identity/v3/users => generated 287 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:15:26.799891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0292a7-4a69-47e1-8dc8-bf44a21ce738 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:26.810641 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0292a7-4a69-47e1-8dc8-bf44a21ce738 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:26.815785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6740-a74f-4b8b-8d22-ca237c06f9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:26.816479 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6740-a74f-4b8b-8d22-ca237c06f9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:26.816762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6740-a74f-4b8b-8d22-ca237c06f9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:26.817040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e6740-a74f-4b8b-8d22-ca237c06f9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:26.817760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6740-a74f-4b8b-8d22-ca237c06f9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:26.819370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e6740-a74f-4b8b-8d22-ca237c06f9e0 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:26.830237 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1159/2315] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:15:26.834274 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed6bdb-f838-4ebe-ba1a-b2567e4aeaf2 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:26.844421 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ed6bdb-f838-4ebe-ba1a-b2567e4aeaf2 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:26.849649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e2e0e0-cd10-485b-bf72-281afe423bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:26.850315 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e0e0-cd10-485b-bf72-281afe423bbb admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:26.850594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e0e0-cd10-485b-bf72-281afe423bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:26.850864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e2e0e0-cd10-485b-bf72-281afe423bbb admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:26.851588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2e0e0-cd10-485b-bf72-281afe423bbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:26.853222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e2e0e0-cd10-485b-bf72-281afe423bbb admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:26.865979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1157/2316] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:15:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:15:26.870002 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6740-a74f-4b8b-8d22-ca237c06f9e0 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:26.882392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e6740-a74f-4b8b-8d22-ca237c06f9e0 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:26.886605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4957b-b0f5-416d-b713-136fd53e7b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:26.887592 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4957b-b0f5-416d-b713-136fd53e7b9a admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:26.887986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4957b-b0f5-416d-b713-136fd53e7b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:26.888340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4957b-b0f5-416d-b713-136fd53e7b9a admin admin] PATH_INFO: `/v3/projects/649ba0b239424b72b1bbed1e372e4905/users/f207186e394a4d1eb89451314d1e2e7e/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:26.905084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4957b-b0f5-416d-b713-136fd53e7b9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=649ba0b239424b72b1bbed1e372e4905, user_id=f207186e394a4d1eb89451314d1e2e7e, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:26.907955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4957b-b0f5-416d-b713-136fd53e7b9a admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:26.993236 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1160/2317] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:15:26 2022] PUT /identity/v3/projects/649ba0b239424b72b1bbed1e372e4905/users/f207186e394a4d1eb89451314d1e2e7e/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:15:27.002403 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87438549-7fcc-45c1-898b-e90b29f64678 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:27.002612 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87438549-7fcc-45c1-898b-e90b29f64678 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:27.002873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87438549-7fcc-45c1-898b-e90b29f64678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:27.022469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-87438549-7fcc-45c1-898b-e90b29f64678 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:15:27.023725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-87438549-7fcc-45c1-898b-e90b29f64678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:27.091529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1158/2318] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:15:27.120604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4957b-b0f5-416d-b713-136fd53e7b9a admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:27.122470 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-34a4957b-b0f5-416d-b713-136fd53e7b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:27.181712 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4957b-b0f5-416d-b713-136fd53e7b9a admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:27.185648 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c5d5b-dd3d-45fd-8fd7-307e1ae59118 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:27.186280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c5d5b-dd3d-45fd-8fd7-307e1ae59118 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:27.186569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c5d5b-dd3d-45fd-8fd7-307e1ae59118 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:27.186853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c5d5b-dd3d-45fd-8fd7-307e1ae59118 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:27.197258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c5d5b-dd3d-45fd-8fd7-307e1ae59118 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:27.198708 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c5d5b-dd3d-45fd-8fd7-307e1ae59118 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:27.209457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1161/2319] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:15:31.092691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87438549-7fcc-45c1-898b-e90b29f64678 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:31.113266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87438549-7fcc-45c1-898b-e90b29f64678 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:31.124631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dd2ce-74ca-4767-a7bb-dcb284fda72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:31.125314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dd2ce-74ca-4767-a7bb-dcb284fda72c service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:31.125955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dd2ce-74ca-4767-a7bb-dcb284fda72c service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:31.126277 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9dd2ce-74ca-4767-a7bb-dcb284fda72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:31.135252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4a9dd2ce-74ca-4767-a7bb-dcb284fda72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:31.231896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dd2ce-74ca-4767-a7bb-dcb284fda72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:31.233579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9dd2ce-74ca-4767-a7bb-dcb284fda72c service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:31.278919 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1159/2320] 10.222.0.52 () {60 vars in 1396 bytes} [Thu Jun 23 11:15:31 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3258 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:15:32.428598 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094620dd-c3a8-4388-8570-1c7996d1849e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:32.429675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094620dd-c3a8-4388-8570-1c7996d1849e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:32.430122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094620dd-c3a8-4388-8570-1c7996d1849e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:32.457698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-094620dd-c3a8-4388-8570-1c7996d1849e None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:15:32.458954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-094620dd-c3a8-4388-8570-1c7996d1849e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:32.537777 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1162/2321] 10.222.0.52 () {58 vars in 967 bytes} [Thu Jun 23 11:15:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:15:32.715331 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dd2ce-74ca-4767-a7bb-dcb284fda72c service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:32.716920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4a9dd2ce-74ca-4767-a7bb-dcb284fda72c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:32.791047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:32.809634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9dd2ce-74ca-4767-a7bb-dcb284fda72c service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:32.815449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1ef57-89a4-4bf7-a9a8-bcc892f1fb43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:32.816287 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1ef57-89a4-4bf7-a9a8-bcc892f1fb43 service swift] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:32.816644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1ef57-89a4-4bf7-a9a8-bcc892f1fb43 service swift] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:32.817002 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1ef57-89a4-4bf7-a9a8-bcc892f1fb43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:32.827330 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1ef57-89a4-4bf7-a9a8-bcc892f1fb43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:32.829159 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1ef57-89a4-4bf7-a9a8-bcc892f1fb43 service swift] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:32.841473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1160/2322] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:15:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:15:35.344801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1b021-dc03-45b8-80e3-cfeb1f6cf443 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:35.345361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1b021-dc03-45b8-80e3-cfeb1f6cf443 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:35.345443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1b021-dc03-45b8-80e3-cfeb1f6cf443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:35.383530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-3ad1b021-dc03-45b8-80e3-cfeb1f6cf443 None None] MFA Rules not processed for user `f207186e394a4d1eb89451314d1e2e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:15:35.385146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3ad1b021-dc03-45b8-80e3-cfeb1f6cf443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:35.440016 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:35.477110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1163/2323] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:15:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:15:35.482102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1ef57-89a4-4bf7-a9a8-bcc892f1fb43 service swift] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:35.502765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1ef57-89a4-4bf7-a9a8-bcc892f1fb43 service swift] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:35.515427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856f578-93a2-414f-a3df-6ec73fec2154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:35.516467 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856f578-93a2-414f-a3df-6ec73fec2154 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:35.516979 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856f578-93a2-414f-a3df-6ec73fec2154 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:35.517917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856f578-93a2-414f-a3df-6ec73fec2154 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:35.518890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856f578-93a2-414f-a3df-6ec73fec2154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:35.521315 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856f578-93a2-414f-a3df-6ec73fec2154 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:35.645819 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1161/2324] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:15:35 2022] POST /identity/v3/projects => generated 373 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:15:35.650042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1b021-dc03-45b8-80e3-cfeb1f6cf443 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:35.664283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1b021-dc03-45b8-80e3-cfeb1f6cf443 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:35.745569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c794d-cb41-40ec-9054-00d5e68e53d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:35.746941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c794d-cb41-40ec-9054-00d5e68e53d2 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:35.747348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c794d-cb41-40ec-9054-00d5e68e53d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:35.747652 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c794d-cb41-40ec-9054-00d5e68e53d2 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:35.750742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c794d-cb41-40ec-9054-00d5e68e53d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:35.750742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c794d-cb41-40ec-9054-00d5e68e53d2 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:35.852359 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1164/2325] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:15:35 2022] POST /identity/v3/users => generated 293 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:15:35.856699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856f578-93a2-414f-a3df-6ec73fec2154 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:35.867951 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856f578-93a2-414f-a3df-6ec73fec2154 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:35.872841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2092e-705d-409a-8fe9-805ddc224726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:35.873939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2092e-705d-409a-8fe9-805ddc224726 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:35.874224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2092e-705d-409a-8fe9-805ddc224726 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:35.874496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2092e-705d-409a-8fe9-805ddc224726 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:35.875217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2092e-705d-409a-8fe9-805ddc224726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:35.877387 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2092e-705d-409a-8fe9-805ddc224726 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:35.888571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1162/2326] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:15:35.899767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c794d-cb41-40ec-9054-00d5e68e53d2 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:35.910939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c794d-cb41-40ec-9054-00d5e68e53d2 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:35.915679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25033ad4-fd1e-45b1-a0af-9a35f3b8b9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:35.916684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25033ad4-fd1e-45b1-a0af-9a35f3b8b9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:35.916973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25033ad4-fd1e-45b1-a0af-9a35f3b8b9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:35.917250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25033ad4-fd1e-45b1-a0af-9a35f3b8b9c4 admin admin] PATH_INFO: `/v3/projects/5efe039d6a2b4563a26c1dcfa6c17663/users/ca5eade4bf1c4984a218500a04f1cadd/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:35.935133 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25033ad4-fd1e-45b1-a0af-9a35f3b8b9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efe039d6a2b4563a26c1dcfa6c17663, user_id=ca5eade4bf1c4984a218500a04f1cadd, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:35.937856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25033ad4-fd1e-45b1-a0af-9a35f3b8b9c4 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:36.022739 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1165/2327] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:15:35 2022] PUT /identity/v3/projects/5efe039d6a2b4563a26c1dcfa6c17663/users/ca5eade4bf1c4984a218500a04f1cadd/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:15:36.027620 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2092e-705d-409a-8fe9-805ddc224726 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:36.044350 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2092e-705d-409a-8fe9-805ddc224726 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:36.111793 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2374c5-17a5-4207-b4fa-8786861a0c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:36.112798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2374c5-17a5-4207-b4fa-8786861a0c1d admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:36.113263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2374c5-17a5-4207-b4fa-8786861a0c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:36.113718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2374c5-17a5-4207-b4fa-8786861a0c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:36.114620 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2374c5-17a5-4207-b4fa-8786861a0c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:36.116323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2374c5-17a5-4207-b4fa-8786861a0c1d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:36.130660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1163/2328] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:15:36.134736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25033ad4-fd1e-45b1-a0af-9a35f3b8b9c4 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:36.147782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25033ad4-fd1e-45b1-a0af-9a35f3b8b9c4 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:36.153190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c7415-ce1d-4c3f-8ea5-ecc2501b57b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:36.154220 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c7415-ce1d-4c3f-8ea5-ecc2501b57b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:36.154580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c7415-ce1d-4c3f-8ea5-ecc2501b57b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:36.154932 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c7415-ce1d-4c3f-8ea5-ecc2501b57b1 admin admin] PATH_INFO: `/v3/projects/5efe039d6a2b4563a26c1dcfa6c17663/users/ca5eade4bf1c4984a218500a04f1cadd/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:36.157645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c7415-ce1d-4c3f-8ea5-ecc2501b57b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5efe039d6a2b4563a26c1dcfa6c17663, user_id=ca5eade4bf1c4984a218500a04f1cadd, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:36.161584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c7415-ce1d-4c3f-8ea5-ecc2501b57b1 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:36.173514 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1166/2329] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:15:36 2022] PUT /identity/v3/projects/5efe039d6a2b4563a26c1dcfa6c17663/users/ca5eade4bf1c4984a218500a04f1cadd/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:15:44.385674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fd08f-e469-4416-8ac2-e55889595c51 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:44.386532 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fd08f-e469-4416-8ac2-e55889595c51 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:44.386949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fd08f-e469-4416-8ac2-e55889595c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:44.445314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-db1fd08f-e469-4416-8ac2-e55889595c51 None None] MFA Rules not processed for user `ca5eade4bf1c4984a218500a04f1cadd`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:15:44.447246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-db1fd08f-e469-4416-8ac2-e55889595c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:44.544191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1164/2330] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:15:44 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:15:44.556101 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c7415-ce1d-4c3f-8ea5-ecc2501b57b1 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:44.557797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-4e9c7415-ce1d-4c3f-8ea5-ecc2501b57b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:44.688188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c7415-ce1d-4c3f-8ea5-ecc2501b57b1 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:44.695450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e4605-58aa-49ab-ab9a-2cfa29ee817a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:44.696460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e4605-58aa-49ab-ab9a-2cfa29ee817a service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:44.696903 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e4605-58aa-49ab-ab9a-2cfa29ee817a service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:44.697355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0e4605-58aa-49ab-ab9a-2cfa29ee817a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:44.764151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:44.827207 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e4605-58aa-49ab-ab9a-2cfa29ee817a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:44.829142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0e4605-58aa-49ab-ab9a-2cfa29ee817a service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:44.841611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1167/2331] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:15:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:15:44.950045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fd08f-e469-4416-8ac2-e55889595c51 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:44.951485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-db1fd08f-e469-4416-8ac2-e55889595c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:44.996584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:45.028211 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fd08f-e469-4416-8ac2-e55889595c51 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:45.033432 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:45.034320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:45.034631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:45.034939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] PATH_INFO: `/v3/users/3901560256c4484497b2323aadcbe60a` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:45.036213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3901560256c4484497b2323aadcbe60a)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:45.038156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:45.120079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e4605-58aa-49ab-ab9a-2cfa29ee817a service nova] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:45.121482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0b0e4605-58aa-49ab-ab9a-2cfa29ee817a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:45.138816 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0e4605-58aa-49ab-ab9a-2cfa29ee817a service nova] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:45.145030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804cf1d-fa3b-4998-af5a-5f4ba5fdbbe8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:45.145700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804cf1d-fa3b-4998-af5a-5f4ba5fdbbe8 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:45.146043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804cf1d-fa3b-4998-af5a-5f4ba5fdbbe8 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:45.146328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8804cf1d-fa3b-4998-af5a-5f4ba5fdbbe8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:45.148831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8804cf1d-fa3b-4998-af5a-5f4ba5fdbbe8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:45.221871 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804cf1d-fa3b-4998-af5a-5f4ba5fdbbe8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:45.223697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8804cf1d-fa3b-4998-af5a-5f4ba5fdbbe8 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:45.234890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1168/2332] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:15:45 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:15:45.343574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3901560256c4484497b2323aadcbe60a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:45.370636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3901560256c4484497b2323aadcbe60a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:45.371517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3901560256c4484497b2323aadcbe60a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:45.372152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3901560256c4484497b2323aadcbe60a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:45.491024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3901560256c4484497b2323aadcbe60a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:45.509691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1165/2333] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:15:44 2022] DELETE /identity/v3/users/3901560256c4484497b2323aadcbe60a => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:15:45.801309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804cf1d-fa3b-4998-af5a-5f4ba5fdbbe8 service nova] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:45.820251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8804cf1d-fa3b-4998-af5a-5f4ba5fdbbe8 service nova] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:45.885331 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:45.886380 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:45.886732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:45.887233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] PATH_INFO: `/v3/projects/81090c9a4f4c4cf1b2438be6e36fd13b` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:45.888614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] RBAC: Authorizing `identity:delete_project(project_id=81090c9a4f4c4cf1b2438be6e36fd13b)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:45.890660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:46.083687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81090c9a4f4c4cf1b2438be6e36fd13b', 'request_id': 'req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:46.097693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81090c9a4f4c4cf1b2438be6e36fd13b', 'request_id': 'req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:46.115417 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81090c9a4f4c4cf1b2438be6e36fd13b', 'request_id': 'req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:46.217713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:46.224661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] The token cache is being invalidate because project 81090c9a4f4c4cf1b2438be6e36fd13b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:15:46.224959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:46.226402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:46.232666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:46.232866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1169/2334] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:15:45 2022] DELETE /identity/v3/projects/81090c9a4f4c4cf1b2438be6e36fd13b => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:15:46.234180 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:46.249068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171cacd7-d7b7-4087-a22d-f5c9ce883352 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:46.328720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a20da-3ea8-4f46-b9dc-4d45103ef3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:46.330121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a20da-3ea8-4f46-b9dc-4d45103ef3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:46.330608 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a20da-3ea8-4f46-b9dc-4d45103ef3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:46.331055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a20da-3ea8-4f46-b9dc-4d45103ef3a8 admin admin] PATH_INFO: `/v3/users/9e6aeb519e7049d9bf4c319a5a9972b0` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:46.333287 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a20da-3ea8-4f46-b9dc-4d45103ef3a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6aeb519e7049d9bf4c319a5a9972b0)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:46.335395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a20da-3ea8-4f46-b9dc-4d45103ef3a8 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:46.636698 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0b8a20da-3ea8-4f46-b9dc-4d45103ef3a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6aeb519e7049d9bf4c319a5a9972b0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:46.641459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:46.652857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0b8a20da-3ea8-4f46-b9dc-4d45103ef3a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6aeb519e7049d9bf4c319a5a9972b0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:46.653689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0b8a20da-3ea8-4f46-b9dc-4d45103ef3a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6aeb519e7049d9bf4c319a5a9972b0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:46.654328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0b8a20da-3ea8-4f46-b9dc-4d45103ef3a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6aeb519e7049d9bf4c319a5a9972b0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:46.724914 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0b8a20da-3ea8-4f46-b9dc-4d45103ef3a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6aeb519e7049d9bf4c319a5a9972b0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:46.744777 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1166/2335] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:15:46 2022] DELETE /identity/v3/users/9e6aeb519e7049d9bf4c319a5a9972b0 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:15:47.124138 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:47.126767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:47.142524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482658e0-3866-4a2b-9ad2-15b6c9a7e39b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:47.284423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:47.289535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:47.289535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:47.289535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] PATH_INFO: `/v3/projects/325fb866eb654386a4c415416fba4e5d` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:47.291000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=325fb866eb654386a4c415416fba4e5d)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:47.293061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:47.479409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '325fb866eb654386a4c415416fba4e5d', 'request_id': 'req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:47.489121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '325fb866eb654386a4c415416fba4e5d', 'request_id': 'req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:47.495255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '325fb866eb654386a4c415416fba4e5d', 'request_id': 'req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:47.625071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] The token cache is being invalidate because project 325fb866eb654386a4c415416fba4e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:15:47.625658 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:47.627067 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:47.629208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1170/2336] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:15:47 2022] DELETE /identity/v3/projects/325fb866eb654386a4c415416fba4e5d => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:15:48.381198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82b44a-52b9-41f8-b7c2-0d17ebb2c119 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:48.382658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82b44a-52b9-41f8-b7c2-0d17ebb2c119 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:48.383286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac82b44a-52b9-41f8-b7c2-0d17ebb2c119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:48.404217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-ac82b44a-52b9-41f8-b7c2-0d17ebb2c119 None None] MFA Rules not processed for user `f207186e394a4d1eb89451314d1e2e7e`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:15:48.405446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ac82b44a-52b9-41f8-b7c2-0d17ebb2c119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:48.475978 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1167/2337] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:15:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:15:48.906670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:48.908805 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:48.976383 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576f6c0-6d40-48ad-b241-689d4bd2ee9b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:48.980452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a7f48-aac8-4f53-8a72-7eebbb7b5a66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:48.981246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a7f48-aac8-4f53-8a72-7eebbb7b5a66 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:48.981604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a7f48-aac8-4f53-8a72-7eebbb7b5a66 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:48.981986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0a7f48-aac8-4f53-8a72-7eebbb7b5a66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:48.983946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8a0a7f48-aac8-4f53-8a72-7eebbb7b5a66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:49.028612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:49.049145 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a7f48-aac8-4f53-8a72-7eebbb7b5a66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:49.050606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0a7f48-aac8-4f53-8a72-7eebbb7b5a66 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:49.062721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1171/2338] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:15:53.170523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82b44a-52b9-41f8-b7c2-0d17ebb2c119 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:53.170523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ac82b44a-52b9-41f8-b7c2-0d17ebb2c119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:53.197780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac82b44a-52b9-41f8-b7c2-0d17ebb2c119 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:53.207300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aff8da-4dd6-40e0-bdfb-c83c6f79704d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:53.210128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff8da-4dd6-40e0-bdfb-c83c6f79704d admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:53.210414 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff8da-4dd6-40e0-bdfb-c83c6f79704d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:53.211232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aff8da-4dd6-40e0-bdfb-c83c6f79704d admin admin] PATH_INFO: `/v3/users/1d6b0c12ebad40eaafec09b662e228c4` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:53.213615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aff8da-4dd6-40e0-bdfb-c83c6f79704d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d6b0c12ebad40eaafec09b662e228c4)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:53.215984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aff8da-4dd6-40e0-bdfb-c83c6f79704d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:53.459083 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-73aff8da-4dd6-40e0-bdfb-c83c6f79704d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d6b0c12ebad40eaafec09b662e228c4'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:53.472529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-73aff8da-4dd6-40e0-bdfb-c83c6f79704d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d6b0c12ebad40eaafec09b662e228c4'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:53.473290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-73aff8da-4dd6-40e0-bdfb-c83c6f79704d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d6b0c12ebad40eaafec09b662e228c4'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:53.473934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-73aff8da-4dd6-40e0-bdfb-c83c6f79704d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d6b0c12ebad40eaafec09b662e228c4'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:53.562536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-73aff8da-4dd6-40e0-bdfb-c83c6f79704d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d6b0c12ebad40eaafec09b662e228c4'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:53.576234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1168/2339] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:15:53 2022] DELETE /identity/v3/users/1d6b0c12ebad40eaafec09b662e228c4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:15:53.822517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a7f48-aac8-4f53-8a72-7eebbb7b5a66 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:53.833574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0a7f48-aac8-4f53-8a72-7eebbb7b5a66 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:53.899384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0921546b-2adf-4856-bf88-c4ff6bbc62ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:53.900286 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921546b-2adf-4856-bf88-c4ff6bbc62ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:53.900569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921546b-2adf-4856-bf88-c4ff6bbc62ea admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:53.900851 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0921546b-2adf-4856-bf88-c4ff6bbc62ea admin admin] PATH_INFO: `/v3/projects/2774759dc4b741518d5bbb7a50e1e50d` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:53.902074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921546b-2adf-4856-bf88-c4ff6bbc62ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=2774759dc4b741518d5bbb7a50e1e50d)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:53.904023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0921546b-2adf-4856-bf88-c4ff6bbc62ea admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:54.015114 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-0921546b-2adf-4856-bf88-c4ff6bbc62ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2774759dc4b741518d5bbb7a50e1e50d', 'request_id': 'req-0921546b-2adf-4856-bf88-c4ff6bbc62ea'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:54.022303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-0921546b-2adf-4856-bf88-c4ff6bbc62ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2774759dc4b741518d5bbb7a50e1e50d', 'request_id': 'req-0921546b-2adf-4856-bf88-c4ff6bbc62ea'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:54.028869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-0921546b-2adf-4856-bf88-c4ff6bbc62ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2774759dc4b741518d5bbb7a50e1e50d', 'request_id': 'req-0921546b-2adf-4856-bf88-c4ff6bbc62ea'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:54.128536 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-0921546b-2adf-4856-bf88-c4ff6bbc62ea admin admin] The token cache is being invalidate because project 2774759dc4b741518d5bbb7a50e1e50d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:15:54.128831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-0921546b-2adf-4856-bf88-c4ff6bbc62ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:54.129475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-0921546b-2adf-4856-bf88-c4ff6bbc62ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:15:54.131101 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1172/2340] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:15:53 2022] DELETE /identity/v3/projects/2774759dc4b741518d5bbb7a50e1e50d => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:15:54.136190 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb715-c7d8-4b5d-bb0e-e30674ec61ad None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:54.136504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb715-c7d8-4b5d-bb0e-e30674ec61ad None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:54.136782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb715-c7d8-4b5d-bb0e-e30674ec61ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:54.155641 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-c14eb715-c7d8-4b5d-bb0e-e30674ec61ad None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:15:54.156902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c14eb715-c7d8-4b5d-bb0e-e30674ec61ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:54.202752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:54.222865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1169/2341] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:15:54.231137 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d76e5-ce5c-4420-9ba8-76b2ca6ca8dd None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:54.231444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d76e5-ce5c-4420-9ba8-76b2ca6ca8dd None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:54.231777 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5d76e5-ce5c-4420-9ba8-76b2ca6ca8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:54.252485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-cb5d76e5-ce5c-4420-9ba8-76b2ca6ca8dd None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:15:54.253704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-cb5d76e5-ce5c-4420-9ba8-76b2ca6ca8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:54.261671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1173/2342] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:15:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:15:54.270002 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eb715-c7d8-4b5d-bb0e-e30674ec61ad None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:54.276910 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eb715-c7d8-4b5d-bb0e-e30674ec61ad None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:54.282105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450758c7-44b2-46b2-8903-89be00b81276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:54.282975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450758c7-44b2-46b2-8903-89be00b81276 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:54.283096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450758c7-44b2-46b2-8903-89be00b81276 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:54.283402 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450758c7-44b2-46b2-8903-89be00b81276 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:54.284215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450758c7-44b2-46b2-8903-89be00b81276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:15:54.284457 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450758c7-44b2-46b2-8903-89be00b81276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:54.286082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450758c7-44b2-46b2-8903-89be00b81276 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:54.300568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1170/2343] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:15:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:15:54.305398 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d76e5-ce5c-4420-9ba8-76b2ca6ca8dd None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:54.317135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5d76e5-ce5c-4420-9ba8-76b2ca6ca8dd None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:54.322603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731a2d1-868f-4440-ac1d-4fd9f87da6cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:54.323302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731a2d1-868f-4440-ac1d-4fd9f87da6cb admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:54.323585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731a2d1-868f-4440-ac1d-4fd9f87da6cb admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:54.323896 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731a2d1-868f-4440-ac1d-4fd9f87da6cb admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:54.324609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731a2d1-868f-4440-ac1d-4fd9f87da6cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:54.326697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731a2d1-868f-4440-ac1d-4fd9f87da6cb admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:54.427607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1174/2344] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:15:54 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:15:54.432254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450758c7-44b2-46b2-8903-89be00b81276 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:54.443705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450758c7-44b2-46b2-8903-89be00b81276 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:54.508023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d21178-578d-414a-bea1-9972ed6d8a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:54.508770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d21178-578d-414a-bea1-9972ed6d8a26 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:54.509593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d21178-578d-414a-bea1-9972ed6d8a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:54.509593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d21178-578d-414a-bea1-9972ed6d8a26 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:54.510174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d21178-578d-414a-bea1-9972ed6d8a26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:54.512435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d21178-578d-414a-bea1-9972ed6d8a26 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:54.637432 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1171/2345] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:15:54 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:15:54.641482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731a2d1-868f-4440-ac1d-4fd9f87da6cb admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:54.651784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731a2d1-868f-4440-ac1d-4fd9f87da6cb admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:54.656341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff784c-2b96-4c45-9bcf-1cb4888aa33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:54.658271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff784c-2b96-4c45-9bcf-1cb4888aa33a admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:54.658271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff784c-2b96-4c45-9bcf-1cb4888aa33a admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:54.658271 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ff784c-2b96-4c45-9bcf-1cb4888aa33a admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:54.658716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff784c-2b96-4c45-9bcf-1cb4888aa33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:54.660333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ff784c-2b96-4c45-9bcf-1cb4888aa33a admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:54.670645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1175/2346] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:15:54.675225 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d21178-578d-414a-bea1-9972ed6d8a26 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:54.686065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d21178-578d-414a-bea1-9972ed6d8a26 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:54.691275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5d0f62-8286-410b-bfc1-447a79f9fbf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:54.691983 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d0f62-8286-410b-bfc1-447a79f9fbf2 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:54.692263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d0f62-8286-410b-bfc1-447a79f9fbf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:54.692538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5d0f62-8286-410b-bfc1-447a79f9fbf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:54.693259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d0f62-8286-410b-bfc1-447a79f9fbf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:54.694870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5d0f62-8286-410b-bfc1-447a79f9fbf2 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:54.705323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1172/2347] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:15:54.709620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff784c-2b96-4c45-9bcf-1cb4888aa33a admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:54.719934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ff784c-2b96-4c45-9bcf-1cb4888aa33a admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:54.724397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcf746-0c29-40bd-b81b-5c35ac125d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:54.725255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcf746-0c29-40bd-b81b-5c35ac125d6d admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:54.725534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcf746-0c29-40bd-b81b-5c35ac125d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:54.725833 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabcf746-0c29-40bd-b81b-5c35ac125d6d admin admin] PATH_INFO: `/v3/projects/dd885c3e48c14a9095dff16b93b4a883/users/ae48eb907feb4ce0a14f116dc145e35a/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:54.742569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcf746-0c29-40bd-b81b-5c35ac125d6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd885c3e48c14a9095dff16b93b4a883, user_id=ae48eb907feb4ce0a14f116dc145e35a, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:54.745311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabcf746-0c29-40bd-b81b-5c35ac125d6d admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:54.843901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1176/2348] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:15:54 2022] PUT /identity/v3/projects/dd885c3e48c14a9095dff16b93b4a883/users/ae48eb907feb4ce0a14f116dc145e35a/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:15:54.854601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d535d-74b0-4015-817f-fa8a5acac99f None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:54.854895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d535d-74b0-4015-817f-fa8a5acac99f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:54.855376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888d535d-74b0-4015-817f-fa8a5acac99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:54.885724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-888d535d-74b0-4015-817f-fa8a5acac99f None None] MFA Rules not processed for user `ae48eb907feb4ce0a14f116dc145e35a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:15:54.886960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-888d535d-74b0-4015-817f-fa8a5acac99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:54.956601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1173/2349] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:15:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:15:54.968111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcf746-0c29-40bd-b81b-5c35ac125d6d admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:54.970501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-cabcf746-0c29-40bd-b81b-5c35ac125d6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:54.977021 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:55.048293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabcf746-0c29-40bd-b81b-5c35ac125d6d admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:55.054128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc544ee-a252-4077-babe-3d3e94c5d66d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:55.054800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc544ee-a252-4077-babe-3d3e94c5d66d service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:55.055098 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc544ee-a252-4077-babe-3d3e94c5d66d service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:55.055382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc544ee-a252-4077-babe-3d3e94c5d66d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:55.064386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc544ee-a252-4077-babe-3d3e94c5d66d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:55.065997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc544ee-a252-4077-babe-3d3e94c5d66d service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:55.075688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1177/2350] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:15:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:15:59.543438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d535d-74b0-4015-817f-fa8a5acac99f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:15:59.545463 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-888d535d-74b0-4015-817f-fa8a5acac99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:59.564933 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888d535d-74b0-4015-817f-fa8a5acac99f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:15:59.579078 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045169eb-dd45-4d58-b6f4-cb411bec4216 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:15:59.580754 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045169eb-dd45-4d58-b6f4-cb411bec4216 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:15:59.581188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045169eb-dd45-4d58-b6f4-cb411bec4216 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:15:59.581634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045169eb-dd45-4d58-b6f4-cb411bec4216 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:15:59.585167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-045169eb-dd45-4d58-b6f4-cb411bec4216 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:15:59.631767 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:15:59.650709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045169eb-dd45-4d58-b6f4-cb411bec4216 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:15:59.652470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045169eb-dd45-4d58-b6f4-cb411bec4216 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:15:59.663074 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1174/2351] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:15:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:01.845668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953df94-84f4-40a8-95e8-848871aa8aea None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:01.846704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953df94-84f4-40a8-95e8-848871aa8aea None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:01.846900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f953df94-84f4-40a8-95e8-848871aa8aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:01.865759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-f953df94-84f4-40a8-95e8-848871aa8aea None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:01.870054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f953df94-84f4-40a8-95e8-848871aa8aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:01.932447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1178/2352] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:16:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:01.948607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045169eb-dd45-4d58-b6f4-cb411bec4216 service nova] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:01.948607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-045169eb-dd45-4d58-b6f4-cb411bec4216 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:02.026214 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045169eb-dd45-4d58-b6f4-cb411bec4216 service nova] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:02.031629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32931940-17d6-42b8-94c4-65b124d36545 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:02.032425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931940-17d6-42b8-94c4-65b124d36545 service swift] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:02.032603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931940-17d6-42b8-94c4-65b124d36545 service swift] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:02.032916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32931940-17d6-42b8-94c4-65b124d36545 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:02.042491 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32931940-17d6-42b8-94c4-65b124d36545 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:02.044143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32931940-17d6-42b8-94c4-65b124d36545 service swift] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:02.053747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1175/2353] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:16:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:16:02.441399 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953df94-84f4-40a8-95e8-848871aa8aea None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:02.534233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f953df94-84f4-40a8-95e8-848871aa8aea None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:02.541638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:02.542531 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:02.542823 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:02.543186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] PATH_INFO: `/v3/users/ae48eb907feb4ce0a14f116dc145e35a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:02.544386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae48eb907feb4ce0a14f116dc145e35a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:02.546656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:02.781361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:02.795898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae48eb907feb4ce0a14f116dc145e35a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:02.796569 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae48eb907feb4ce0a14f116dc145e35a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:02.797258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae48eb907feb4ce0a14f116dc145e35a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:02.877940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae48eb907feb4ce0a14f116dc145e35a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:02.890600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae48eb907feb4ce0a14f116dc145e35a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:02.926779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1179/2354] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:16:02 2022] DELETE /identity/v3/users/ae48eb907feb4ce0a14f116dc145e35a => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:02.931568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df9310-09ae-4ba1-a776-371c93e236ae None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:02.931744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df9310-09ae-4ba1-a776-371c93e236ae None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:02.932101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54df9310-09ae-4ba1-a776-371c93e236ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:02.953705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-54df9310-09ae-4ba1-a776-371c93e236ae None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:02.955126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-54df9310-09ae-4ba1-a776-371c93e236ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:03.042717 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1176/2355] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:03.053800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:03.055870 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:03.125034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c723cf12-6d75-4c2c-a6ee-ad96483398b8 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:03.129288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e5b66-3c67-4493-b1f4-12bc650e859c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:03.129939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e5b66-3c67-4493-b1f4-12bc650e859c service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:03.130224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e5b66-3c67-4493-b1f4-12bc650e859c service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:03.130502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e5b66-3c67-4493-b1f4-12bc650e859c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:03.140061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e5b66-3c67-4493-b1f4-12bc650e859c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:03.145402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e5b66-3c67-4493-b1f4-12bc650e859c service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:03.151464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1180/2356] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:03.759026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df9310-09ae-4ba1-a776-371c93e236ae None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:03.760875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-54df9310-09ae-4ba1-a776-371c93e236ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:03.794320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54df9310-09ae-4ba1-a776-371c93e236ae None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:03.802398 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1758b4-2c21-46a9-9e69-b0754d78a656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:03.803573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1758b4-2c21-46a9-9e69-b0754d78a656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:03.804523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1758b4-2c21-46a9-9e69-b0754d78a656 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:03.805028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1758b4-2c21-46a9-9e69-b0754d78a656 admin admin] PATH_INFO: `/v3/projects/dd885c3e48c14a9095dff16b93b4a883` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:03.809015 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1758b4-2c21-46a9-9e69-b0754d78a656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd885c3e48c14a9095dff16b93b4a883)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:03.813645 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1758b4-2c21-46a9-9e69-b0754d78a656 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:04.048113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-bd1758b4-2c21-46a9-9e69-b0754d78a656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd885c3e48c14a9095dff16b93b4a883', 'request_id': 'req-bd1758b4-2c21-46a9-9e69-b0754d78a656'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:04.068233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-bd1758b4-2c21-46a9-9e69-b0754d78a656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd885c3e48c14a9095dff16b93b4a883', 'request_id': 'req-bd1758b4-2c21-46a9-9e69-b0754d78a656'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:04.091433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-bd1758b4-2c21-46a9-9e69-b0754d78a656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd885c3e48c14a9095dff16b93b4a883', 'request_id': 'req-bd1758b4-2c21-46a9-9e69-b0754d78a656'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:04.098083 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:04.212661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-bd1758b4-2c21-46a9-9e69-b0754d78a656 admin admin] The token cache is being invalidate because project dd885c3e48c14a9095dff16b93b4a883 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:16:04.213065 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-bd1758b4-2c21-46a9-9e69-b0754d78a656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:04.213832 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-bd1758b4-2c21-46a9-9e69-b0754d78a656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:04.218901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1177/2357] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:16:03 2022] DELETE /identity/v3/projects/dd885c3e48c14a9095dff16b93b4a883 => generated 0 bytes in 457 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:04.221463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5388c-13bc-4cc0-9ed6-555b1d016b0f None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:04.222456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5388c-13bc-4cc0-9ed6-555b1d016b0f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:04.222795 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd5388c-13bc-4cc0-9ed6-555b1d016b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:04.245169 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-bdd5388c-13bc-4cc0-9ed6-555b1d016b0f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:04.246447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-bdd5388c-13bc-4cc0-9ed6-555b1d016b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:04.330929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1181/2358] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:04.346441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676af8f4-5314-485d-9132-e212882c8379 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:04.349428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676af8f4-5314-485d-9132-e212882c8379 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:04.350093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676af8f4-5314-485d-9132-e212882c8379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:04.386024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-676af8f4-5314-485d-9132-e212882c8379 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:04.387282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-676af8f4-5314-485d-9132-e212882c8379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:04.400538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1178/2359] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:04.401812 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5388c-13bc-4cc0-9ed6-555b1d016b0f None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:04.413898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd5388c-13bc-4cc0-9ed6-555b1d016b0f None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:04.419190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6317-cd6f-4e20-8490-ef2894bdf6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:04.420032 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6317-cd6f-4e20-8490-ef2894bdf6c5 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:04.420392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6317-cd6f-4e20-8490-ef2894bdf6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:04.420741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a6317-cd6f-4e20-8490-ef2894bdf6c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:04.421560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a6317-cd6f-4e20-8490-ef2894bdf6c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:16:04.421963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a6317-cd6f-4e20-8490-ef2894bdf6c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:04.423692 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a6317-cd6f-4e20-8490-ef2894bdf6c5 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:04.444758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1182/2360] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:16:04.448532 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676af8f4-5314-485d-9132-e212882c8379 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:04.461782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676af8f4-5314-485d-9132-e212882c8379 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:04.464276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05963c0-37ad-4d3a-8a13-33a7f03485b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:04.465117 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05963c0-37ad-4d3a-8a13-33a7f03485b8 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:04.465588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05963c0-37ad-4d3a-8a13-33a7f03485b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:04.470246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05963c0-37ad-4d3a-8a13-33a7f03485b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:04.472571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05963c0-37ad-4d3a-8a13-33a7f03485b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:04.473963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6317-cd6f-4e20-8490-ef2894bdf6c5 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:04.475086 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05963c0-37ad-4d3a-8a13-33a7f03485b8 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:04.476775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-214a6317-cd6f-4e20-8490-ef2894bdf6c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:04.544054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:04.560902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a6317-cd6f-4e20-8490-ef2894bdf6c5 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:04.568226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df411c10-f11e-421f-adc3-5596adc1408e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:04.569380 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df411c10-f11e-421f-adc3-5596adc1408e service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:04.574727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df411c10-f11e-421f-adc3-5596adc1408e service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:04.574727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df411c10-f11e-421f-adc3-5596adc1408e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:04.574934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1179/2361] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:16:04 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:16:04.575517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05963c0-37ad-4d3a-8a13-33a7f03485b8 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:04.579082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-df411c10-f11e-421f-adc3-5596adc1408e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:04.601734 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df411c10-f11e-421f-adc3-5596adc1408e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:04.606008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df411c10-f11e-421f-adc3-5596adc1408e service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:04.630088 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1183/2362] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:04 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:16:04.742399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05963c0-37ad-4d3a-8a13-33a7f03485b8 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:04.749645 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527aad33-f11b-48ae-b663-e4f4feae9836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:04.750496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aad33-f11b-48ae-b663-e4f4feae9836 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:04.750885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aad33-f11b-48ae-b663-e4f4feae9836 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:04.751266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527aad33-f11b-48ae-b663-e4f4feae9836 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:04.752690 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aad33-f11b-48ae-b663-e4f4feae9836 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:04.754756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527aad33-f11b-48ae-b663-e4f4feae9836 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:04.886056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1180/2363] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:16:04 2022] POST /identity/v3/users => generated 292 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:04.887337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df411c10-f11e-421f-adc3-5596adc1408e service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:04.912589 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df411c10-f11e-421f-adc3-5596adc1408e service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:04.917236 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe84eb7-6756-4f2e-8352-f9b998ff2b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:04.917633 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe84eb7-6756-4f2e-8352-f9b998ff2b08 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:04.917920 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe84eb7-6756-4f2e-8352-f9b998ff2b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:04.918197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe84eb7-6756-4f2e-8352-f9b998ff2b08 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:04.919090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe84eb7-6756-4f2e-8352-f9b998ff2b08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:04.920808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe84eb7-6756-4f2e-8352-f9b998ff2b08 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:04.939092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1184/2364] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:04.941386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527aad33-f11b-48ae-b663-e4f4feae9836 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:04.954419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527aad33-f11b-48ae-b663-e4f4feae9836 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:04.960679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47fadd9-9412-4bc9-b82d-c3daf065f67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:04.961569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fadd9-9412-4bc9-b82d-c3daf065f67c admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:04.964679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fadd9-9412-4bc9-b82d-c3daf065f67c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:04.964679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fadd9-9412-4bc9-b82d-c3daf065f67c admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:04.964679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fadd9-9412-4bc9-b82d-c3daf065f67c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:04.965016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47fadd9-9412-4bc9-b82d-c3daf065f67c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:04.988461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1181/2365] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:04.989412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe84eb7-6756-4f2e-8352-f9b998ff2b08 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:05.000829 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe84eb7-6756-4f2e-8352-f9b998ff2b08 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:05.006139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c7e68-8227-41e3-8cec-ed7248d38875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:05.007036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c7e68-8227-41e3-8cec-ed7248d38875 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:05.007323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c7e68-8227-41e3-8cec-ed7248d38875 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:05.007605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4c7e68-8227-41e3-8cec-ed7248d38875 admin admin] PATH_INFO: `/v3/projects/9b52076fafba4f4fa4abdb4d968f07ec/users/816a4bc6862343f3bf0b0fab476e316a/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:05.030764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c7e68-8227-41e3-8cec-ed7248d38875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b52076fafba4f4fa4abdb4d968f07ec, user_id=816a4bc6862343f3bf0b0fab476e316a, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:05.034205 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4c7e68-8227-41e3-8cec-ed7248d38875 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:05.138442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1185/2366] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:16:04 2022] PUT /identity/v3/projects/9b52076fafba4f4fa4abdb4d968f07ec/users/816a4bc6862343f3bf0b0fab476e316a/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:05.140524 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c80add-b523-4b84-94e6-4294e0152fc1 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:05.140995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c80add-b523-4b84-94e6-4294e0152fc1 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:05.141076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c80add-b523-4b84-94e6-4294e0152fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:05.178604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-f0c80add-b523-4b84-94e6-4294e0152fc1 None None] MFA Rules not processed for user `816a4bc6862343f3bf0b0fab476e316a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:05.180659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f0c80add-b523-4b84-94e6-4294e0152fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:05.294535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1182/2367] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:05.299289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c7e68-8227-41e3-8cec-ed7248d38875 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:05.372638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4c7e68-8227-41e3-8cec-ed7248d38875 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:05.377371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ccc45-621b-4ccc-9010-765c4a28a88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:05.378028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ccc45-621b-4ccc-9010-765c4a28a88c admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:05.378315 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ccc45-621b-4ccc-9010-765c4a28a88c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:05.378596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0ccc45-621b-4ccc-9010-765c4a28a88c admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:05.379335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ccc45-621b-4ccc-9010-765c4a28a88c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:05.381409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0ccc45-621b-4ccc-9010-765c4a28a88c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:05.881327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1186/2368] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:16:05 2022] POST /identity/v3/projects => generated 383 bytes in 582 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:05.885377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c80add-b523-4b84-94e6-4294e0152fc1 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:05.897283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c80add-b523-4b84-94e6-4294e0152fc1 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:05.928731 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:05.962274 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d78d8d-3f7d-4bdf-9e73-6107a7bbf785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:05.962876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d78d8d-3f7d-4bdf-9e73-6107a7bbf785 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:05.963479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d78d8d-3f7d-4bdf-9e73-6107a7bbf785 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:05.963659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d78d8d-3f7d-4bdf-9e73-6107a7bbf785 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:05.964396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d78d8d-3f7d-4bdf-9e73-6107a7bbf785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:05.966423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d78d8d-3f7d-4bdf-9e73-6107a7bbf785 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:06.133724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1183/2369] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:16:05 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:06.136076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ccc45-621b-4ccc-9010-765c4a28a88c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:06.139707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d78d8d-3f7d-4bdf-9e73-6107a7bbf785 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:06.148406 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-52d78d8d-3f7d-4bdf-9e73-6107a7bbf785 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:06.151430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0ccc45-621b-4ccc-9010-765c4a28a88c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:06.159531 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ffe4d-3e2a-430e-b95f-cd9a6a07a3f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:06.161495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ffe4d-3e2a-430e-b95f-cd9a6a07a3f1 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:06.162012 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ffe4d-3e2a-430e-b95f-cd9a6a07a3f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:06.162551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24ffe4d-3e2a-430e-b95f-cd9a6a07a3f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:06.163651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ffe4d-3e2a-430e-b95f-cd9a6a07a3f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:06.165597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24ffe4d-3e2a-430e-b95f-cd9a6a07a3f1 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:06.182204 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1187/2370] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:06.192999 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ffe4d-3e2a-430e-b95f-cd9a6a07a3f1 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:06.216627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24ffe4d-3e2a-430e-b95f-cd9a6a07a3f1 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:06.220285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1309d4-f3b1-4321-b673-4db38fd6b2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:06.221788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1309d4-f3b1-4321-b673-4db38fd6b2f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:06.222057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1309d4-f3b1-4321-b673-4db38fd6b2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:06.222340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1309d4-f3b1-4321-b673-4db38fd6b2f6 admin admin] PATH_INFO: `/v3/projects/0819af7e525a426fb267b43f9af688b2/users/3e50f62f6da64e8faacdb717a3e19f16/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:06.257943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1309d4-f3b1-4321-b673-4db38fd6b2f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0819af7e525a426fb267b43f9af688b2, user_id=3e50f62f6da64e8faacdb717a3e19f16, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:06.258173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d78d8d-3f7d-4bdf-9e73-6107a7bbf785 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:06.260733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1309d4-f3b1-4321-b673-4db38fd6b2f6 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:06.266765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a5bf8-1387-4fda-a8c4-d7b4bd2bac31 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e838dd9aa24f4571b64719125610c528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:06.268007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a5bf8-1387-4fda-a8c4-d7b4bd2bac31 service placement] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:06.268298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a5bf8-1387-4fda-a8c4-d7b4bd2bac31 service placement] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:06.268575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0a5bf8-1387-4fda-a8c4-d7b4bd2bac31 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:06.271175 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8c0a5bf8-1387-4fda-a8c4-d7b4bd2bac31 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:06.290302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a5bf8-1387-4fda-a8c4-d7b4bd2bac31 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:06.291506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0a5bf8-1387-4fda-a8c4-d7b4bd2bac31 service placement] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:06.315864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1184/2371] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:06.373528 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a5bf8-1387-4fda-a8c4-d7b4bd2bac31 service placement] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:06.376024 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1188/2372] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:16:06 2022] PUT /identity/v3/projects/0819af7e525a426fb267b43f9af688b2/users/3e50f62f6da64e8faacdb717a3e19f16/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:06.394660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0a5bf8-1387-4fda-a8c4-d7b4bd2bac31 service placement] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:06.492471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4f06e-7f5c-40b2-af3b-762d5e1e7c06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:06.493273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4f06e-7f5c-40b2-af3b-762d5e1e7c06 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:06.493429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4f06e-7f5c-40b2-af3b-762d5e1e7c06 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:06.493970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4f06e-7f5c-40b2-af3b-762d5e1e7c06 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:06.494906 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4f06e-7f5c-40b2-af3b-762d5e1e7c06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:06.497230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4f06e-7f5c-40b2-af3b-762d5e1e7c06 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:06.519853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1185/2373] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:16:06.523629 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1309d4-f3b1-4321-b673-4db38fd6b2f6 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:06.537680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1309d4-f3b1-4321-b673-4db38fd6b2f6 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:06.546183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f007c58-2490-4745-9a44-5acad5a75d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:06.547086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007c58-2490-4745-9a44-5acad5a75d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:06.547376 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007c58-2490-4745-9a44-5acad5a75d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:06.547643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007c58-2490-4745-9a44-5acad5a75d0b admin admin] PATH_INFO: `/v3/projects/0819af7e525a426fb267b43f9af688b2/users/3e50f62f6da64e8faacdb717a3e19f16/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:06.550300 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f007c58-2490-4745-9a44-5acad5a75d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0819af7e525a426fb267b43f9af688b2, user_id=3e50f62f6da64e8faacdb717a3e19f16, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:06.553020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f007c58-2490-4745-9a44-5acad5a75d0b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:06.582358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a51ca-7cca-492c-99b2-72b510acd748 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:06.582671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a51ca-7cca-492c-99b2-72b510acd748 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:06.582955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a51ca-7cca-492c-99b2-72b510acd748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:06.584412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1189/2374] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:16:06 2022] PUT /identity/v3/projects/0819af7e525a426fb267b43f9af688b2/users/3e50f62f6da64e8faacdb717a3e19f16/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:16:06.621454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-543a51ca-7cca-492c-99b2-72b510acd748 None None] MFA Rules not processed for user `3e50f62f6da64e8faacdb717a3e19f16`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:06.622964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-543a51ca-7cca-492c-99b2-72b510acd748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:06.683552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:06.726564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1186/2375] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:06.741631 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f007c58-2490-4745-9a44-5acad5a75d0b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:06.744789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2f007c58-2490-4745-9a44-5acad5a75d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:06.847251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:06.854936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f007c58-2490-4745-9a44-5acad5a75d0b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:06.865552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532806f-3db4-4fc4-9c3f-67a4940f4c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:06.869212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532806f-3db4-4fc4-9c3f-67a4940f4c78 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:06.869212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532806f-3db4-4fc4-9c3f-67a4940f4c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:06.869212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f532806f-3db4-4fc4-9c3f-67a4940f4c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:06.887119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532806f-3db4-4fc4-9c3f-67a4940f4c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:06.887119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f532806f-3db4-4fc4-9c3f-67a4940f4c78 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:06.906574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1190/2376] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:06 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:16:07.088297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a51ca-7cca-492c-99b2-72b510acd748 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:07.090038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-543a51ca-7cca-492c-99b2-72b510acd748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:07.121633 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a51ca-7cca-492c-99b2-72b510acd748 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:07.126036 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306d3fd-565c-43d1-b501-9448077ad8f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:07.126515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306d3fd-565c-43d1-b501-9448077ad8f8 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:07.126806 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306d3fd-565c-43d1-b501-9448077ad8f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:07.132759 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306d3fd-565c-43d1-b501-9448077ad8f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:07.237045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306d3fd-565c-43d1-b501-9448077ad8f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:07.238687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306d3fd-565c-43d1-b501-9448077ad8f8 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:07.253604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1187/2377] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:07.932974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532806f-3db4-4fc4-9c3f-67a4940f4c78 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:08.008632 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f532806f-3db4-4fc4-9c3f-67a4940f4c78 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:08.023439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:08.025677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:08.025960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:08.028272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] PATH_INFO: `/v3/users/816a4bc6862343f3bf0b0fab476e316a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:08.031296 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=816a4bc6862343f3bf0b0fab476e316a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:08.033603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:08.252490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '816a4bc6862343f3bf0b0fab476e316a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:08.253235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '816a4bc6862343f3bf0b0fab476e316a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:08.253966 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '816a4bc6862343f3bf0b0fab476e316a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:08.363721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '816a4bc6862343f3bf0b0fab476e316a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:08.378469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '816a4bc6862343f3bf0b0fab476e316a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:08.428449 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1191/2378] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:16:07 2022] DELETE /identity/v3/users/816a4bc6862343f3bf0b0fab476e316a => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:08.435388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4606fb-0ab4-44d0-9a5e-52d370269277 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:08.435388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4606fb-0ab4-44d0-9a5e-52d370269277 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:08.435388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4606fb-0ab4-44d0-9a5e-52d370269277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:08.459671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-be4606fb-0ab4-44d0-9a5e-52d370269277 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:08.461179 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-be4606fb-0ab4-44d0-9a5e-52d370269277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:08.553434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1188/2379] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:08.563626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:08.565109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:08.650191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8b625-b99b-4c12-a5a5-928314356ddc admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:08.654829 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa159a-b0c6-4cf3-859c-b7bd1cc3dba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:08.655475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa159a-b0c6-4cf3-859c-b7bd1cc3dba2 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:08.655777 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa159a-b0c6-4cf3-859c-b7bd1cc3dba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:08.656116 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa159a-b0c6-4cf3-859c-b7bd1cc3dba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:08.667052 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa159a-b0c6-4cf3-859c-b7bd1cc3dba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:08.669739 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa159a-b0c6-4cf3-859c-b7bd1cc3dba2 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:08.681930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1192/2380] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:09.499852 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4606fb-0ab4-44d0-9a5e-52d370269277 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:09.501813 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-be4606fb-0ab4-44d0-9a5e-52d370269277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:09.515988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4606fb-0ab4-44d0-9a5e-52d370269277 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:09.522339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:09.523312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:09.523645 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:09.523964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] PATH_INFO: `/v3/projects/9b52076fafba4f4fa4abdb4d968f07ec` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:09.525418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b52076fafba4f4fa4abdb4d968f07ec)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:09.528270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:09.703853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b52076fafba4f4fa4abdb4d968f07ec', 'request_id': 'req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:09.711580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b52076fafba4f4fa4abdb4d968f07ec', 'request_id': 'req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:09.721857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b52076fafba4f4fa4abdb4d968f07ec', 'request_id': 'req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:09.729323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:09.838784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] The token cache is being invalidate because project 9b52076fafba4f4fa4abdb4d968f07ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:16:09.839084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:09.839795 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:09.846668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1189/2381] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:16:09 2022] DELETE /identity/v3/projects/9b52076fafba4f4fa4abdb4d968f07ec => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:09.849594 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa159a-b0c6-4cf3-859c-b7bd1cc3dba2 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:09.861838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa159a-b0c6-4cf3-859c-b7bd1cc3dba2 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:09.874500 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:09.950251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:09.956665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:09.956665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:09.956665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] PATH_INFO: `/v3/users/3e50f62f6da64e8faacdb717a3e19f16` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:09.956665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e50f62f6da64e8faacdb717a3e19f16)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:09.956665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:10.234948 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e50f62f6da64e8faacdb717a3e19f16'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:10.236138 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e50f62f6da64e8faacdb717a3e19f16'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:10.236935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e50f62f6da64e8faacdb717a3e19f16'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:10.324139 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e50f62f6da64e8faacdb717a3e19f16'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:10.333963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e50f62f6da64e8faacdb717a3e19f16'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:10.384496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1193/2382] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:16:09 2022] DELETE /identity/v3/users/3e50f62f6da64e8faacdb717a3e19f16 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:11.122488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:11.124297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:11.157419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b3bc5-4a8d-4322-a1bb-d008f3f6f379 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:11.252651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895e47b3-abce-4be0-bc6a-7c216eb13b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:11.253986 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e47b3-abce-4be0-bc6a-7c216eb13b75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:11.254749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e47b3-abce-4be0-bc6a-7c216eb13b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:11.255242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895e47b3-abce-4be0-bc6a-7c216eb13b75 admin admin] PATH_INFO: `/v3/projects/0819af7e525a426fb267b43f9af688b2` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:11.256837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e47b3-abce-4be0-bc6a-7c216eb13b75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0819af7e525a426fb267b43f9af688b2)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:11.259060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895e47b3-abce-4be0-bc6a-7c216eb13b75 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:11.424308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-895e47b3-abce-4be0-bc6a-7c216eb13b75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0819af7e525a426fb267b43f9af688b2', 'request_id': 'req-895e47b3-abce-4be0-bc6a-7c216eb13b75'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:11.431481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-895e47b3-abce-4be0-bc6a-7c216eb13b75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0819af7e525a426fb267b43f9af688b2', 'request_id': 'req-895e47b3-abce-4be0-bc6a-7c216eb13b75'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:11.438296 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-895e47b3-abce-4be0-bc6a-7c216eb13b75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0819af7e525a426fb267b43f9af688b2', 'request_id': 'req-895e47b3-abce-4be0-bc6a-7c216eb13b75'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:11.473372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:11.474958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:11.623709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db52db12-8509-4e6c-a985-f844f83d2f35 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:11.627317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-895e47b3-abce-4be0-bc6a-7c216eb13b75 admin admin] The token cache is being invalidate because project 0819af7e525a426fb267b43f9af688b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:16:11.627611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-895e47b3-abce-4be0-bc6a-7c216eb13b75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:11.628340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-895e47b3-abce-4be0-bc6a-7c216eb13b75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:11.633954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1190/2383] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:16:11 2022] DELETE /identity/v3/projects/0819af7e525a426fb267b43f9af688b2 => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:11.636630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f157-2d7b-406e-8a44-95cb212b6a09 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:11.636928 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f157-2d7b-406e-8a44-95cb212b6a09 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:11.637211 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f157-2d7b-406e-8a44-95cb212b6a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:11.659340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4367f157-2d7b-406e-8a44-95cb212b6a09 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:11.660654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4367f157-2d7b-406e-8a44-95cb212b6a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:11.706487 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:11.712277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d7be6-2a30-4db6-8d30-dc1dc2e878b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:11.713654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7be6-2a30-4db6-8d30-dc1dc2e878b7 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:11.714162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7be6-2a30-4db6-8d30-dc1dc2e878b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:11.714769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7be6-2a30-4db6-8d30-dc1dc2e878b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:11.719518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-046d7be6-2a30-4db6-8d30-dc1dc2e878b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:11.731892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d7be6-2a30-4db6-8d30-dc1dc2e878b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:11.733975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d7be6-2a30-4db6-8d30-dc1dc2e878b7 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:11.739929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1191/2384] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:11.741434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70f9e7-74c8-46fe-8247-545d44f861a4 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:11.741750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70f9e7-74c8-46fe-8247-545d44f861a4 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:11.742031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70f9e7-74c8-46fe-8247-545d44f861a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:11.746716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1194/2385] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:11.763129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-7b70f9e7-74c8-46fe-8247-545d44f861a4 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:11.764429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-7b70f9e7-74c8-46fe-8247-545d44f861a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:11.780251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d7be6-2a30-4db6-8d30-dc1dc2e878b7 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:11.781258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1192/2386] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:11.798348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d7be6-2a30-4db6-8d30-dc1dc2e878b7 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:11.804100 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aea005-2164-4a9b-9345-9d6c029dd0ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:11.804768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aea005-2164-4a9b-9345-9d6c029dd0ff admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:11.805051 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aea005-2164-4a9b-9345-9d6c029dd0ff admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:11.805327 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aea005-2164-4a9b-9345-9d6c029dd0ff admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:11.806069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aea005-2164-4a9b-9345-9d6c029dd0ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:16:11.806376 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aea005-2164-4a9b-9345-9d6c029dd0ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:11.808501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aea005-2164-4a9b-9345-9d6c029dd0ff admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:11.835518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1195/2387] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:16:11.836702 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70f9e7-74c8-46fe-8247-545d44f861a4 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:11.853038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70f9e7-74c8-46fe-8247-545d44f861a4 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:11.864650 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d251bd-29db-4853-b292-1036bca2613e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:11.865325 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d251bd-29db-4853-b292-1036bca2613e admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:11.865615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d251bd-29db-4853-b292-1036bca2613e admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:11.866125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d251bd-29db-4853-b292-1036bca2613e admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:11.866835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d251bd-29db-4853-b292-1036bca2613e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:11.868818 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d251bd-29db-4853-b292-1036bca2613e admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:11.972095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:11.987308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1193/2388] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:16:11 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:11.990980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aea005-2164-4a9b-9345-9d6c029dd0ff admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:12.004954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aea005-2164-4a9b-9345-9d6c029dd0ff admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:12.082691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700955e5-13da-4f30-beee-fa1ce8000820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:12.084619 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700955e5-13da-4f30-beee-fa1ce8000820 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:12.084910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700955e5-13da-4f30-beee-fa1ce8000820 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:12.085196 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700955e5-13da-4f30-beee-fa1ce8000820 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:12.085915 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700955e5-13da-4f30-beee-fa1ce8000820 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:12.087875 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700955e5-13da-4f30-beee-fa1ce8000820 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:12.243772 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1196/2389] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:16:11 2022] POST /identity/v3/users => generated 292 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:12.253636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d251bd-29db-4853-b292-1036bca2613e admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:12.259321 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d251bd-29db-4853-b292-1036bca2613e admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:12.265919 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fda9f-186e-49aa-9ff8-15db1f03a06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:12.268292 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fda9f-186e-49aa-9ff8-15db1f03a06c admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:12.268829 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fda9f-186e-49aa-9ff8-15db1f03a06c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:12.269768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fda9f-186e-49aa-9ff8-15db1f03a06c admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:12.270757 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fda9f-186e-49aa-9ff8-15db1f03a06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:12.274510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55fda9f-186e-49aa-9ff8-15db1f03a06c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:12.290060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1194/2390] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:12.297867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700955e5-13da-4f30-beee-fa1ce8000820 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:12.312929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700955e5-13da-4f30-beee-fa1ce8000820 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:12.319752 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6b7d4-402a-461c-b54c-77408e9acfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:12.320472 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6b7d4-402a-461c-b54c-77408e9acfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:12.320757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6b7d4-402a-461c-b54c-77408e9acfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:12.321037 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6b7d4-402a-461c-b54c-77408e9acfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:12.321771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6b7d4-402a-461c-b54c-77408e9acfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:12.323393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6b7d4-402a-461c-b54c-77408e9acfd4 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:12.341886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1197/2391] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:12 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:12.346471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fda9f-186e-49aa-9ff8-15db1f03a06c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:12.357322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fda9f-186e-49aa-9ff8-15db1f03a06c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:12.365296 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f20bb-626b-415e-bad4-201ec3bda803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:12.366517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f20bb-626b-415e-bad4-201ec3bda803 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:12.366798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f20bb-626b-415e-bad4-201ec3bda803 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:12.367073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f20bb-626b-415e-bad4-201ec3bda803 admin admin] PATH_INFO: `/v3/projects/f746dc7cb49e4b32a2b4cce1c9ee6c9d/users/95ab4e782ee0409fb20b56cac64d50d5/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:12.384018 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f20bb-626b-415e-bad4-201ec3bda803 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f746dc7cb49e4b32a2b4cce1c9ee6c9d, user_id=95ab4e782ee0409fb20b56cac64d50d5, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:12.387399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2f20bb-626b-415e-bad4-201ec3bda803 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:12.546541 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1195/2392] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:16:12 2022] PUT /identity/v3/projects/f746dc7cb49e4b32a2b4cce1c9ee6c9d/users/95ab4e782ee0409fb20b56cac64d50d5/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:16:12.557364 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d28de0-20e5-41fd-a480-f3343dae6060 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:12.558901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d28de0-20e5-41fd-a480-f3343dae6060 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:12.559188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d28de0-20e5-41fd-a480-f3343dae6060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:12.620210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-57d28de0-20e5-41fd-a480-f3343dae6060 None None] MFA Rules not processed for user `95ab4e782ee0409fb20b56cac64d50d5`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:12.621576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-57d28de0-20e5-41fd-a480-f3343dae6060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:12.771301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1198/2393] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:12.779570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f20bb-626b-415e-bad4-201ec3bda803 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:12.857373 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f20bb-626b-415e-bad4-201ec3bda803 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:12.864652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc29fc-a647-420e-a808-bd56e14ea8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:12.865438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc29fc-a647-420e-a808-bd56e14ea8ae admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:12.865670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc29fc-a647-420e-a808-bd56e14ea8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:12.866009 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc29fc-a647-420e-a808-bd56e14ea8ae admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:12.866771 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc29fc-a647-420e-a808-bd56e14ea8ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:12.868865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc29fc-a647-420e-a808-bd56e14ea8ae admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:12.944979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d28de0-20e5-41fd-a480-f3343dae6060 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:12.948527 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-57d28de0-20e5-41fd-a480-f3343dae6060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:13.056697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d28de0-20e5-41fd-a480-f3343dae6060 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:13.064049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b762c4c-a02c-4b42-986c-91d56fb88b74 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:13.065329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b762c4c-a02c-4b42-986c-91d56fb88b74 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:13.065615 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b762c4c-a02c-4b42-986c-91d56fb88b74 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:13.065917 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b762c4c-a02c-4b42-986c-91d56fb88b74 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:13.067964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9b762c4c-a02c-4b42-986c-91d56fb88b74 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:13.082460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b762c4c-a02c-4b42-986c-91d56fb88b74 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:13.084171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b762c4c-a02c-4b42-986c-91d56fb88b74 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:13.101135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1199/2394] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:16:13.228163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1196/2395] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:16:12 2022] POST /identity/v3/projects => generated 383 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:13.232033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b762c4c-a02c-4b42-986c-91d56fb88b74 service nova] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:13.246014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b762c4c-a02c-4b42-986c-91d56fb88b74 service nova] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:13.306002 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408d4bd-f718-4c29-931f-169cfd1c43a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:13.306581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408d4bd-f718-4c29-931f-169cfd1c43a0 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:13.306870 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408d4bd-f718-4c29-931f-169cfd1c43a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:13.307149 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408d4bd-f718-4c29-931f-169cfd1c43a0 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:13.307905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408d4bd-f718-4c29-931f-169cfd1c43a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:13.309827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408d4bd-f718-4c29-931f-169cfd1c43a0 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:13.462336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1200/2396] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:16:13 2022] POST /identity/v3/users => generated 298 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:13.467137 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc29fc-a647-420e-a808-bd56e14ea8ae admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:13.485512 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc29fc-a647-420e-a808-bd56e14ea8ae admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:13.507994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc0274-f46e-430e-99f5-982d2661791d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:13.507994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc0274-f46e-430e-99f5-982d2661791d admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:13.507994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc0274-f46e-430e-99f5-982d2661791d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:13.507994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc0274-f46e-430e-99f5-982d2661791d admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:13.508433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc0274-f46e-430e-99f5-982d2661791d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:13.508433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fc0274-f46e-430e-99f5-982d2661791d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:13.530133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1197/2397] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:13.534691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408d4bd-f718-4c29-931f-169cfd1c43a0 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:13.551109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408d4bd-f718-4c29-931f-169cfd1c43a0 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:13.558918 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0859e-cbb6-4374-a522-88911c87b35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:13.559741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0859e-cbb6-4374-a522-88911c87b35e admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:13.560061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0859e-cbb6-4374-a522-88911c87b35e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:13.560676 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0859e-cbb6-4374-a522-88911c87b35e admin admin] PATH_INFO: `/v3/projects/a17f80bcf26943b380f32f0306088752/users/c448824d192944c9b1a0e4d98b6cee28/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:13.581948 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0859e-cbb6-4374-a522-88911c87b35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17f80bcf26943b380f32f0306088752, user_id=c448824d192944c9b1a0e4d98b6cee28, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:13.588153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0859e-cbb6-4374-a522-88911c87b35e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:13.668200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1201/2398] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:16:13 2022] PUT /identity/v3/projects/a17f80bcf26943b380f32f0306088752/users/c448824d192944c9b1a0e4d98b6cee28/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:13.676869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc0274-f46e-430e-99f5-982d2661791d admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:13.689342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc0274-f46e-430e-99f5-982d2661791d admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:13.726013 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:13.779930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ec89ce-2534-42cd-b7b9-018ed1c2a9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:13.780685 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec89ce-2534-42cd-b7b9-018ed1c2a9ad admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:13.781037 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec89ce-2534-42cd-b7b9-018ed1c2a9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:13.781328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ec89ce-2534-42cd-b7b9-018ed1c2a9ad admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:13.782094 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec89ce-2534-42cd-b7b9-018ed1c2a9ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:13.784699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ec89ce-2534-42cd-b7b9-018ed1c2a9ad admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:13.800207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1198/2399] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:13 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:13.807709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0859e-cbb6-4374-a522-88911c87b35e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:13.823446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0859e-cbb6-4374-a522-88911c87b35e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:13.828856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff927b14-8e0a-4fbe-ba97-dd385f57bd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:13.830844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff927b14-8e0a-4fbe-ba97-dd385f57bd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:13.830844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff927b14-8e0a-4fbe-ba97-dd385f57bd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:13.830844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff927b14-8e0a-4fbe-ba97-dd385f57bd75 admin admin] PATH_INFO: `/v3/projects/a17f80bcf26943b380f32f0306088752/users/c448824d192944c9b1a0e4d98b6cee28/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:13.832872 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff927b14-8e0a-4fbe-ba97-dd385f57bd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a17f80bcf26943b380f32f0306088752, user_id=c448824d192944c9b1a0e4d98b6cee28, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:13.836793 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff927b14-8e0a-4fbe-ba97-dd385f57bd75 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:13.851721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1202/2400] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:16:13 2022] PUT /identity/v3/projects/a17f80bcf26943b380f32f0306088752/users/c448824d192944c9b1a0e4d98b6cee28/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:13.862462 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885ac83-66b1-47e0-9d8b-a50f80575ecb None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:13.863716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885ac83-66b1-47e0-9d8b-a50f80575ecb None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:13.863716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1885ac83-66b1-47e0-9d8b-a50f80575ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:13.909770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-1885ac83-66b1-47e0-9d8b-a50f80575ecb None None] MFA Rules not processed for user `c448824d192944c9b1a0e4d98b6cee28`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:13.911146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1885ac83-66b1-47e0-9d8b-a50f80575ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:13.935562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:14.019890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1199/2401] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:14.031621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff927b14-8e0a-4fbe-ba97-dd385f57bd75 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:14.038203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ff927b14-8e0a-4fbe-ba97-dd385f57bd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:14.135939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff927b14-8e0a-4fbe-ba97-dd385f57bd75 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:14.139765 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9a92a-ae64-4411-986c-d52755269c0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:14.140462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9a92a-ae64-4411-986c-d52755269c0e service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:14.140802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9a92a-ae64-4411-986c-d52755269c0e service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:14.141132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9a92a-ae64-4411-986c-d52755269c0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:14.209982 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9a92a-ae64-4411-986c-d52755269c0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:14.211722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9a92a-ae64-4411-986c-d52755269c0e service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:14.227126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1203/2402] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:14.307429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:19.756515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885ac83-66b1-47e0-9d8b-a50f80575ecb None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:19.767988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1885ac83-66b1-47e0-9d8b-a50f80575ecb None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:19.772317 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4999970-8248-4e62-bb59-2f246f55a560 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:19.773245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4999970-8248-4e62-bb59-2f246f55a560 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:19.773245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4999970-8248-4e62-bb59-2f246f55a560 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:19.773520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4999970-8248-4e62-bb59-2f246f55a560 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:19.786332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4999970-8248-4e62-bb59-2f246f55a560 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:19.788920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4999970-8248-4e62-bb59-2f246f55a560 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:19.800266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1200/2403] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:19 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:20.191707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9a92a-ae64-4411-986c-d52755269c0e service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:20.291099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9a92a-ae64-4411-986c-d52755269c0e service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:20.296956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc42687-3d60-499f-aa48-ee41412a3604 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:20.297720 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc42687-3d60-499f-aa48-ee41412a3604 service nova] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:20.300576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc42687-3d60-499f-aa48-ee41412a3604 service nova] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:20.300576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc42687-3d60-499f-aa48-ee41412a3604 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:20.300576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8bc42687-3d60-499f-aa48-ee41412a3604 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:20.315869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc42687-3d60-499f-aa48-ee41412a3604 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:20.319265 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc42687-3d60-499f-aa48-ee41412a3604 service nova] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:20.332694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1204/2404] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:25.191934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4999970-8248-4e62-bb59-2f246f55a560 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:25.193504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d4999970-8248-4e62-bb59-2f246f55a560 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:25.263751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4999970-8248-4e62-bb59-2f246f55a560 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:25.267936 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb21f7-d1c6-4f92-9c67-6776fd319d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:25.268655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb21f7-d1c6-4f92-9c67-6776fd319d54 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:25.270203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb21f7-d1c6-4f92-9c67-6776fd319d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:25.270530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfb21f7-d1c6-4f92-9c67-6776fd319d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:25.272526 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3dfb21f7-d1c6-4f92-9c67-6776fd319d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:25.343310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb21f7-d1c6-4f92-9c67-6776fd319d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:25.345038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfb21f7-d1c6-4f92-9c67-6776fd319d54 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:25.360994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1201/2405] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:16:25.782723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402f16-9c13-4986-84b2-d0cb25b7ec4c None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:25.783193 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402f16-9c13-4986-84b2-d0cb25b7ec4c None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:25.783288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6402f16-9c13-4986-84b2-d0cb25b7ec4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:25.803698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-e6402f16-9c13-4986-84b2-d0cb25b7ec4c None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:25.805058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e6402f16-9c13-4986-84b2-d0cb25b7ec4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:25.874747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1205/2406] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:16:25 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:25.887265 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb21f7-d1c6-4f92-9c67-6776fd319d54 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:25.888725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3dfb21f7-d1c6-4f92-9c67-6776fd319d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:25.954616 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:25.973790 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfb21f7-d1c6-4f92-9c67-6776fd319d54 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:25.978725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e496f-6f33-4faf-ab7d-c3df0b5f314c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:25.979371 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e496f-6f33-4faf-ab7d-c3df0b5f314c service swift] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:25.979649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e496f-6f33-4faf-ab7d-c3df0b5f314c service swift] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:25.979953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e496f-6f33-4faf-ab7d-c3df0b5f314c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:25.988325 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e496f-6f33-4faf-ab7d-c3df0b5f314c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:25.989920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e496f-6f33-4faf-ab7d-c3df0b5f314c service swift] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:25.998392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1202/2407] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:16:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:16:26.022719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6402f16-9c13-4986-84b2-d0cb25b7ec4c None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:26.095562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6402f16-9c13-4986-84b2-d0cb25b7ec4c None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:26.102542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:26.103556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:26.103958 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:26.104397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] PATH_INFO: `/v3/users/95ab4e782ee0409fb20b56cac64d50d5` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:26.105991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95ab4e782ee0409fb20b56cac64d50d5)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:26.110155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:26.123991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:26.282224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95ab4e782ee0409fb20b56cac64d50d5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:26.283247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95ab4e782ee0409fb20b56cac64d50d5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:26.284558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95ab4e782ee0409fb20b56cac64d50d5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:26.357546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95ab4e782ee0409fb20b56cac64d50d5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:26.369883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95ab4e782ee0409fb20b56cac64d50d5'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:26.412826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1206/2408] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:16:26 2022] DELETE /identity/v3/users/95ab4e782ee0409fb20b56cac64d50d5 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:26.419080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c2dff-9f98-44b6-8a5e-201d9c4ded46 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:26.420021 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c2dff-9f98-44b6-8a5e-201d9c4ded46 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:26.420494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8c2dff-9f98-44b6-8a5e-201d9c4ded46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:26.471025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-7b8c2dff-9f98-44b6-8a5e-201d9c4ded46 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:26.482930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-7b8c2dff-9f98-44b6-8a5e-201d9c4ded46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:26.596969 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1203/2409] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:26.640707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:26.645810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:26.781706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f39852-4071-468f-bdff-ef744f66c809 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:26.788017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a46b8b-edbe-4965-a46b-ec6aab228503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:26.788968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a46b8b-edbe-4965-a46b-ec6aab228503 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:26.789284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a46b8b-edbe-4965-a46b-ec6aab228503 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:26.789730 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a46b8b-edbe-4965-a46b-ec6aab228503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:26.811708 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a46b8b-edbe-4965-a46b-ec6aab228503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:26.816733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a46b8b-edbe-4965-a46b-ec6aab228503 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:26.841133 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1207/2410] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:27.475665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c2dff-9f98-44b6-8a5e-201d9c4ded46 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:27.477736 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-7b8c2dff-9f98-44b6-8a5e-201d9c4ded46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:27.511990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8c2dff-9f98-44b6-8a5e-201d9c4ded46 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:27.518583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:27.519875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:27.520252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:27.520585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] PATH_INFO: `/v3/projects/f746dc7cb49e4b32a2b4cce1c9ee6c9d` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:27.522125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f746dc7cb49e4b32a2b4cce1c9ee6c9d)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:27.524667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:27.693040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f746dc7cb49e4b32a2b4cce1c9ee6c9d', 'request_id': 'req-c5f1ae3e-e321-44b5-9648-9c690a21ea81'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:27.699035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f746dc7cb49e4b32a2b4cce1c9ee6c9d', 'request_id': 'req-c5f1ae3e-e321-44b5-9648-9c690a21ea81'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:27.706614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f746dc7cb49e4b32a2b4cce1c9ee6c9d', 'request_id': 'req-c5f1ae3e-e321-44b5-9648-9c690a21ea81'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:27.809344 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] The token cache is being invalidate because project f746dc7cb49e4b32a2b4cce1c9ee6c9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:16:27.809550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:27.810195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:27.811924 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1204/2411] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:16:27 2022] DELETE /identity/v3/projects/f746dc7cb49e4b32a2b4cce1c9ee6c9d => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:27.817062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a46b8b-edbe-4965-a46b-ec6aab228503 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:27.827157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a46b8b-edbe-4965-a46b-ec6aab228503 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:27.887462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:27.888365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:27.888642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:27.888914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] PATH_INFO: `/v3/users/c448824d192944c9b1a0e4d98b6cee28` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:27.890110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c448824d192944c9b1a0e4d98b6cee28)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:27.892096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:28.152626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:28.167208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c448824d192944c9b1a0e4d98b6cee28'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:28.167208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c448824d192944c9b1a0e4d98b6cee28'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:28.167208 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c448824d192944c9b1a0e4d98b6cee28'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:28.236837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c448824d192944c9b1a0e4d98b6cee28'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:28.247255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c448824d192944c9b1a0e4d98b6cee28'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:28.290389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1208/2412] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:16:27 2022] DELETE /identity/v3/users/c448824d192944c9b1a0e4d98b6cee28 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:28.445980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:28.447577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:28.698146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f1ae3e-e321-44b5-9648-9c690a21ea81 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:28.718928 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:28.845934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2c4f3-3bbd-48a2-b4a0-a0113ccc655e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:28.848854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2c4f3-3bbd-48a2-b4a0-a0113ccc655e service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:28.850332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2c4f3-3bbd-48a2-b4a0-a0113ccc655e service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:28.850469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2c4f3-3bbd-48a2-b4a0-a0113ccc655e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:28.860371 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-89a2c4f3-3bbd-48a2-b4a0-a0113ccc655e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:28.883687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2c4f3-3bbd-48a2-b4a0-a0113ccc655e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:28.885361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a2c4f3-3bbd-48a2-b4a0-a0113ccc655e service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:28.901093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1205/2413] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:28.982789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:28.984597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:29.131254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6b034-9976-44c3-950f-c7aadec6dd81 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:29.154935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6ff63d-8298-4739-b5f4-64ba20819eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:29.155841 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ff63d-8298-4739-b5f4-64ba20819eb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:29.156251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ff63d-8298-4739-b5f4-64ba20819eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:29.156535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6ff63d-8298-4739-b5f4-64ba20819eb8 admin admin] PATH_INFO: `/v3/projects/a17f80bcf26943b380f32f0306088752` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:29.162768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ff63d-8298-4739-b5f4-64ba20819eb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a17f80bcf26943b380f32f0306088752)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:29.164770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6ff63d-8298-4739-b5f4-64ba20819eb8 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:29.359209 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-8f6ff63d-8298-4739-b5f4-64ba20819eb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a17f80bcf26943b380f32f0306088752', 'request_id': 'req-8f6ff63d-8298-4739-b5f4-64ba20819eb8'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:29.371185 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-8f6ff63d-8298-4739-b5f4-64ba20819eb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a17f80bcf26943b380f32f0306088752', 'request_id': 'req-8f6ff63d-8298-4739-b5f4-64ba20819eb8'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:29.383234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-8f6ff63d-8298-4739-b5f4-64ba20819eb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a17f80bcf26943b380f32f0306088752', 'request_id': 'req-8f6ff63d-8298-4739-b5f4-64ba20819eb8'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:29.449534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-8f6ff63d-8298-4739-b5f4-64ba20819eb8 admin admin] The token cache is being invalidate because project a17f80bcf26943b380f32f0306088752 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:16:29.449791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-8f6ff63d-8298-4739-b5f4-64ba20819eb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:29.455797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-8f6ff63d-8298-4739-b5f4-64ba20819eb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:29.462671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1209/2414] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:16:28 2022] DELETE /identity/v3/projects/a17f80bcf26943b380f32f0306088752 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:29.464484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb0856-c32d-4aad-a1e8-2d1af7070735 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:29.464775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb0856-c32d-4aad-a1e8-2d1af7070735 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:29.465048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb0856-c32d-4aad-a1e8-2d1af7070735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:29.505646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-09bb0856-c32d-4aad-a1e8-2d1af7070735 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:29.506975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-09bb0856-c32d-4aad-a1e8-2d1af7070735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:29.627076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1206/2415] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:29.636171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39716a9e-f47e-420b-a8fd-05e7fbb788a6 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:29.636627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39716a9e-f47e-420b-a8fd-05e7fbb788a6 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:29.637019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39716a9e-f47e-420b-a8fd-05e7fbb788a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:29.680039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-39716a9e-f47e-420b-a8fd-05e7fbb788a6 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:29.680039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-39716a9e-f47e-420b-a8fd-05e7fbb788a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:29.701171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1210/2416] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:29.707165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb0856-c32d-4aad-a1e8-2d1af7070735 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:29.721265 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb0856-c32d-4aad-a1e8-2d1af7070735 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:29.746047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a61975-aeff-42b4-83af-b756bf15cdc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:29.746739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a61975-aeff-42b4-83af-b756bf15cdc6 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:29.747023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a61975-aeff-42b4-83af-b756bf15cdc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:29.747301 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a61975-aeff-42b4-83af-b756bf15cdc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:29.748098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a61975-aeff-42b4-83af-b756bf15cdc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:16:29.755863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a61975-aeff-42b4-83af-b756bf15cdc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:29.758537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a61975-aeff-42b4-83af-b756bf15cdc6 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:29.783249 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1207/2417] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:16:29.792288 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39716a9e-f47e-420b-a8fd-05e7fbb788a6 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:29.802853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39716a9e-f47e-420b-a8fd-05e7fbb788a6 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:29.816884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97407123-d287-442e-b09b-c8a227a9148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:29.817693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97407123-d287-442e-b09b-c8a227a9148b admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:29.817985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97407123-d287-442e-b09b-c8a227a9148b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:29.818410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97407123-d287-442e-b09b-c8a227a9148b admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:29.819146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97407123-d287-442e-b09b-c8a227a9148b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:29.821153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97407123-d287-442e-b09b-c8a227a9148b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:29.993517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1211/2418] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:16:29 2022] POST /identity/v3/projects => generated 361 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:29.997461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a61975-aeff-42b4-83af-b756bf15cdc6 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:30.013877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a61975-aeff-42b4-83af-b756bf15cdc6 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:30.099461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce96c5-6c11-4ed1-9c29-b557f8e1bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:30.100481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce96c5-6c11-4ed1-9c29-b557f8e1bddd admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:30.100776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce96c5-6c11-4ed1-9c29-b557f8e1bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:30.101183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ce96c5-6c11-4ed1-9c29-b557f8e1bddd admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:30.101982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce96c5-6c11-4ed1-9c29-b557f8e1bddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:30.104156 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ce96c5-6c11-4ed1-9c29-b557f8e1bddd admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:30.227134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1208/2419] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:16:29 2022] POST /identity/v3/users => generated 281 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:16:30.234681 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97407123-d287-442e-b09b-c8a227a9148b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:30.241270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:30.255845 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97407123-d287-442e-b09b-c8a227a9148b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:30.260450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca151c5c-bc90-4079-b990-b50dfe28d4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:30.261132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151c5c-bc90-4079-b990-b50dfe28d4ac admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:30.261416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151c5c-bc90-4079-b990-b50dfe28d4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:30.261691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca151c5c-bc90-4079-b990-b50dfe28d4ac admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:30.262425 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca151c5c-bc90-4079-b990-b50dfe28d4ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:30.264065 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca151c5c-bc90-4079-b990-b50dfe28d4ac admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:30.275351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1212/2420] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:30.280327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce96c5-6c11-4ed1-9c29-b557f8e1bddd admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:30.292498 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ce96c5-6c11-4ed1-9c29-b557f8e1bddd admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:30.297329 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a924f-f41d-4e4f-bd7d-eac74f605675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:30.297998 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a924f-f41d-4e4f-bd7d-eac74f605675 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:30.298339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a924f-f41d-4e4f-bd7d-eac74f605675 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:30.298661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a924f-f41d-4e4f-bd7d-eac74f605675 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:30.299390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a924f-f41d-4e4f-bd7d-eac74f605675 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:30.301192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a924f-f41d-4e4f-bd7d-eac74f605675 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:30.303690 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:30.317449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1209/2421] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:16:30.322006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca151c5c-bc90-4079-b990-b50dfe28d4ac admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:30.342632 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca151c5c-bc90-4079-b990-b50dfe28d4ac admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:30.348605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7749fd-80ef-4c7d-8138-ce8156fa4c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:30.349600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7749fd-80ef-4c7d-8138-ce8156fa4c6c admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:30.349917 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7749fd-80ef-4c7d-8138-ce8156fa4c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:30.350170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7749fd-80ef-4c7d-8138-ce8156fa4c6c admin admin] PATH_INFO: `/v3/projects/872f19b997c34007aab66fa7105aed38/users/18e7af403f524a0eb627e4e482ae5bc9/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:30.367660 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7749fd-80ef-4c7d-8138-ce8156fa4c6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=872f19b997c34007aab66fa7105aed38, user_id=18e7af403f524a0eb627e4e482ae5bc9, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:30.370921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7749fd-80ef-4c7d-8138-ce8156fa4c6c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:30.468797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1213/2422] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:16:30 2022] PUT /identity/v3/projects/872f19b997c34007aab66fa7105aed38/users/18e7af403f524a0eb627e4e482ae5bc9/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:30.480381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ec56-6970-419b-9b71-b5649b62f849 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:30.480720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ec56-6970-419b-9b71-b5649b62f849 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:30.481000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4706ec56-6970-419b-9b71-b5649b62f849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:30.515229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4706ec56-6970-419b-9b71-b5649b62f849 None None] MFA Rules not processed for user `18e7af403f524a0eb627e4e482ae5bc9`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:30.516501 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4706ec56-6970-419b-9b71-b5649b62f849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:30.602820 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1210/2423] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:30 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:30.649190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7749fd-80ef-4c7d-8138-ce8156fa4c6c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:30.650914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9a7749fd-80ef-4c7d-8138-ce8156fa4c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:30.718613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7749fd-80ef-4c7d-8138-ce8156fa4c6c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:30.723068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7774876-509d-4e84-93bb-d33435769a74 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:30.723668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7774876-509d-4e84-93bb-d33435769a74 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:30.723994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7774876-509d-4e84-93bb-d33435769a74 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:30.724270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7774876-509d-4e84-93bb-d33435769a74 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:30.733813 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7774876-509d-4e84-93bb-d33435769a74 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:30.735382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7774876-509d-4e84-93bb-d33435769a74 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:30.748721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1214/2424] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:30 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:30.765743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706ec56-6970-419b-9b71-b5649b62f849 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:30.850606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4706ec56-6970-419b-9b71-b5649b62f849 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:30.856544 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:30.857441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:30.857734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:30.858029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] PATH_INFO: `/v3/users/18e7af403f524a0eb627e4e482ae5bc9` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:30.862470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18e7af403f524a0eb627e4e482ae5bc9)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:30.862470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:31.060162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18e7af403f524a0eb627e4e482ae5bc9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:31.096762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18e7af403f524a0eb627e4e482ae5bc9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:31.098075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18e7af403f524a0eb627e4e482ae5bc9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:31.098756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18e7af403f524a0eb627e4e482ae5bc9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:31.157600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18e7af403f524a0eb627e4e482ae5bc9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:31.178825 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1211/2425] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:16:30 2022] DELETE /identity/v3/users/18e7af403f524a0eb627e4e482ae5bc9 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:31.183520 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5fee7-97cc-4fa3-b594-cbb17e4b8996 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:31.184073 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5fee7-97cc-4fa3-b594-cbb17e4b8996 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:31.184298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f5fee7-97cc-4fa3-b594-cbb17e4b8996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:31.203667 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-19f5fee7-97cc-4fa3-b594-cbb17e4b8996 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:31.204916 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-19f5fee7-97cc-4fa3-b594-cbb17e4b8996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:31.291727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1215/2426] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:31.302982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:31.304564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:31.321772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:31.426158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226c1df-761b-4c9d-9932-5ee3147899a8 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:31.428282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5fee7-97cc-4fa3-b594-cbb17e4b8996 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:31.437602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b51f9-bb54-4e4b-8382-8c372f00f15e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:31.438390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b51f9-bb54-4e4b-8382-8c372f00f15e service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:31.438673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b51f9-bb54-4e4b-8382-8c372f00f15e service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:31.438792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f5fee7-97cc-4fa3-b594-cbb17e4b8996 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:31.438972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03b51f9-bb54-4e4b-8382-8c372f00f15e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:31.446407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c840b20-1a58-4f7a-a750-2541f62b0ce0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:31.447084 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c840b20-1a58-4f7a-a750-2541f62b0ce0 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:31.447516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c840b20-1a58-4f7a-a750-2541f62b0ce0 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:31.447840 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c840b20-1a58-4f7a-a750-2541f62b0ce0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:31.450831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5c840b20-1a58-4f7a-a750-2541f62b0ce0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:31.450955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b51f9-bb54-4e4b-8382-8c372f00f15e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:31.453453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03b51f9-bb54-4e4b-8382-8c372f00f15e service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:31.464234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c840b20-1a58-4f7a-a750-2541f62b0ce0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:31.465175 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1212/2427] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:31.465703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c840b20-1a58-4f7a-a750-2541f62b0ce0 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:31.481089 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1216/2428] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:16:32.359064 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b51f9-bb54-4e4b-8382-8c372f00f15e service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:32.360620 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e03b51f9-bb54-4e4b-8382-8c372f00f15e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:32.387335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03b51f9-bb54-4e4b-8382-8c372f00f15e service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:32.393010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2380bd7-9999-48a0-a6ec-09cc7f038152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:32.393882 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2380bd7-9999-48a0-a6ec-09cc7f038152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:32.394195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2380bd7-9999-48a0-a6ec-09cc7f038152 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:32.394465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2380bd7-9999-48a0-a6ec-09cc7f038152 admin admin] PATH_INFO: `/v3/projects/872f19b997c34007aab66fa7105aed38` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:32.400876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2380bd7-9999-48a0-a6ec-09cc7f038152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=872f19b997c34007aab66fa7105aed38)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:32.403514 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2380bd7-9999-48a0-a6ec-09cc7f038152 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:32.565374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f2380bd7-9999-48a0-a6ec-09cc7f038152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '872f19b997c34007aab66fa7105aed38', 'request_id': 'req-f2380bd7-9999-48a0-a6ec-09cc7f038152'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:32.575376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f2380bd7-9999-48a0-a6ec-09cc7f038152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '872f19b997c34007aab66fa7105aed38', 'request_id': 'req-f2380bd7-9999-48a0-a6ec-09cc7f038152'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:32.583049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f2380bd7-9999-48a0-a6ec-09cc7f038152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '872f19b997c34007aab66fa7105aed38', 'request_id': 'req-f2380bd7-9999-48a0-a6ec-09cc7f038152'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:32.673220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f2380bd7-9999-48a0-a6ec-09cc7f038152 admin admin] The token cache is being invalidate because project 872f19b997c34007aab66fa7105aed38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:16:32.674690 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f2380bd7-9999-48a0-a6ec-09cc7f038152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:32.678139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f2380bd7-9999-48a0-a6ec-09cc7f038152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:32.681432 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1213/2429] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:16:32 2022] DELETE /identity/v3/projects/872f19b997c34007aab66fa7105aed38 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:32.689608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a8f4d-782c-47a6-8e64-ffe314d8cd4a None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:32.690192 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a8f4d-782c-47a6-8e64-ffe314d8cd4a None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:32.690192 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a8f4d-782c-47a6-8e64-ffe314d8cd4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:32.712237 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-104a8f4d-782c-47a6-8e64-ffe314d8cd4a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:32.713545 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-104a8f4d-782c-47a6-8e64-ffe314d8cd4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:32.772179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:32.794811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1217/2430] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:32.806122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8027d3-b2e5-4ecd-8530-597cf3460fec None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:32.806775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8027d3-b2e5-4ecd-8530-597cf3460fec None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:32.807420 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8027d3-b2e5-4ecd-8530-597cf3460fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:32.857379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3b8027d3-b2e5-4ecd-8530-597cf3460fec None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:32.859409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3b8027d3-b2e5-4ecd-8530-597cf3460fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:32.878346 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a8f4d-782c-47a6-8e64-ffe314d8cd4a None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:32.878577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1214/2431] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:32.891085 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a8f4d-782c-47a6-8e64-ffe314d8cd4a None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:32.906993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197eefb-219a-46d5-87cc-3d62c05f78e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:32.907691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197eefb-219a-46d5-87cc-3d62c05f78e3 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:32.908017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197eefb-219a-46d5-87cc-3d62c05f78e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:32.908292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e197eefb-219a-46d5-87cc-3d62c05f78e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:32.909060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197eefb-219a-46d5-87cc-3d62c05f78e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:16:32.909382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197eefb-219a-46d5-87cc-3d62c05f78e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:32.911605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e197eefb-219a-46d5-87cc-3d62c05f78e3 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:32.946313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1218/2432] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:16:32.947376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8027d3-b2e5-4ecd-8530-597cf3460fec None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:32.962188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8027d3-b2e5-4ecd-8530-597cf3460fec None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:32.967672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e106bd-00ca-463a-a835-37f38018bb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:32.968427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e106bd-00ca-463a-a835-37f38018bb3a admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:32.968711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e106bd-00ca-463a-a835-37f38018bb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:32.968986 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e106bd-00ca-463a-a835-37f38018bb3a admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:32.969679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e106bd-00ca-463a-a835-37f38018bb3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:32.976753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e106bd-00ca-463a-a835-37f38018bb3a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:33.154606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1215/2433] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:16:32 2022] POST /identity/v3/projects => generated 369 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:33.158369 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197eefb-219a-46d5-87cc-3d62c05f78e3 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:33.173773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e197eefb-219a-46d5-87cc-3d62c05f78e3 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:33.292336 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3f49e-f11f-4d13-8cd4-12736f20a528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:33.293895 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3f49e-f11f-4d13-8cd4-12736f20a528 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:33.294903 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3f49e-f11f-4d13-8cd4-12736f20a528 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:33.295605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c3f49e-f11f-4d13-8cd4-12736f20a528 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:33.296668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3f49e-f11f-4d13-8cd4-12736f20a528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:33.298938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c3f49e-f11f-4d13-8cd4-12736f20a528 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:33.443674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1219/2434] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:16:33 2022] POST /identity/v3/users => generated 285 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:33.447837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e106bd-00ca-463a-a835-37f38018bb3a admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:33.464131 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e106bd-00ca-463a-a835-37f38018bb3a admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:33.469673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d107fc2-15ac-4f52-a1ec-e2c7cdeac056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:33.473999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d107fc2-15ac-4f52-a1ec-e2c7cdeac056 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:33.473999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d107fc2-15ac-4f52-a1ec-e2c7cdeac056 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:33.473999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d107fc2-15ac-4f52-a1ec-e2c7cdeac056 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:33.473999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d107fc2-15ac-4f52-a1ec-e2c7cdeac056 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:33.477125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d107fc2-15ac-4f52-a1ec-e2c7cdeac056 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:33.489776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1216/2435] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:16:33.493770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3f49e-f11f-4d13-8cd4-12736f20a528 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:33.505388 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c3f49e-f11f-4d13-8cd4-12736f20a528 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:33.511032 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc2315-dfe3-4084-95de-b389e314adb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:33.511712 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc2315-dfe3-4084-95de-b389e314adb7 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:33.512029 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc2315-dfe3-4084-95de-b389e314adb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:33.512310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc2315-dfe3-4084-95de-b389e314adb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:33.513040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc2315-dfe3-4084-95de-b389e314adb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:33.514669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc2315-dfe3-4084-95de-b389e314adb7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:33.552061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1220/2436] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:33.557416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d107fc2-15ac-4f52-a1ec-e2c7cdeac056 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:33.575310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d107fc2-15ac-4f52-a1ec-e2c7cdeac056 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:33.591470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf497b36-f704-4536-a7c0-56dbc447728c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:33.592433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf497b36-f704-4536-a7c0-56dbc447728c admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:33.592719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf497b36-f704-4536-a7c0-56dbc447728c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:33.592999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf497b36-f704-4536-a7c0-56dbc447728c admin admin] PATH_INFO: `/v3/projects/834c96682916408980a20b021d05c1f3/users/b7d01d86f2ae4e8f9e7e35c5bb7184e1/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:33.635098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf497b36-f704-4536-a7c0-56dbc447728c admin admin] RBAC: Authorizing `identity:create_grant(project_id=834c96682916408980a20b021d05c1f3, user_id=b7d01d86f2ae4e8f9e7e35c5bb7184e1, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:33.638043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf497b36-f704-4536-a7c0-56dbc447728c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:33.741740 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1217/2437] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:16:33 2022] PUT /identity/v3/projects/834c96682916408980a20b021d05c1f3/users/b7d01d86f2ae4e8f9e7e35c5bb7184e1/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:33.751476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7510c1-c6ef-4169-bca9-198e08ac56e3 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:33.754448 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7510c1-c6ef-4169-bca9-198e08ac56e3 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:33.754448 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7510c1-c6ef-4169-bca9-198e08ac56e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:33.805344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ab7510c1-c6ef-4169-bca9-198e08ac56e3 None None] MFA Rules not processed for user `b7d01d86f2ae4e8f9e7e35c5bb7184e1`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:33.806726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ab7510c1-c6ef-4169-bca9-198e08ac56e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:34.023097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1221/2438] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:33 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:34.038243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf497b36-f704-4536-a7c0-56dbc447728c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:34.040238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-bf497b36-f704-4536-a7c0-56dbc447728c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:34.129343 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:34.211347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf497b36-f704-4536-a7c0-56dbc447728c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:34.236488 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49323e-98a9-4d21-a899-1a98d58f26b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5211ed409a3f43d281bca44382aa03fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:34.240617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49323e-98a9-4d21-a899-1a98d58f26b5 service glance] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:34.241730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49323e-98a9-4d21-a899-1a98d58f26b5 service glance] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:34.242189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49323e-98a9-4d21-a899-1a98d58f26b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:34.265198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49323e-98a9-4d21-a899-1a98d58f26b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:34.266933 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49323e-98a9-4d21-a899-1a98d58f26b5 service glance] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:34.278185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1218/2439] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:34 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:36.976108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7510c1-c6ef-4169-bca9-198e08ac56e3 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:36.978366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ab7510c1-c6ef-4169-bca9-198e08ac56e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:37.034297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:37.052902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7510c1-c6ef-4169-bca9-198e08ac56e3 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:37.059068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728a7ca1-d47d-4812-9bb4-2d285185d45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:37.060467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a7ca1-d47d-4812-9bb4-2d285185d45c admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:37.060467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a7ca1-d47d-4812-9bb4-2d285185d45c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:37.060750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728a7ca1-d47d-4812-9bb4-2d285185d45c admin admin] PATH_INFO: `/v3/users/6617f968cd214435a1efcb401ba33e38` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:37.062342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a7ca1-d47d-4812-9bb4-2d285185d45c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6617f968cd214435a1efcb401ba33e38)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:37.064645 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728a7ca1-d47d-4812-9bb4-2d285185d45c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:37.319876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-728a7ca1-d47d-4812-9bb4-2d285185d45c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6617f968cd214435a1efcb401ba33e38'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:37.320674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-728a7ca1-d47d-4812-9bb4-2d285185d45c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6617f968cd214435a1efcb401ba33e38'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:37.321328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-728a7ca1-d47d-4812-9bb4-2d285185d45c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6617f968cd214435a1efcb401ba33e38'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:37.427483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-728a7ca1-d47d-4812-9bb4-2d285185d45c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6617f968cd214435a1efcb401ba33e38'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:37.437624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-728a7ca1-d47d-4812-9bb4-2d285185d45c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6617f968cd214435a1efcb401ba33e38'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:37.467177 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1222/2440] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:16:36 2022] DELETE /identity/v3/users/6617f968cd214435a1efcb401ba33e38 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:37.788644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49323e-98a9-4d21-a899-1a98d58f26b5 service glance] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:37.806599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49323e-98a9-4d21-a899-1a98d58f26b5 service glance] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:37.880825 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abaf82e-c6b1-4c1e-8917-c67806d3887b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:37.881405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaf82e-c6b1-4c1e-8917-c67806d3887b admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:37.881847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaf82e-c6b1-4c1e-8917-c67806d3887b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:37.882165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abaf82e-c6b1-4c1e-8917-c67806d3887b admin admin] PATH_INFO: `/v3/projects/9a78c13b4d9f4b43a1d239673fc9cc91` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:37.884561 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abaf82e-c6b1-4c1e-8917-c67806d3887b admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a78c13b4d9f4b43a1d239673fc9cc91)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:37.887489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abaf82e-c6b1-4c1e-8917-c67806d3887b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:38.007599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-7abaf82e-c6b1-4c1e-8917-c67806d3887b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a78c13b4d9f4b43a1d239673fc9cc91', 'request_id': 'req-7abaf82e-c6b1-4c1e-8917-c67806d3887b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:38.013308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-7abaf82e-c6b1-4c1e-8917-c67806d3887b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a78c13b4d9f4b43a1d239673fc9cc91', 'request_id': 'req-7abaf82e-c6b1-4c1e-8917-c67806d3887b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:38.019625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-7abaf82e-c6b1-4c1e-8917-c67806d3887b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a78c13b4d9f4b43a1d239673fc9cc91', 'request_id': 'req-7abaf82e-c6b1-4c1e-8917-c67806d3887b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:38.089153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-7abaf82e-c6b1-4c1e-8917-c67806d3887b admin admin] The token cache is being invalidate because project 9a78c13b4d9f4b43a1d239673fc9cc91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:16:38.089620 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-7abaf82e-c6b1-4c1e-8917-c67806d3887b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:38.090446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-7abaf82e-c6b1-4c1e-8917-c67806d3887b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:38.092632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1219/2441] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:16:37 2022] DELETE /identity/v3/projects/9a78c13b4d9f4b43a1d239673fc9cc91 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:38.098123 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246647f-e116-44f7-8d6c-55d6dd0cce73 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:38.098626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246647f-e116-44f7-8d6c-55d6dd0cce73 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:38.098743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246647f-e116-44f7-8d6c-55d6dd0cce73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:38.122320 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-f246647f-e116-44f7-8d6c-55d6dd0cce73 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:38.123563 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f246647f-e116-44f7-8d6c-55d6dd0cce73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:38.195518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1223/2442] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:38.203494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eab25-2f73-4af9-99fd-874077938299 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:38.203946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eab25-2f73-4af9-99fd-874077938299 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:38.204288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25eab25-2f73-4af9-99fd-874077938299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:38.224517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-f25eab25-2f73-4af9-99fd-874077938299 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:38.225813 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f25eab25-2f73-4af9-99fd-874077938299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:38.234680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1220/2443] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:16:38.240320 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246647f-e116-44f7-8d6c-55d6dd0cce73 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:38.249135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246647f-e116-44f7-8d6c-55d6dd0cce73 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:38.253802 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62efe7a-d226-4524-9372-acbd1103e9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:38.254464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62efe7a-d226-4524-9372-acbd1103e9cc admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:38.254753 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62efe7a-d226-4524-9372-acbd1103e9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:38.255039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62efe7a-d226-4524-9372-acbd1103e9cc admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:38.255775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62efe7a-d226-4524-9372-acbd1103e9cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:16:38.256121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62efe7a-d226-4524-9372-acbd1103e9cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:38.257736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62efe7a-d226-4524-9372-acbd1103e9cc admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:38.270310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1224/2444] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:16:38.275003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eab25-2f73-4af9-99fd-874077938299 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:38.285547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25eab25-2f73-4af9-99fd-874077938299 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:38.290351 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861ea3c-961d-4f25-9a9e-653765df7bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:38.291008 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ea3c-961d-4f25-9a9e-653765df7bc6 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:38.291292 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ea3c-961d-4f25-9a9e-653765df7bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:38.291569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c861ea3c-961d-4f25-9a9e-653765df7bc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:38.292290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861ea3c-961d-4f25-9a9e-653765df7bc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:38.294324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c861ea3c-961d-4f25-9a9e-653765df7bc6 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:38.375742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1221/2445] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:16:38 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:38.380621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62efe7a-d226-4524-9372-acbd1103e9cc admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:38.394771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62efe7a-d226-4524-9372-acbd1103e9cc admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:38.496031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1cc8c-60be-4282-bf27-96c36c1c79c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:38.496970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1cc8c-60be-4282-bf27-96c36c1c79c4 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:38.497265 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1cc8c-60be-4282-bf27-96c36c1c79c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:38.497656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf1cc8c-60be-4282-bf27-96c36c1c79c4 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:38.498582 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1cc8c-60be-4282-bf27-96c36c1c79c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:38.500622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf1cc8c-60be-4282-bf27-96c36c1c79c4 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:38.508082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:38.602962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1225/2446] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:16:38 2022] POST /identity/v3/users => generated 287 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:38.607060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861ea3c-961d-4f25-9a9e-653765df7bc6 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:38.621711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c861ea3c-961d-4f25-9a9e-653765df7bc6 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:38.627380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8c3d7-fb6b-4a9a-b39d-e405beda13b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:38.628676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8c3d7-fb6b-4a9a-b39d-e405beda13b1 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:38.630256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8c3d7-fb6b-4a9a-b39d-e405beda13b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:38.630256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e8c3d7-fb6b-4a9a-b39d-e405beda13b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:38.630256 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8c3d7-fb6b-4a9a-b39d-e405beda13b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:38.631847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e8c3d7-fb6b-4a9a-b39d-e405beda13b1 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:38.645283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1222/2447] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:38.649874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1cc8c-60be-4282-bf27-96c36c1c79c4 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:38.660981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf1cc8c-60be-4282-bf27-96c36c1c79c4 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:38.670913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0213590d-cd51-4a84-a809-4696082d82d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:38.671629 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213590d-cd51-4a84-a809-4696082d82d8 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:38.671949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213590d-cd51-4a84-a809-4696082d82d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:38.672245 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0213590d-cd51-4a84-a809-4696082d82d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:38.672979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213590d-cd51-4a84-a809-4696082d82d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:38.674619 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0213590d-cd51-4a84-a809-4696082d82d8 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:38.685883 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1226/2448] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:38.691069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8c3d7-fb6b-4a9a-b39d-e405beda13b1 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:38.697578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:38.702518 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e8c3d7-fb6b-4a9a-b39d-e405beda13b1 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:38.708242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a40aff-81f2-4b1e-b96d-06050fed35f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:38.709143 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a40aff-81f2-4b1e-b96d-06050fed35f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:38.709425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a40aff-81f2-4b1e-b96d-06050fed35f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:38.709706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a40aff-81f2-4b1e-b96d-06050fed35f5 admin admin] PATH_INFO: `/v3/projects/4e7089b429e5453d992bd28e4636e9fd/users/a8a085ef3f864c4aa47f84057f1acff6/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:38.726657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a40aff-81f2-4b1e-b96d-06050fed35f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e7089b429e5453d992bd28e4636e9fd, user_id=a8a085ef3f864c4aa47f84057f1acff6, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:38.729506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a40aff-81f2-4b1e-b96d-06050fed35f5 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:38.831197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1223/2449] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:16:38 2022] PUT /identity/v3/projects/4e7089b429e5453d992bd28e4636e9fd/users/a8a085ef3f864c4aa47f84057f1acff6/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:16:38.842837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432d2c8-0741-4e82-99e6-b44915de86e5 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:38.843075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432d2c8-0741-4e82-99e6-b44915de86e5 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:38.843342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432d2c8-0741-4e82-99e6-b44915de86e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:38.873952 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-6432d2c8-0741-4e82-99e6-b44915de86e5 None None] MFA Rules not processed for user `a8a085ef3f864c4aa47f84057f1acff6`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:38.875723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-6432d2c8-0741-4e82-99e6-b44915de86e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:38.948961 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1227/2450] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:38.953289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a40aff-81f2-4b1e-b96d-06050fed35f5 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:39.031747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a40aff-81f2-4b1e-b96d-06050fed35f5 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:39.037319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4e531-e795-4634-8c0d-84e321bcd57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:39.038228 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4e531-e795-4634-8c0d-84e321bcd57f admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:39.039019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4e531-e795-4634-8c0d-84e321bcd57f admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:39.039019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4e531-e795-4634-8c0d-84e321bcd57f admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:39.039641 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4e531-e795-4634-8c0d-84e321bcd57f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:39.041909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4e531-e795-4634-8c0d-84e321bcd57f admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:39.203500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1224/2451] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:16:38 2022] POST /identity/v3/projects => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:16:39.211868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432d2c8-0741-4e82-99e6-b44915de86e5 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:39.227748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432d2c8-0741-4e82-99e6-b44915de86e5 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:39.306793 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68235b2c-4d2f-4a61-b479-afd169a9eeed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:39.307778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235b2c-4d2f-4a61-b479-afd169a9eeed admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:39.308431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235b2c-4d2f-4a61-b479-afd169a9eeed admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:39.308924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68235b2c-4d2f-4a61-b479-afd169a9eeed admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:39.313993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68235b2c-4d2f-4a61-b479-afd169a9eeed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:39.316870 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68235b2c-4d2f-4a61-b479-afd169a9eeed admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:39.405716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1228/2452] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:16:39 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:16:39.409463 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4e531-e795-4634-8c0d-84e321bcd57f admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:39.420753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4e531-e795-4634-8c0d-84e321bcd57f admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:39.429753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23603fac-5a45-4064-bc33-345547bed67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:39.430463 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23603fac-5a45-4064-bc33-345547bed67f admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:39.430753 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23603fac-5a45-4064-bc33-345547bed67f admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:39.431185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23603fac-5a45-4064-bc33-345547bed67f admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:39.432006 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23603fac-5a45-4064-bc33-345547bed67f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:39.434592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23603fac-5a45-4064-bc33-345547bed67f admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:39.449170 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1225/2453] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:39.458045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68235b2c-4d2f-4a61-b479-afd169a9eeed admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:39.468654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68235b2c-4d2f-4a61-b479-afd169a9eeed admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:39.473432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4b5b5-754b-4f36-b032-24b75a936404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:39.474610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4b5b5-754b-4f36-b032-24b75a936404 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:39.474610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4b5b5-754b-4f36-b032-24b75a936404 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:39.474902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4b5b5-754b-4f36-b032-24b75a936404 admin admin] PATH_INFO: `/v3/projects/5e583d70fd7f4236afa4f6e9d010c2e6/users/0657b0613ea541c5ada3a7560deda627/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:39.492947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4b5b5-754b-4f36-b032-24b75a936404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e583d70fd7f4236afa4f6e9d010c2e6, user_id=0657b0613ea541c5ada3a7560deda627, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:39.495726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4b5b5-754b-4f36-b032-24b75a936404 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:39.575679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1229/2454] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:16:39 2022] PUT /identity/v3/projects/5e583d70fd7f4236afa4f6e9d010c2e6/users/0657b0613ea541c5ada3a7560deda627/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:39.583858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23603fac-5a45-4064-bc33-345547bed67f admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:39.594917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23603fac-5a45-4064-bc33-345547bed67f admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:39.653952 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be821491-9d30-41ed-baf5-b4f960ab426c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:39.654558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821491-9d30-41ed-baf5-b4f960ab426c admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:39.654838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821491-9d30-41ed-baf5-b4f960ab426c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:39.655110 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be821491-9d30-41ed-baf5-b4f960ab426c admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:39.655887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be821491-9d30-41ed-baf5-b4f960ab426c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:39.657526 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be821491-9d30-41ed-baf5-b4f960ab426c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:39.668149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1226/2455] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:16:39.672667 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4b5b5-754b-4f36-b032-24b75a936404 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:39.685042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4b5b5-754b-4f36-b032-24b75a936404 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:39.690459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59845740-0d07-42cd-bd7a-fb3160fa4301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:39.697348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59845740-0d07-42cd-bd7a-fb3160fa4301 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:39.697348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59845740-0d07-42cd-bd7a-fb3160fa4301 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:39.697348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59845740-0d07-42cd-bd7a-fb3160fa4301 admin admin] PATH_INFO: `/v3/projects/5e583d70fd7f4236afa4f6e9d010c2e6/users/0657b0613ea541c5ada3a7560deda627/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:39.697348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59845740-0d07-42cd-bd7a-fb3160fa4301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e583d70fd7f4236afa4f6e9d010c2e6, user_id=0657b0613ea541c5ada3a7560deda627, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:39.697348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59845740-0d07-42cd-bd7a-fb3160fa4301 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:39.709957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1230/2456] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:16:39 2022] PUT /identity/v3/projects/5e583d70fd7f4236afa4f6e9d010c2e6/users/0657b0613ea541c5ada3a7560deda627/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:39.720729 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25477895-a8d0-4b07-8c8a-b2f8acdac43c None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:39.721050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25477895-a8d0-4b07-8c8a-b2f8acdac43c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:39.721335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25477895-a8d0-4b07-8c8a-b2f8acdac43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:39.748938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-25477895-a8d0-4b07-8c8a-b2f8acdac43c None None] MFA Rules not processed for user `0657b0613ea541c5ada3a7560deda627`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:39.750172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-25477895-a8d0-4b07-8c8a-b2f8acdac43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:39.789489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:39.820099 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1227/2457] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:16:39.832383 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59845740-0d07-42cd-bd7a-fb3160fa4301 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:39.834107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-59845740-0d07-42cd-bd7a-fb3160fa4301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:39.861252 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:39.898498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59845740-0d07-42cd-bd7a-fb3160fa4301 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:39.903533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c94a1-209a-4103-acd5-bc5189ccbe44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:39.903533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c94a1-209a-4103-acd5-bc5189ccbe44 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:39.903533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c94a1-209a-4103-acd5-bc5189ccbe44 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:39.903533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c94a1-209a-4103-acd5-bc5189ccbe44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:39.913925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c94a1-209a-4103-acd5-bc5189ccbe44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:39.915338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c94a1-209a-4103-acd5-bc5189ccbe44 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:39.927591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1231/2458] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:40.206004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25477895-a8d0-4b07-8c8a-b2f8acdac43c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:40.216543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25477895-a8d0-4b07-8c8a-b2f8acdac43c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:40.220708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34d232-1da0-4c16-a927-cf8cee5f9ae6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:40.221517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34d232-1da0-4c16-a927-cf8cee5f9ae6 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:40.222381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34d232-1da0-4c16-a927-cf8cee5f9ae6 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:40.222669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34d232-1da0-4c16-a927-cf8cee5f9ae6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:40.286752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34d232-1da0-4c16-a927-cf8cee5f9ae6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:40.288288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34d232-1da0-4c16-a927-cf8cee5f9ae6 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:40.298361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1228/2459] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:40 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:44.189483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3dd0e-4e51-4415-b8ba-1b7cc984afff None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:44.189969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3dd0e-4e51-4415-b8ba-1b7cc984afff None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:44.190175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b3dd0e-4e51-4415-b8ba-1b7cc984afff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:44.210612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-07b3dd0e-4e51-4415-b8ba-1b7cc984afff None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:44.211910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-07b3dd0e-4e51-4415-b8ba-1b7cc984afff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:44.292993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1232/2460] 10.222.0.52 () {58 vars in 967 bytes} [Thu Jun 23 11:16:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:44.316045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34d232-1da0-4c16-a927-cf8cee5f9ae6 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:44.317480 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-bc34d232-1da0-4c16-a927-cf8cee5f9ae6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:44.406916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34d232-1da0-4c16-a927-cf8cee5f9ae6 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:44.414569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b075cdb-8b78-4e17-bde7-c23d58e46f55 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:44.415332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b075cdb-8b78-4e17-bde7-c23d58e46f55 service swift] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:44.415692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b075cdb-8b78-4e17-bde7-c23d58e46f55 service swift] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:44.416098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b075cdb-8b78-4e17-bde7-c23d58e46f55 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:44.433601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b075cdb-8b78-4e17-bde7-c23d58e46f55 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:44.435318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b075cdb-8b78-4e17-bde7-c23d58e46f55 service swift] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:44.444348 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1229/2461] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:16:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:16:44.553227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09413f-7bcc-4353-bef4-600749195b03 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:44.553627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09413f-7bcc-4353-bef4-600749195b03 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:44.553978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c09413f-7bcc-4353-bef4-600749195b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:44.574213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-7c09413f-7bcc-4353-bef4-600749195b03 None None] MFA Rules not processed for user `bdc5ef02c9fd4b2888239b9b19ae4d5e`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:44.575441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7c09413f-7bcc-4353-bef4-600749195b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:44.647516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1233/2462] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:16:49.619608 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b075cdb-8b78-4e17-bde7-c23d58e46f55 service swift] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:49.621557 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-7b075cdb-8b78-4e17-bde7-c23d58e46f55 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:49.696679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:49.711075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b075cdb-8b78-4e17-bde7-c23d58e46f55 service swift] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:49.716566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b09443f-63c5-4ae1-bc93-fd6468837162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:49.717246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09443f-63c5-4ae1-bc93-fd6468837162 service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:49.717527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09443f-63c5-4ae1-bc93-fd6468837162 service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:49.717800 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b09443f-63c5-4ae1-bc93-fd6468837162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:49.720183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6b09443f-63c5-4ae1-bc93-fd6468837162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:49.731538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09443f-63c5-4ae1-bc93-fd6468837162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:49.733486 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b09443f-63c5-4ae1-bc93-fd6468837162 service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:49.755986 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1230/2463] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:16:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:16:54.639882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=67 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:16:59.600087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09413f-7bcc-4353-bef4-600749195b03 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:16:59.601578 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7c09413f-7bcc-4353-bef4-600749195b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:16:59.670794 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c09413f-7bcc-4353-bef4-600749195b03 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:16:59.675486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:16:59.676385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:59.676669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:59.676949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] PATH_INFO: `/v3/users/b7d01d86f2ae4e8f9e7e35c5bb7184e1` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:59.678161 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d01d86f2ae4e8f9e7e35c5bb7184e1)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:16:59.680172 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:16:59.868576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d01d86f2ae4e8f9e7e35c5bb7184e1'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:59.869865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d01d86f2ae4e8f9e7e35c5bb7184e1'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:59.870511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d01d86f2ae4e8f9e7e35c5bb7184e1'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:59.939628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d01d86f2ae4e8f9e7e35c5bb7184e1'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:59.949121 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d01d86f2ae4e8f9e7e35c5bb7184e1'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:16:59.968631 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1234/2464] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:16:59 2022] DELETE /identity/v3/users/b7d01d86f2ae4e8f9e7e35c5bb7184e1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:16:59.973401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7cde6-3000-4889-b7b3-517c752ce03f None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:16:59.973907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7cde6-3000-4889-b7b3-517c752ce03f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:16:59.974083 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7cde6-3000-4889-b7b3-517c752ce03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:16:59.992457 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b3c7cde6-3000-4889-b7b3-517c752ce03f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:16:59.994218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b3c7cde6-3000-4889-b7b3-517c752ce03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:00.055627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1231/2465] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:00.066631 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:00.068226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:00.125936 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5728d2-3947-4732-9a3c-8011f04111d7 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:00.129477 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1ddcb8-53f4-4635-8174-987f65b2abb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:00.130124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ddcb8-53f4-4635-8174-987f65b2abb4 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:00.130408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ddcb8-53f4-4635-8174-987f65b2abb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:00.130683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ddcb8-53f4-4635-8174-987f65b2abb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:00.140540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ddcb8-53f4-4635-8174-987f65b2abb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:00.142023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1ddcb8-53f4-4635-8174-987f65b2abb4 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:00.151882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1235/2466] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:00.593869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7cde6-3000-4889-b7b3-517c752ce03f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:00.595368 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b3c7cde6-3000-4889-b7b3-517c752ce03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:00.621212 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7cde6-3000-4889-b7b3-517c752ce03f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:00.628822 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d66127-3883-4b47-b5b7-66903e35de8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:00.629907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66127-3883-4b47-b5b7-66903e35de8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:00.630209 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66127-3883-4b47-b5b7-66903e35de8f admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:00.630550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d66127-3883-4b47-b5b7-66903e35de8f admin admin] PATH_INFO: `/v3/projects/834c96682916408980a20b021d05c1f3` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:00.632003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d66127-3883-4b47-b5b7-66903e35de8f admin admin] RBAC: Authorizing `identity:delete_project(project_id=834c96682916408980a20b021d05c1f3)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:00.634700 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d66127-3883-4b47-b5b7-66903e35de8f admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:00.777172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d9d66127-3883-4b47-b5b7-66903e35de8f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '834c96682916408980a20b021d05c1f3', 'request_id': 'req-d9d66127-3883-4b47-b5b7-66903e35de8f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:00.782807 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d9d66127-3883-4b47-b5b7-66903e35de8f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '834c96682916408980a20b021d05c1f3', 'request_id': 'req-d9d66127-3883-4b47-b5b7-66903e35de8f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:00.796765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d9d66127-3883-4b47-b5b7-66903e35de8f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '834c96682916408980a20b021d05c1f3', 'request_id': 'req-d9d66127-3883-4b47-b5b7-66903e35de8f'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:00.865306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d9d66127-3883-4b47-b5b7-66903e35de8f admin admin] The token cache is being invalidate because project 834c96682916408980a20b021d05c1f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:00.865824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d9d66127-3883-4b47-b5b7-66903e35de8f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:00.866430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d9d66127-3883-4b47-b5b7-66903e35de8f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:00.871678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1232/2467] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:00 2022] DELETE /identity/v3/projects/834c96682916408980a20b021d05c1f3 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:00.873092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92b7bb-0ffd-4b2c-b440-844809b0e9a9 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:00.873561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92b7bb-0ffd-4b2c-b440-844809b0e9a9 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:00.873644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92b7bb-0ffd-4b2c-b440-844809b0e9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:00.894586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0e92b7bb-0ffd-4b2c-b440-844809b0e9a9 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:00.896143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0e92b7bb-0ffd-4b2c-b440-844809b0e9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:00.916708 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:00.980092 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1236/2468] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:00.987965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3028a-5abb-4ec9-b57e-a2bdcab506e8 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:00.988828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3028a-5abb-4ec9-b57e-a2bdcab506e8 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:00.989261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f3028a-5abb-4ec9-b57e-a2bdcab506e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:01.008673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b3f3028a-5abb-4ec9-b57e-a2bdcab506e8 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:01.011025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b3f3028a-5abb-4ec9-b57e-a2bdcab506e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:01.020135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1233/2469] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:01.024421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92b7bb-0ffd-4b2c-b440-844809b0e9a9 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:01.036163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92b7bb-0ffd-4b2c-b440-844809b0e9a9 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:01.042187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490483-2f03-46ac-88a5-f14f9b35bd79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:01.044776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490483-2f03-46ac-88a5-f14f9b35bd79 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:01.044776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490483-2f03-46ac-88a5-f14f9b35bd79 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:01.044776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b490483-2f03-46ac-88a5-f14f9b35bd79 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:01.044776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b490483-2f03-46ac-88a5-f14f9b35bd79 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:01.044776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b490483-2f03-46ac-88a5-f14f9b35bd79 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:01.046529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b490483-2f03-46ac-88a5-f14f9b35bd79 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:01.060047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1237/2470] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:01.070178 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3028a-5abb-4ec9-b57e-a2bdcab506e8 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:01.080816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f3028a-5abb-4ec9-b57e-a2bdcab506e8 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:01.086308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc1207-b415-47ca-9cfc-493f4a3473d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:01.086980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc1207-b415-47ca-9cfc-493f4a3473d1 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:01.087265 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc1207-b415-47ca-9cfc-493f4a3473d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:01.088169 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acc1207-b415-47ca-9cfc-493f4a3473d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:01.089275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc1207-b415-47ca-9cfc-493f4a3473d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:01.090796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acc1207-b415-47ca-9cfc-493f4a3473d1 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:01.202027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1234/2471] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:01 2022] POST /identity/v3/projects => generated 365 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:01.206721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490483-2f03-46ac-88a5-f14f9b35bd79 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:01.218787 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b490483-2f03-46ac-88a5-f14f9b35bd79 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:01.288715 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442d75-e134-4e49-95c9-0f4fe450ff2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:01.289391 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442d75-e134-4e49-95c9-0f4fe450ff2a admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:01.289674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442d75-e134-4e49-95c9-0f4fe450ff2a admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:01.289953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1442d75-e134-4e49-95c9-0f4fe450ff2a admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:01.291198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1442d75-e134-4e49-95c9-0f4fe450ff2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:01.293345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1442d75-e134-4e49-95c9-0f4fe450ff2a admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:01.369737 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1238/2472] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:01 2022] POST /identity/v3/users => generated 283 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:01.374119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc1207-b415-47ca-9cfc-493f4a3473d1 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:01.386642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acc1207-b415-47ca-9cfc-493f4a3473d1 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:01.393442 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec613db-1fd5-4f56-978a-47db42b6b1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:01.394305 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec613db-1fd5-4f56-978a-47db42b6b1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:01.394682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec613db-1fd5-4f56-978a-47db42b6b1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:01.395039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec613db-1fd5-4f56-978a-47db42b6b1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:01.396042 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec613db-1fd5-4f56-978a-47db42b6b1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:01.398031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec613db-1fd5-4f56-978a-47db42b6b1b4 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:01.413617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1235/2473] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:01.415654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442d75-e134-4e49-95c9-0f4fe450ff2a admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:01.427000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1442d75-e134-4e49-95c9-0f4fe450ff2a admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:01.433541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f082f08-4045-45b6-9714-7a86feac0ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:01.434229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f082f08-4045-45b6-9714-7a86feac0ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:01.434534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f082f08-4045-45b6-9714-7a86feac0ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:01.434868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f082f08-4045-45b6-9714-7a86feac0ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:01.435539 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f082f08-4045-45b6-9714-7a86feac0ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:01.438012 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f082f08-4045-45b6-9714-7a86feac0ff8 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:01.451230 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1239/2474] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:01.455555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec613db-1fd5-4f56-978a-47db42b6b1b4 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:01.466107 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec613db-1fd5-4f56-978a-47db42b6b1b4 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:01.471467 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197d174-ba54-41be-864d-8c51e8c7faa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:01.472412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197d174-ba54-41be-864d-8c51e8c7faa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:01.472701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197d174-ba54-41be-864d-8c51e8c7faa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:01.472980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1197d174-ba54-41be-864d-8c51e8c7faa9 admin admin] PATH_INFO: `/v3/projects/734b8e0606fa40a3bcbf7bd521910835/users/3c42ff3b5a7e4ec1adec47f5bf030b5c/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:01.488452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197d174-ba54-41be-864d-8c51e8c7faa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734b8e0606fa40a3bcbf7bd521910835, user_id=3c42ff3b5a7e4ec1adec47f5bf030b5c, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:01.491125 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1197d174-ba54-41be-864d-8c51e8c7faa9 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:01.570876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1236/2475] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:01 2022] PUT /identity/v3/projects/734b8e0606fa40a3bcbf7bd521910835/users/3c42ff3b5a7e4ec1adec47f5bf030b5c/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:01.584422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da206-4379-47d4-9819-3445efed7ffa None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:01.584422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da206-4379-47d4-9819-3445efed7ffa None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:01.584647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4da206-4379-47d4-9819-3445efed7ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:01.614312 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-de4da206-4379-47d4-9819-3445efed7ffa None None] MFA Rules not processed for user `3c42ff3b5a7e4ec1adec47f5bf030b5c`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:01.615583 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-de4da206-4379-47d4-9819-3445efed7ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:01.687649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1240/2476] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:01 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:01.699708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197d174-ba54-41be-864d-8c51e8c7faa9 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:01.702424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1197d174-ba54-41be-864d-8c51e8c7faa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:01.713151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:01.768584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1197d174-ba54-41be-864d-8c51e8c7faa9 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:01.772636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e5cac-ced8-4f1c-af02-77c66dad8528 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:01.773461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e5cac-ced8-4f1c-af02-77c66dad8528 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:01.773975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e5cac-ced8-4f1c-af02-77c66dad8528 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:01.774386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e5cac-ced8-4f1c-af02-77c66dad8528 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:01.784525 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e5cac-ced8-4f1c-af02-77c66dad8528 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:01.786081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e5cac-ced8-4f1c-af02-77c66dad8528 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:01.796592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1237/2477] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:01 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:11.684135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:12.013930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=23 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:17.931497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4da206-4379-47d4-9819-3445efed7ffa None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:17.933088 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-de4da206-4379-47d4-9819-3445efed7ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:18.002868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4da206-4379-47d4-9819-3445efed7ffa None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:18.007356 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:18.008267 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:18.008557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:18.008834 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] PATH_INFO: `/v3/users/a8a085ef3f864c4aa47f84057f1acff6` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:18.010026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8a085ef3f864c4aa47f84057f1acff6)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:18.012080 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:18.249895 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8a085ef3f864c4aa47f84057f1acff6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:18.250705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8a085ef3f864c4aa47f84057f1acff6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:18.251355 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8a085ef3f864c4aa47f84057f1acff6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:18.344456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8a085ef3f864c4aa47f84057f1acff6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:18.352797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8a085ef3f864c4aa47f84057f1acff6'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:18.370821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1241/2478] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:17 2022] DELETE /identity/v3/users/a8a085ef3f864c4aa47f84057f1acff6 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:18.375761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b11f90-6cce-4c16-b587-07cfb2421d1e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:18.376300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b11f90-6cce-4c16-b587-07cfb2421d1e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:18.376465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b11f90-6cce-4c16-b587-07cfb2421d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:18.395095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-c6b11f90-6cce-4c16-b587-07cfb2421d1e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:18.396337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c6b11f90-6cce-4c16-b587-07cfb2421d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:18.460252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1238/2479] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:18.470755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:18.472307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:18.532922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0301521-5155-488d-8792-ac42ae837a9e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:18.536524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962a5bd-3d11-4aa1-8643-7c58d792b261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:18.537201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962a5bd-3d11-4aa1-8643-7c58d792b261 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:18.537484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962a5bd-3d11-4aa1-8643-7c58d792b261 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:18.537762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962a5bd-3d11-4aa1-8643-7c58d792b261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:18.547255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962a5bd-3d11-4aa1-8643-7c58d792b261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:18.548759 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962a5bd-3d11-4aa1-8643-7c58d792b261 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:18.559323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1242/2480] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:18.968628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b11f90-6cce-4c16-b587-07cfb2421d1e None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:18.970127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c6b11f90-6cce-4c16-b587-07cfb2421d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:18.985687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b11f90-6cce-4c16-b587-07cfb2421d1e None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:18.990454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:18.992171 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:18.992461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:18.992738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] PATH_INFO: `/v3/projects/4e7089b429e5453d992bd28e4636e9fd` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:18.993992 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e7089b429e5453d992bd28e4636e9fd)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:18.995901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:19.130318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e7089b429e5453d992bd28e4636e9fd', 'request_id': 'req-04358ac5-c0c6-4eca-a8d6-a92571782d38'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:19.136090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e7089b429e5453d992bd28e4636e9fd', 'request_id': 'req-04358ac5-c0c6-4eca-a8d6-a92571782d38'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:19.142381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e7089b429e5453d992bd28e4636e9fd', 'request_id': 'req-04358ac5-c0c6-4eca-a8d6-a92571782d38'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:19.206773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] The token cache is being invalidate because project 4e7089b429e5453d992bd28e4636e9fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:19.207959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:19.207959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:19.209261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1239/2481] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:18 2022] DELETE /identity/v3/projects/4e7089b429e5453d992bd28e4636e9fd => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:19.213307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962a5bd-3d11-4aa1-8643-7c58d792b261 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:19.224126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962a5bd-3d11-4aa1-8643-7c58d792b261 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:19.243533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:19.285933 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df96cd5-503c-4978-98bd-82efa0d8a54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:19.286809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df96cd5-503c-4978-98bd-82efa0d8a54b admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:19.287094 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df96cd5-503c-4978-98bd-82efa0d8a54b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:19.287370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df96cd5-503c-4978-98bd-82efa0d8a54b admin admin] PATH_INFO: `/v3/users/0657b0613ea541c5ada3a7560deda627` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:19.288594 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df96cd5-503c-4978-98bd-82efa0d8a54b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0657b0613ea541c5ada3a7560deda627)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:19.290529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df96cd5-503c-4978-98bd-82efa0d8a54b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:19.493189 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4df96cd5-503c-4978-98bd-82efa0d8a54b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0657b0613ea541c5ada3a7560deda627'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:19.493884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4df96cd5-503c-4978-98bd-82efa0d8a54b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0657b0613ea541c5ada3a7560deda627'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:19.494484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4df96cd5-503c-4978-98bd-82efa0d8a54b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0657b0613ea541c5ada3a7560deda627'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:19.561639 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4df96cd5-503c-4978-98bd-82efa0d8a54b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0657b0613ea541c5ada3a7560deda627'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:19.569303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4df96cd5-503c-4978-98bd-82efa0d8a54b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0657b0613ea541c5ada3a7560deda627'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:19.589057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1243/2482] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:19 2022] DELETE /identity/v3/users/0657b0613ea541c5ada3a7560deda627 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:20.032572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:20.035035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:20.057278 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04358ac5-c0c6-4eca-a8d6-a92571782d38 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:20.124312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482571-1760-4731-b246-70baf23fe884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:20.125299 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482571-1760-4731-b246-70baf23fe884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:20.125676 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482571-1760-4731-b246-70baf23fe884 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:20.125954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482571-1760-4731-b246-70baf23fe884 admin admin] PATH_INFO: `/v3/projects/5e583d70fd7f4236afa4f6e9d010c2e6` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:20.127183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e482571-1760-4731-b246-70baf23fe884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e583d70fd7f4236afa4f6e9d010c2e6)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:20.129147 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e482571-1760-4731-b246-70baf23fe884 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:20.208959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:20.225101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-5e482571-1760-4731-b246-70baf23fe884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e583d70fd7f4236afa4f6e9d010c2e6', 'request_id': 'req-5e482571-1760-4731-b246-70baf23fe884'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:20.230320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-5e482571-1760-4731-b246-70baf23fe884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e583d70fd7f4236afa4f6e9d010c2e6', 'request_id': 'req-5e482571-1760-4731-b246-70baf23fe884'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:20.236439 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-5e482571-1760-4731-b246-70baf23fe884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e583d70fd7f4236afa4f6e9d010c2e6', 'request_id': 'req-5e482571-1760-4731-b246-70baf23fe884'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:20.338381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-5e482571-1760-4731-b246-70baf23fe884 admin admin] The token cache is being invalidate because project 5e583d70fd7f4236afa4f6e9d010c2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:20.338764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-5e482571-1760-4731-b246-70baf23fe884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:20.339555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-5e482571-1760-4731-b246-70baf23fe884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:20.341356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1240/2483] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:20 2022] DELETE /identity/v3/projects/5e583d70fd7f4236afa4f6e9d010c2e6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:20.346532 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5420be-5d37-4b19-aa5e-90f56bcda443 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:20.347055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5420be-5d37-4b19-aa5e-90f56bcda443 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:20.347253 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5420be-5d37-4b19-aa5e-90f56bcda443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:20.368726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-4a5420be-5d37-4b19-aa5e-90f56bcda443 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:20.369981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-4a5420be-5d37-4b19-aa5e-90f56bcda443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:20.458560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1244/2484] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:20.460423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5cfed-37ed-4d76-a7d6-291162a94023 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:20.460724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5cfed-37ed-4d76-a7d6-291162a94023 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:20.461068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b5cfed-37ed-4d76-a7d6-291162a94023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:20.483284 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-87b5cfed-37ed-4d76-a7d6-291162a94023 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:20.484570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-87b5cfed-37ed-4d76-a7d6-291162a94023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:20.494453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1241/2485] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:20.499441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5420be-5d37-4b19-aa5e-90f56bcda443 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:20.509831 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5420be-5d37-4b19-aa5e-90f56bcda443 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:20.516765 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bc0bc-1b49-4565-99cd-863741c47ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:20.517452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bc0bc-1b49-4565-99cd-863741c47ecf admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:20.520322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bc0bc-1b49-4565-99cd-863741c47ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:20.520322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88bc0bc-1b49-4565-99cd-863741c47ecf admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:20.520322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bc0bc-1b49-4565-99cd-863741c47ecf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:20.520322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bc0bc-1b49-4565-99cd-863741c47ecf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:20.520694 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88bc0bc-1b49-4565-99cd-863741c47ecf admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:20.535852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1245/2486] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:17:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:20.537447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5cfed-37ed-4d76-a7d6-291162a94023 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:20.548462 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b5cfed-37ed-4d76-a7d6-291162a94023 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:20.553395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2e04d-0b8c-4c5f-93bd-cbad5cc71ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:20.554070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2e04d-0b8c-4c5f-93bd-cbad5cc71ef8 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:20.555964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2e04d-0b8c-4c5f-93bd-cbad5cc71ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:20.555964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d2e04d-0b8c-4c5f-93bd-cbad5cc71ef8 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:20.555964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2e04d-0b8c-4c5f-93bd-cbad5cc71ef8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:20.557204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d2e04d-0b8c-4c5f-93bd-cbad5cc71ef8 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:20.626964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1242/2487] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:20 2022] POST /identity/v3/projects => generated 365 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:20.631363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bc0bc-1b49-4565-99cd-863741c47ecf admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:20.641623 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88bc0bc-1b49-4565-99cd-863741c47ecf admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:20.668306 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:20.701308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc5048-d3ea-4cd7-9a03-6b5e6c48743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:20.701985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc5048-d3ea-4cd7-9a03-6b5e6c48743b admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:20.702266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc5048-d3ea-4cd7-9a03-6b5e6c48743b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:20.702549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc5048-d3ea-4cd7-9a03-6b5e6c48743b admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:20.703302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc5048-d3ea-4cd7-9a03-6b5e6c48743b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:20.705814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc5048-d3ea-4cd7-9a03-6b5e6c48743b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:20.773221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1246/2488] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:20 2022] POST /identity/v3/users => generated 283 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:20.777322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2e04d-0b8c-4c5f-93bd-cbad5cc71ef8 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:20.788280 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d2e04d-0b8c-4c5f-93bd-cbad5cc71ef8 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:20.793360 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcfb0d-b00e-4172-8e8c-709ba928b01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:20.794040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcfb0d-b00e-4172-8e8c-709ba928b01c admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:20.794325 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcfb0d-b00e-4172-8e8c-709ba928b01c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:20.795252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fcfb0d-b00e-4172-8e8c-709ba928b01c admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:20.796025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcfb0d-b00e-4172-8e8c-709ba928b01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:20.797687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fcfb0d-b00e-4172-8e8c-709ba928b01c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:20.808674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1243/2489] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:20.813112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc5048-d3ea-4cd7-9a03-6b5e6c48743b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:20.823634 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc5048-d3ea-4cd7-9a03-6b5e6c48743b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:20.828552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065fb3d3-8868-49f2-82d8-c47addf1da94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:20.834276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fb3d3-8868-49f2-82d8-c47addf1da94 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:20.834276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fb3d3-8868-49f2-82d8-c47addf1da94 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:20.834276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065fb3d3-8868-49f2-82d8-c47addf1da94 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:20.834276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fb3d3-8868-49f2-82d8-c47addf1da94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:20.834276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065fb3d3-8868-49f2-82d8-c47addf1da94 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:20.845051 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1247/2490] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:20.849200 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcfb0d-b00e-4172-8e8c-709ba928b01c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:20.860238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fcfb0d-b00e-4172-8e8c-709ba928b01c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:20.865487 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebdbfe-4db6-402a-bdfa-8883fe367c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:20.866390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebdbfe-4db6-402a-bdfa-8883fe367c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:20.866770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebdbfe-4db6-402a-bdfa-8883fe367c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:20.867051 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ebdbfe-4db6-402a-bdfa-8883fe367c0f admin admin] PATH_INFO: `/v3/projects/46bc4b83e8ae4ba38540ce489f279ee5/users/aae7465337214a8cbc909267b35f6e58/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:20.882443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebdbfe-4db6-402a-bdfa-8883fe367c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=46bc4b83e8ae4ba38540ce489f279ee5, user_id=aae7465337214a8cbc909267b35f6e58, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:20.885146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ebdbfe-4db6-402a-bdfa-8883fe367c0f admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:21.031606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1244/2491] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:20 2022] PUT /identity/v3/projects/46bc4b83e8ae4ba38540ce489f279ee5/users/aae7465337214a8cbc909267b35f6e58/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:21.042837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca1583-d29b-44c7-b440-1fc3234697f4 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:21.043108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca1583-d29b-44c7-b440-1fc3234697f4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:21.043396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca1583-d29b-44c7-b440-1fc3234697f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:21.071770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-4bca1583-d29b-44c7-b440-1fc3234697f4 None None] MFA Rules not processed for user `aae7465337214a8cbc909267b35f6e58`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:21.073018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-4bca1583-d29b-44c7-b440-1fc3234697f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:21.137519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1248/2492] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:21 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:21.142619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebdbfe-4db6-402a-bdfa-8883fe367c0f admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:21.205268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ebdbfe-4db6-402a-bdfa-8883fe367c0f admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:21.210668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bed2c-4271-4614-b409-0ee6501414b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:21.211349 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bed2c-4271-4614-b409-0ee6501414b7 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:21.211635 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bed2c-4271-4614-b409-0ee6501414b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:21.211951 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6bed2c-4271-4614-b409-0ee6501414b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:21.212713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bed2c-4271-4614-b409-0ee6501414b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:21.214683 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6bed2c-4271-4614-b409-0ee6501414b7 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:21.300276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1245/2493] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:21 2022] POST /identity/v3/projects => generated 363 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:21.304310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca1583-d29b-44c7-b440-1fc3234697f4 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:21.316276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca1583-d29b-44c7-b440-1fc3234697f4 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:21.378782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7030-ca2b-4ed7-835e-c3a5e95ac948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:21.379516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7030-ca2b-4ed7-835e-c3a5e95ac948 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:21.379742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7030-ca2b-4ed7-835e-c3a5e95ac948 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:21.380058 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea7030-ca2b-4ed7-835e-c3a5e95ac948 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:21.380761 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea7030-ca2b-4ed7-835e-c3a5e95ac948 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:21.382709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea7030-ca2b-4ed7-835e-c3a5e95ac948 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:21.459446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1249/2494] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:21 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:21.463423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bed2c-4271-4614-b409-0ee6501414b7 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:21.474048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6bed2c-4271-4614-b409-0ee6501414b7 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:21.478720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935f9a9-e57f-4794-b843-cccfc246dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:21.479374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935f9a9-e57f-4794-b843-cccfc246dc6b admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:21.479657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935f9a9-e57f-4794-b843-cccfc246dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:21.480174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935f9a9-e57f-4794-b843-cccfc246dc6b admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:21.480895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935f9a9-e57f-4794-b843-cccfc246dc6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:21.482489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935f9a9-e57f-4794-b843-cccfc246dc6b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:21.496615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1246/2495] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:21.498950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7030-ca2b-4ed7-835e-c3a5e95ac948 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:21.509780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea7030-ca2b-4ed7-835e-c3a5e95ac948 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:21.515422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb4485-fbda-4291-b286-eac114b3588c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:21.517630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb4485-fbda-4291-b286-eac114b3588c admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:21.517630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb4485-fbda-4291-b286-eac114b3588c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:21.517824 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adeb4485-fbda-4291-b286-eac114b3588c admin admin] PATH_INFO: `/v3/projects/094ba0bf757648ba82a3c1568ed6d3a8/users/230d46894d6648e79ac8b9607c68c824/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:21.534206 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb4485-fbda-4291-b286-eac114b3588c admin admin] RBAC: Authorizing `identity:create_grant(project_id=094ba0bf757648ba82a3c1568ed6d3a8, user_id=230d46894d6648e79ac8b9607c68c824, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:21.536957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adeb4485-fbda-4291-b286-eac114b3588c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:21.619748 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1250/2496] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:21 2022] PUT /identity/v3/projects/094ba0bf757648ba82a3c1568ed6d3a8/users/230d46894d6648e79ac8b9607c68c824/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:21.624394 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935f9a9-e57f-4794-b843-cccfc246dc6b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:21.634902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935f9a9-e57f-4794-b843-cccfc246dc6b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:21.655554 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:21.695888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db089aac-f1b9-43fa-8e88-044cc120a423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:21.696801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db089aac-f1b9-43fa-8e88-044cc120a423 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:21.697114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db089aac-f1b9-43fa-8e88-044cc120a423 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:21.697416 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db089aac-f1b9-43fa-8e88-044cc120a423 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:21.698168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db089aac-f1b9-43fa-8e88-044cc120a423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:21.699883 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db089aac-f1b9-43fa-8e88-044cc120a423 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:21.720210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1247/2497] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:21.721740 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb4485-fbda-4291-b286-eac114b3588c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:21.728604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:21.735298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adeb4485-fbda-4291-b286-eac114b3588c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:21.740310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acff63-646b-42ba-85d6-2ceb24edf0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:21.741236 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acff63-646b-42ba-85d6-2ceb24edf0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:21.741566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acff63-646b-42ba-85d6-2ceb24edf0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:21.741844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59acff63-646b-42ba-85d6-2ceb24edf0a2 admin admin] PATH_INFO: `/v3/projects/094ba0bf757648ba82a3c1568ed6d3a8/users/230d46894d6648e79ac8b9607c68c824/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:21.743827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acff63-646b-42ba-85d6-2ceb24edf0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=094ba0bf757648ba82a3c1568ed6d3a8, user_id=230d46894d6648e79ac8b9607c68c824, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:21.746537 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59acff63-646b-42ba-85d6-2ceb24edf0a2 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:21.757876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1251/2498] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:21 2022] PUT /identity/v3/projects/094ba0bf757648ba82a3c1568ed6d3a8/users/230d46894d6648e79ac8b9607c68c824/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:21.769309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5ef47-0512-497a-b9f4-b7dc224e07d7 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:21.769603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5ef47-0512-497a-b9f4-b7dc224e07d7 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:21.769889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5ef47-0512-497a-b9f4-b7dc224e07d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:21.800369 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-9ae5ef47-0512-497a-b9f4-b7dc224e07d7 None None] MFA Rules not processed for user `230d46894d6648e79ac8b9607c68c824`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:21.801652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-9ae5ef47-0512-497a-b9f4-b7dc224e07d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:21.873919 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1248/2499] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:21 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:21.885999 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acff63-646b-42ba-85d6-2ceb24edf0a2 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:21.887838 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-59acff63-646b-42ba-85d6-2ceb24edf0a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:21.948249 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59acff63-646b-42ba-85d6-2ceb24edf0a2 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:21.952077 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed295d29-6e77-41bd-a72e-65cecbc21e9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:21.952727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed295d29-6e77-41bd-a72e-65cecbc21e9d service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:21.953011 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed295d29-6e77-41bd-a72e-65cecbc21e9d service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:21.953319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed295d29-6e77-41bd-a72e-65cecbc21e9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:21.962974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed295d29-6e77-41bd-a72e-65cecbc21e9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:21.964463 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed295d29-6e77-41bd-a72e-65cecbc21e9d service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:21.977755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1252/2500] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:21 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:22.208761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5ef47-0512-497a-b9f4-b7dc224e07d7 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:22.218974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5ef47-0512-497a-b9f4-b7dc224e07d7 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:22.223035 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52259de7-2ba8-403d-9e64-ac6986c10358 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:22.223747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52259de7-2ba8-403d-9e64-ac6986c10358 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:22.224062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52259de7-2ba8-403d-9e64-ac6986c10358 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:22.224594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52259de7-2ba8-403d-9e64-ac6986c10358 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:22.289115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52259de7-2ba8-403d-9e64-ac6986c10358 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:22.290579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52259de7-2ba8-403d-9e64-ac6986c10358 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:22.300492 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1249/2501] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:22 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:27.601348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed295d29-6e77-41bd-a72e-65cecbc21e9d service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:27.602770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ed295d29-6e77-41bd-a72e-65cecbc21e9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:27.661778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed295d29-6e77-41bd-a72e-65cecbc21e9d service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:27.665396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542a613-001d-42b3-a9ed-fc99d182fa67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:27.666035 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542a613-001d-42b3-a9ed-fc99d182fa67 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:27.666319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542a613-001d-42b3-a9ed-fc99d182fa67 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:27.666596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a542a613-001d-42b3-a9ed-fc99d182fa67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:27.668390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a542a613-001d-42b3-a9ed-fc99d182fa67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:27.731459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542a613-001d-42b3-a9ed-fc99d182fa67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:27.732965 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a542a613-001d-42b3-a9ed-fc99d182fa67 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:27.743018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1253/2502] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:31.616123 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52259de7-2ba8-403d-9e64-ac6986c10358 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:31.617831 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-52259de7-2ba8-403d-9e64-ac6986c10358 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:31.637449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52259de7-2ba8-403d-9e64-ac6986c10358 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:31.642908 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748f1da-86ee-4109-a7c9-718ea1ea1966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:31.643773 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748f1da-86ee-4109-a7c9-718ea1ea1966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:31.644128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748f1da-86ee-4109-a7c9-718ea1ea1966 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:31.644432 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748f1da-86ee-4109-a7c9-718ea1ea1966 admin admin] PATH_INFO: `/v3/users/54404c13a1cf4d4eab0082fbfdd2bc58` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:31.645879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748f1da-86ee-4109-a7c9-718ea1ea1966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54404c13a1cf4d4eab0082fbfdd2bc58)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:31.647872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4748f1da-86ee-4109-a7c9-718ea1ea1966 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:31.702988 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542a613-001d-42b3-a9ed-fc99d182fa67 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:31.712919 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a542a613-001d-42b3-a9ed-fc99d182fa67 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:31.718068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:31.718928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:31.719342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:31.719679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] PATH_INFO: `/v3/users/aae7465337214a8cbc909267b35f6e58` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:31.720868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aae7465337214a8cbc909267b35f6e58)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:31.722811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:31.879471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:31.885938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-4748f1da-86ee-4109-a7c9-718ea1ea1966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54404c13a1cf4d4eab0082fbfdd2bc58'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:31.898713 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-4748f1da-86ee-4109-a7c9-718ea1ea1966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54404c13a1cf4d4eab0082fbfdd2bc58'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:31.899417 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-4748f1da-86ee-4109-a7c9-718ea1ea1966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54404c13a1cf4d4eab0082fbfdd2bc58'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:31.900124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-4748f1da-86ee-4109-a7c9-718ea1ea1966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54404c13a1cf4d4eab0082fbfdd2bc58'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:31.932195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:31.941010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aae7465337214a8cbc909267b35f6e58'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:31.941691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aae7465337214a8cbc909267b35f6e58'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:31.942308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aae7465337214a8cbc909267b35f6e58'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:32.012641 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-4748f1da-86ee-4109-a7c9-718ea1ea1966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54404c13a1cf4d4eab0082fbfdd2bc58'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:32.026938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1250/2503] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:31 2022] DELETE /identity/v3/users/54404c13a1cf4d4eab0082fbfdd2bc58 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:32.076210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aae7465337214a8cbc909267b35f6e58'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:32.084233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aae7465337214a8cbc909267b35f6e58'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:32.103308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1254/2504] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:31 2022] DELETE /identity/v3/users/aae7465337214a8cbc909267b35f6e58 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:32.107962 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72c326-250c-4bf4-99f0-d73c788de3e6 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:32.108292 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72c326-250c-4bf4-99f0-d73c788de3e6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:32.109128 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb72c326-250c-4bf4-99f0-d73c788de3e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:32.132585 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-fb72c326-250c-4bf4-99f0-d73c788de3e6 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:32.133912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-fb72c326-250c-4bf4-99f0-d73c788de3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:32.213033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1251/2505] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:32.223003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:32.224415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:32.285564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6977b-30e3-4a3d-8e45-554c05b6995a admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:32.289239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621ecbeb-8f14-4085-8f34-7dc4e82db6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:32.289889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ecbeb-8f14-4085-8f34-7dc4e82db6cb service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:32.290176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ecbeb-8f14-4085-8f34-7dc4e82db6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:32.290458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621ecbeb-8f14-4085-8f34-7dc4e82db6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:32.300280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ecbeb-8f14-4085-8f34-7dc4e82db6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:32.301722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621ecbeb-8f14-4085-8f34-7dc4e82db6cb service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:32.312191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72c326-250c-4bf4-99f0-d73c788de3e6 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:32.313368 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1255/2506] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:32.314565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-fb72c326-250c-4bf4-99f0-d73c788de3e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:32.331551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb72c326-250c-4bf4-99f0-d73c788de3e6 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:32.337245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce5f1-c555-480d-843f-b28650e4e567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:32.345101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce5f1-c555-480d-843f-b28650e4e567 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:32.345101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce5f1-c555-480d-843f-b28650e4e567 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:32.345101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce5f1-c555-480d-843f-b28650e4e567 admin admin] PATH_INFO: `/v3/projects/4a29063e00c940209cc2c923de7424af` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:32.345101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cce5f1-c555-480d-843f-b28650e4e567 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a29063e00c940209cc2c923de7424af)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:32.345101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cce5f1-c555-480d-843f-b28650e4e567 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:32.469860 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-28cce5f1-c555-480d-843f-b28650e4e567 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a29063e00c940209cc2c923de7424af', 'request_id': 'req-28cce5f1-c555-480d-843f-b28650e4e567'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:32.475358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-28cce5f1-c555-480d-843f-b28650e4e567 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a29063e00c940209cc2c923de7424af', 'request_id': 'req-28cce5f1-c555-480d-843f-b28650e4e567'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:32.482098 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-28cce5f1-c555-480d-843f-b28650e4e567 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a29063e00c940209cc2c923de7424af', 'request_id': 'req-28cce5f1-c555-480d-843f-b28650e4e567'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:32.594622 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-28cce5f1-c555-480d-843f-b28650e4e567 admin admin] The token cache is being invalidate because project 4a29063e00c940209cc2c923de7424af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:32.594912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-28cce5f1-c555-480d-843f-b28650e4e567 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:32.595567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-28cce5f1-c555-480d-843f-b28650e4e567 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:32.597189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1252/2507] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:32 2022] DELETE /identity/v3/projects/4a29063e00c940209cc2c923de7424af => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:32.602122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7f9ee-258b-4aeb-ae6f-2db2b6ae71a4 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:32.602414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7f9ee-258b-4aeb-ae6f-2db2b6ae71a4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:32.602692 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c7f9ee-258b-4aeb-ae6f-2db2b6ae71a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:32.620588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-64c7f9ee-258b-4aeb-ae6f-2db2b6ae71a4 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:32.621813 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-64c7f9ee-258b-4aeb-ae6f-2db2b6ae71a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:32.683726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1256/2508] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:32.691649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c54db4-2ade-4333-9955-614b7531d0cb None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:32.692167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c54db4-2ade-4333-9955-614b7531d0cb None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:32.692266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c54db4-2ade-4333-9955-614b7531d0cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:32.710533 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-06c54db4-2ade-4333-9955-614b7531d0cb None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:32.711749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-06c54db4-2ade-4333-9955-614b7531d0cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:32.720646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1253/2509] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:32.724926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7f9ee-258b-4aeb-ae6f-2db2b6ae71a4 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:32.735406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c7f9ee-258b-4aeb-ae6f-2db2b6ae71a4 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:32.740395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d21766-9d1f-48f1-873b-c7ba2b0a87f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:32.741054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d21766-9d1f-48f1-873b-c7ba2b0a87f9 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:32.745295 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d21766-9d1f-48f1-873b-c7ba2b0a87f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:32.745295 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d21766-9d1f-48f1-873b-c7ba2b0a87f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:32.745295 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d21766-9d1f-48f1-873b-c7ba2b0a87f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:32.745295 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d21766-9d1f-48f1-873b-c7ba2b0a87f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:32.745295 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d21766-9d1f-48f1-873b-c7ba2b0a87f9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:32.756375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1257/2510] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:17:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:32.760747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c54db4-2ade-4333-9955-614b7531d0cb None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:32.770389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c54db4-2ade-4333-9955-614b7531d0cb None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:32.775426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73004f-c0e1-4cb2-b9e0-7b7580e4797b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:32.776118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73004f-c0e1-4cb2-b9e0-7b7580e4797b admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:32.776583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73004f-c0e1-4cb2-b9e0-7b7580e4797b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:32.776869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af73004f-c0e1-4cb2-b9e0-7b7580e4797b admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:32.777579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73004f-c0e1-4cb2-b9e0-7b7580e4797b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:32.780019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af73004f-c0e1-4cb2-b9e0-7b7580e4797b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:32.803311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d21766-9d1f-48f1-873b-c7ba2b0a87f9 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:32.805040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-57d21766-9d1f-48f1-873b-c7ba2b0a87f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:32.818458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d21766-9d1f-48f1-873b-c7ba2b0a87f9 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:32.823460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:32.824385 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:32.824668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:32.824944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] PATH_INFO: `/v3/projects/46bc4b83e8ae4ba38540ce489f279ee5` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:32.826281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46bc4b83e8ae4ba38540ce489f279ee5)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:32.828322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:32.888903 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1254/2511] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:32 2022] POST /identity/v3/projects => generated 405 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:32.892956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73004f-c0e1-4cb2-b9e0-7b7580e4797b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:32.905477 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:32.953892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af73004f-c0e1-4cb2-b9e0-7b7580e4797b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:32.958769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e60730-adf1-4d77-b523-da12d43c9332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:32.959444 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e60730-adf1-4d77-b523-da12d43c9332 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:32.959725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e60730-adf1-4d77-b523-da12d43c9332 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:32.960054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e60730-adf1-4d77-b523-da12d43c9332 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:32.960723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e60730-adf1-4d77-b523-da12d43c9332 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:32.962679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e60730-adf1-4d77-b523-da12d43c9332 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:32.966688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:32.974095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46bc4b83e8ae4ba38540ce489f279ee5', 'request_id': 'req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:32.980956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46bc4b83e8ae4ba38540ce489f279ee5', 'request_id': 'req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:32.986489 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46bc4b83e8ae4ba38540ce489f279ee5', 'request_id': 'req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:33.052357 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1255/2512] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:32 2022] POST /identity/v3/users => generated 303 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:17:33.056492 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e60730-adf1-4d77-b523-da12d43c9332 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:33.067233 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e60730-adf1-4d77-b523-da12d43c9332 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:33.075423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] The token cache is being invalidate because project 46bc4b83e8ae4ba38540ce489f279ee5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:33.075717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:33.076414 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:33.078036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1258/2513] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:32 2022] DELETE /identity/v3/projects/46bc4b83e8ae4ba38540ce489f279ee5 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:33.082035 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:33.083406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:33.127899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea3c88-a820-45ad-9bff-d5dea6cb5a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:33.128738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea3c88-a820-45ad-9bff-d5dea6cb5a8b admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:33.129024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea3c88-a820-45ad-9bff-d5dea6cb5a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:33.129311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea3c88-a820-45ad-9bff-d5dea6cb5a8b admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:33.130031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea3c88-a820-45ad-9bff-d5dea6cb5a8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:33.131836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea3c88-a820-45ad-9bff-d5dea6cb5a8b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:33.145704 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1256/2514] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:17:33.146651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea3c88-a820-45ad-9bff-d5dea6cb5a8b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:33.148384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c4ea3c88-a820-45ad-9bff-d5dea6cb5a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:33.149015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f1d5d-a00d-47df-979b-8cd2942f8d82 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:33.153613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:33.154529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:33.155089 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:33.155607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] PATH_INFO: `/v3/users/230d46894d6648e79ac8b9607c68c824` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:33.157532 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] RBAC: Authorizing `identity:delete_user(user_id=230d46894d6648e79ac8b9607c68c824)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:33.160325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:33.162029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea3c88-a820-45ad-9bff-d5dea6cb5a8b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:33.167606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04a801-9cb0-4acb-b31c-e9ee4174eb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:33.168308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04a801-9cb0-4acb-b31c-e9ee4174eb14 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:33.168593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04a801-9cb0-4acb-b31c-e9ee4174eb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:33.168870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04a801-9cb0-4acb-b31c-e9ee4174eb14 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:33.170150 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04a801-9cb0-4acb-b31c-e9ee4174eb14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:33.172173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a04a801-9cb0-4acb-b31c-e9ee4174eb14 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:33.187863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1257/2515] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:33 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:17:33.189007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04a801-9cb0-4acb-b31c-e9ee4174eb14 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:33.199149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a04a801-9cb0-4acb-b31c-e9ee4174eb14 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:33.203943 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1785fa-ac76-4dcf-b7f5-bba0baf08952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:33.204840 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1785fa-ac76-4dcf-b7f5-bba0baf08952 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:33.205104 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1785fa-ac76-4dcf-b7f5-bba0baf08952 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:33.205380 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1785fa-ac76-4dcf-b7f5-bba0baf08952 admin admin] PATH_INFO: `/v3/projects/e989d929c0f2416db269b161eafc0f68/users/706a226ef573445a8fd3c3d5fc083221/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:33.220655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1785fa-ac76-4dcf-b7f5-bba0baf08952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e989d929c0f2416db269b161eafc0f68, user_id=706a226ef573445a8fd3c3d5fc083221, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:33.223347 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1785fa-ac76-4dcf-b7f5-bba0baf08952 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:33.292891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1258/2516] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:33 2022] PUT /identity/v3/projects/e989d929c0f2416db269b161eafc0f68/users/706a226ef573445a8fd3c3d5fc083221/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:33.298014 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eebff-ab12-44e4-ac1c-79cc8caef363 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:33.298306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eebff-ab12-44e4-ac1c-79cc8caef363 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:33.298592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7eebff-ab12-44e4-ac1c-79cc8caef363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:33.315860 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4d7eebff-ab12-44e4-ac1c-79cc8caef363 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:33.317085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4d7eebff-ab12-44e4-ac1c-79cc8caef363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:33.322138 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '230d46894d6648e79ac8b9607c68c824'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:33.322804 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '230d46894d6648e79ac8b9607c68c824'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:33.323439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '230d46894d6648e79ac8b9607c68c824'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:33.378133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1259/2517] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:17:33.388478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eebff-ab12-44e4-ac1c-79cc8caef363 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:33.390316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4d7eebff-ab12-44e4-ac1c-79cc8caef363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:33.396814 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:33.406538 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '230d46894d6648e79ac8b9607c68c824'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:33.414349 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '230d46894d6648e79ac8b9607c68c824'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:33.433239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1259/2518] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:33 2022] DELETE /identity/v3/users/230d46894d6648e79ac8b9607c68c824 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:33.449362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7eebff-ab12-44e4-ac1c-79cc8caef363 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:33.504179 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1310d915-f9c7-4aaf-bf2c-60f6f4f19a37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:33.504853 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310d915-f9c7-4aaf-bf2c-60f6f4f19a37 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:33.505261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310d915-f9c7-4aaf-bf2c-60f6f4f19a37 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:33.505543 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1310d915-f9c7-4aaf-bf2c-60f6f4f19a37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:33.576636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310d915-f9c7-4aaf-bf2c-60f6f4f19a37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:33.578040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1310d915-f9c7-4aaf-bf2c-60f6f4f19a37 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:33.589354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1260/2519] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:17:33.864801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:33.866957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:33.898308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4a830-a899-4eb4-86d0-7a7a0e84839a admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:33.903499 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0f1bb2-7469-4005-8df2-018426141320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:33.904341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1bb2-7469-4005-8df2-018426141320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:33.904625 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1bb2-7469-4005-8df2-018426141320 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:33.904906 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0f1bb2-7469-4005-8df2-018426141320 admin admin] PATH_INFO: `/v3/projects/094ba0bf757648ba82a3c1568ed6d3a8` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:33.906104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f1bb2-7469-4005-8df2-018426141320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=094ba0bf757648ba82a3c1568ed6d3a8)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:33.908190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0f1bb2-7469-4005-8df2-018426141320 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:34.050725 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:34.058902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5e0f1bb2-7469-4005-8df2-018426141320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '094ba0bf757648ba82a3c1568ed6d3a8', 'request_id': 'req-5e0f1bb2-7469-4005-8df2-018426141320'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:34.064695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5e0f1bb2-7469-4005-8df2-018426141320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '094ba0bf757648ba82a3c1568ed6d3a8', 'request_id': 'req-5e0f1bb2-7469-4005-8df2-018426141320'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:34.070570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5e0f1bb2-7469-4005-8df2-018426141320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '094ba0bf757648ba82a3c1568ed6d3a8', 'request_id': 'req-5e0f1bb2-7469-4005-8df2-018426141320'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:34.173712 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5e0f1bb2-7469-4005-8df2-018426141320 admin admin] The token cache is being invalidate because project 094ba0bf757648ba82a3c1568ed6d3a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:34.173929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5e0f1bb2-7469-4005-8df2-018426141320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:34.174679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5e0f1bb2-7469-4005-8df2-018426141320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:34.178199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1260/2520] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:33 2022] DELETE /identity/v3/projects/094ba0bf757648ba82a3c1568ed6d3a8 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:34.182517 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96efb8-5ec0-48af-88db-8eb57f052d63 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:34.184527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96efb8-5ec0-48af-88db-8eb57f052d63 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:34.185661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96efb8-5ec0-48af-88db-8eb57f052d63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:34.204553 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5d96efb8-5ec0-48af-88db-8eb57f052d63 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:34.206053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5d96efb8-5ec0-48af-88db-8eb57f052d63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:34.267260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1261/2521] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:34.276270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02039a9-378f-4967-b7be-834f8dff070d None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:34.276571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02039a9-378f-4967-b7be-834f8dff070d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:34.276879 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02039a9-378f-4967-b7be-834f8dff070d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:34.296391 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-e02039a9-378f-4967-b7be-834f8dff070d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:34.297709 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e02039a9-378f-4967-b7be-834f8dff070d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:34.306131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1261/2522] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:34.310715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96efb8-5ec0-48af-88db-8eb57f052d63 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:34.320535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96efb8-5ec0-48af-88db-8eb57f052d63 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:34.326435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41755e89-ba80-49c7-a25e-2b135e09a082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:34.326435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41755e89-ba80-49c7-a25e-2b135e09a082 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:34.326435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41755e89-ba80-49c7-a25e-2b135e09a082 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:34.326784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41755e89-ba80-49c7-a25e-2b135e09a082 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:34.327240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41755e89-ba80-49c7-a25e-2b135e09a082 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:34.327545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41755e89-ba80-49c7-a25e-2b135e09a082 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:34.329234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41755e89-ba80-49c7-a25e-2b135e09a082 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:34.332066 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:34.342355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1262/2523] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:34.347943 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02039a9-378f-4967-b7be-834f8dff070d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:34.357960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02039a9-378f-4967-b7be-834f8dff070d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:34.363229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e689e-4812-48c4-8683-6a725a95b4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:34.363925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e689e-4812-48c4-8683-6a725a95b4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:34.364214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e689e-4812-48c4-8683-6a725a95b4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:34.364496 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79e689e-4812-48c4-8683-6a725a95b4e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:34.365214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e689e-4812-48c4-8683-6a725a95b4e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:34.367182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79e689e-4812-48c4-8683-6a725a95b4e7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:34.459662 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1262/2524] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:34 2022] POST /identity/v3/projects => generated 401 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:34.464058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41755e89-ba80-49c7-a25e-2b135e09a082 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:34.474405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41755e89-ba80-49c7-a25e-2b135e09a082 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:34.529037 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae60470-ba0b-483a-82cf-6cf0d4ece69f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:34.529695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae60470-ba0b-483a-82cf-6cf0d4ece69f admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:34.529980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae60470-ba0b-483a-82cf-6cf0d4ece69f admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:34.530253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae60470-ba0b-483a-82cf-6cf0d4ece69f admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:34.530946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae60470-ba0b-483a-82cf-6cf0d4ece69f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:34.532893 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae60470-ba0b-483a-82cf-6cf0d4ece69f admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:34.664696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1263/2525] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:34 2022] POST /identity/v3/users => generated 301 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:34.668980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e689e-4812-48c4-8683-6a725a95b4e7 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:34.679622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79e689e-4812-48c4-8683-6a725a95b4e7 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:34.684107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e48e24-f89a-41ea-b586-3f00efc6036e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:34.684779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e48e24-f89a-41ea-b586-3f00efc6036e admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:34.685352 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e48e24-f89a-41ea-b586-3f00efc6036e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:34.685632 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e48e24-f89a-41ea-b586-3f00efc6036e admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:34.686381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e48e24-f89a-41ea-b586-3f00efc6036e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:34.688107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e48e24-f89a-41ea-b586-3f00efc6036e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:34.698558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1263/2526] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:34.702728 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae60470-ba0b-483a-82cf-6cf0d4ece69f admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:34.712944 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae60470-ba0b-483a-82cf-6cf0d4ece69f admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:34.718130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ce4b4c-6ce6-43e0-961b-41b7b7deb77d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:34.718786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce4b4c-6ce6-43e0-961b-41b7b7deb77d admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:34.719068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce4b4c-6ce6-43e0-961b-41b7b7deb77d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:34.719345 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ce4b4c-6ce6-43e0-961b-41b7b7deb77d admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:34.720092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce4b4c-6ce6-43e0-961b-41b7b7deb77d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:34.721699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ce4b4c-6ce6-43e0-961b-41b7b7deb77d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:34.731550 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1264/2527] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:34.735757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e48e24-f89a-41ea-b586-3f00efc6036e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:34.748166 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e48e24-f89a-41ea-b586-3f00efc6036e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:34.752719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef845fb-bb48-438e-9af6-2e19047b87ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:34.753668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef845fb-bb48-438e-9af6-2e19047b87ba admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:34.753949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef845fb-bb48-438e-9af6-2e19047b87ba admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:34.754226 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef845fb-bb48-438e-9af6-2e19047b87ba admin admin] PATH_INFO: `/v3/projects/1fb3867c0fd349de98c3852e152a7c2d/users/010b6a448e9f4c8fa9bfdc371912cd51/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:34.773989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef845fb-bb48-438e-9af6-2e19047b87ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fb3867c0fd349de98c3852e152a7c2d, user_id=010b6a448e9f4c8fa9bfdc371912cd51, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:34.777878 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef845fb-bb48-438e-9af6-2e19047b87ba admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:34.893332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe44afb-0eb7-4aaa-8696-79206adfe64e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:34.893756 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe44afb-0eb7-4aaa-8696-79206adfe64e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:34.894099 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe44afb-0eb7-4aaa-8696-79206adfe64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:34.913251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1264/2528] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:34 2022] PUT /identity/v3/projects/1fb3867c0fd349de98c3852e152a7c2d/users/010b6a448e9f4c8fa9bfdc371912cd51/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:34.922866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991395ce-cb65-4847-bf3b-cb6241a7c239 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:34.923202 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991395ce-cb65-4847-bf3b-cb6241a7c239 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:34.923666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991395ce-cb65-4847-bf3b-cb6241a7c239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:34.924318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-ebe44afb-0eb7-4aaa-8696-79206adfe64e None None] MFA Rules not processed for user `706a226ef573445a8fd3c3d5fc083221`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:34.925802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ebe44afb-0eb7-4aaa-8696-79206adfe64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:34.956726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-991395ce-cb65-4847-bf3b-cb6241a7c239 None None] MFA Rules not processed for user `010b6a448e9f4c8fa9bfdc371912cd51`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:34.958227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-991395ce-cb65-4847-bf3b-cb6241a7c239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:34.998729 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1265/2529] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:34 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:17:35.003228 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe44afb-0eb7-4aaa-8696-79206adfe64e None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.004578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ebe44afb-0eb7-4aaa-8696-79206adfe64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:35.034269 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1265/2530] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:34 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:35.038538 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991395ce-cb65-4847-bf3b-cb6241a7c239 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.073276 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe44afb-0eb7-4aaa-8696-79206adfe64e None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:35.078930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66b45a-1682-4db0-837e-0ea609861325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:35.079615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b45a-1682-4db0-837e-0ea609861325 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.082313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b45a-1682-4db0-837e-0ea609861325 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.082313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e66b45a-1682-4db0-837e-0ea609861325 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.082313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66b45a-1682-4db0-837e-0ea609861325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:35.082796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e66b45a-1682-4db0-837e-0ea609861325 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:35.091025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:35.099296 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:35.104874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991395ce-cb65-4847-bf3b-cb6241a7c239 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:35.109511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8a6ad-f6f3-4206-af98-a54ba309f2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:35.110167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8a6ad-f6f3-4206-af98-a54ba309f2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.110446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8a6ad-f6f3-4206-af98-a54ba309f2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.110721 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8a6ad-f6f3-4206-af98-a54ba309f2d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.111406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8a6ad-f6f3-4206-af98-a54ba309f2d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:35.113358 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e8a6ad-f6f3-4206-af98-a54ba309f2d9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:35.173662 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1266/2531] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:35 2022] POST /identity/v3/projects => generated 403 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:17:35.177661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66b45a-1682-4db0-837e-0ea609861325 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.229025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1266/2532] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:35 2022] POST /identity/v3/projects => generated 399 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:17:35.230291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8a6ad-f6f3-4206-af98-a54ba309f2d9 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.239643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e66b45a-1682-4db0-837e-0ea609861325 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:35.304009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8a6ad-f6f3-4206-af98-a54ba309f2d9 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:35.304192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee94a1-59fe-42df-a217-ad86a570c65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:35.304192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee94a1-59fe-42df-a217-ad86a570c65d admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.304192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee94a1-59fe-42df-a217-ad86a570c65d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.304192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aee94a1-59fe-42df-a217-ad86a570c65d admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.304559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee94a1-59fe-42df-a217-ad86a570c65d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:35.304648 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c78829-34fc-48b5-b954-79656abd8297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:35.304748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aee94a1-59fe-42df-a217-ad86a570c65d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:35.304836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c78829-34fc-48b5-b954-79656abd8297 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.304836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c78829-34fc-48b5-b954-79656abd8297 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.304836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c78829-34fc-48b5-b954-79656abd8297 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.304836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c78829-34fc-48b5-b954-79656abd8297 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:35.305484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c78829-34fc-48b5-b954-79656abd8297 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:35.430268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1267/2533] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:35 2022] POST /identity/v3/users => generated 308 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:17:35.430506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1267/2534] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:35 2022] POST /identity/v3/users => generated 306 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:35.434427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee94a1-59fe-42df-a217-ad86a570c65d admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.437924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c78829-34fc-48b5-b954-79656abd8297 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.446718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aee94a1-59fe-42df-a217-ad86a570c65d admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:35.448562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c78829-34fc-48b5-b954-79656abd8297 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:35.451728 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674380c2-4729-411d-854b-ec08eee0bc8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:35.452436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674380c2-4729-411d-854b-ec08eee0bc8f admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.452724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674380c2-4729-411d-854b-ec08eee0bc8f admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.453000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674380c2-4729-411d-854b-ec08eee0bc8f admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.453736 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674380c2-4729-411d-854b-ec08eee0bc8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:35.453862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c755bf-34c6-47fd-b37e-9695955de554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:35.454441 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c755bf-34c6-47fd-b37e-9695955de554 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.454727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c755bf-34c6-47fd-b37e-9695955de554 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.455031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c755bf-34c6-47fd-b37e-9695955de554 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.455369 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674380c2-4729-411d-854b-ec08eee0bc8f admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:35.455745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c755bf-34c6-47fd-b37e-9695955de554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:35.457956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c755bf-34c6-47fd-b37e-9695955de554 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:35.467026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1268/2535] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:35.468464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1268/2536] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:17:35.472609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674380c2-4729-411d-854b-ec08eee0bc8f admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.472895 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c755bf-34c6-47fd-b37e-9695955de554 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.483199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c755bf-34c6-47fd-b37e-9695955de554 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:35.483382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674380c2-4729-411d-854b-ec08eee0bc8f admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:35.488053 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69bc8-bca2-4939-8d61-3eddb8887e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:35.488240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36824e8c-9a5e-468c-b191-49a75de27a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:35.492656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69bc8-bca2-4939-8d61-3eddb8887e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.492782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36824e8c-9a5e-468c-b191-49a75de27a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.492880 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69bc8-bca2-4939-8d61-3eddb8887e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.492971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36824e8c-9a5e-468c-b191-49a75de27a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.493060 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa69bc8-bca2-4939-8d61-3eddb8887e3e admin admin] PATH_INFO: `/v3/projects/19e1302be5ad4d0184c5e27cbcdfe7ea/users/e2427fbef00745a682e8c3d885f8e3ed/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.493178 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36824e8c-9a5e-468c-b191-49a75de27a98 admin admin] PATH_INFO: `/v3/projects/064a3311b6d748b4993ab4ceff2af8af/users/18684e6126b340b1b5eff2ac0c8d739e/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.505301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa69bc8-bca2-4939-8d61-3eddb8887e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e1302be5ad4d0184c5e27cbcdfe7ea, user_id=e2427fbef00745a682e8c3d885f8e3ed, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:35.505986 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36824e8c-9a5e-468c-b191-49a75de27a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=064a3311b6d748b4993ab4ceff2af8af, user_id=18684e6126b340b1b5eff2ac0c8d739e, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:35.507979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa69bc8-bca2-4939-8d61-3eddb8887e3e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:35.509769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36824e8c-9a5e-468c-b191-49a75de27a98 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:35.613211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1269/2537] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:35 2022] PUT /identity/v3/projects/19e1302be5ad4d0184c5e27cbcdfe7ea/users/e2427fbef00745a682e8c3d885f8e3ed/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:35.617217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69bc8-bca2-4939-8d61-3eddb8887e3e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.641170 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1269/2538] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:35 2022] PUT /identity/v3/projects/064a3311b6d748b4993ab4ceff2af8af/users/18684e6126b340b1b5eff2ac0c8d739e/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:35.645189 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36824e8c-9a5e-468c-b191-49a75de27a98 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.680739 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa69bc8-bca2-4939-8d61-3eddb8887e3e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:35.706719 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36824e8c-9a5e-468c-b191-49a75de27a98 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:35.712198 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e585d56-5da8-494d-94f8-dc796c4051a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:35.712869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e585d56-5da8-494d-94f8-dc796c4051a4 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.713417 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e585d56-5da8-494d-94f8-dc796c4051a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.713628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e585d56-5da8-494d-94f8-dc796c4051a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.714435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e585d56-5da8-494d-94f8-dc796c4051a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:35.716530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e585d56-5da8-494d-94f8-dc796c4051a4 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:35.726569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1270/2539] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:17:35.730679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e585d56-5da8-494d-94f8-dc796c4051a4 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.739370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd43503-3038-40dc-a2d6-f0d9de1e8e1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:35.740132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd43503-3038-40dc-a2d6-f0d9de1e8e1d admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.740413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd43503-3038-40dc-a2d6-f0d9de1e8e1d admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.740686 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd43503-3038-40dc-a2d6-f0d9de1e8e1d admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.740895 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e585d56-5da8-494d-94f8-dc796c4051a4 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:35.741444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd43503-3038-40dc-a2d6-f0d9de1e8e1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:35.743321 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd43503-3038-40dc-a2d6-f0d9de1e8e1d admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:35.746047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2bd73-3ab1-4dbc-a51d-ac61cae5555d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:35.746916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2bd73-3ab1-4dbc-a51d-ac61cae5555d admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.747228 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2bd73-3ab1-4dbc-a51d-ac61cae5555d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.747506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2bd73-3ab1-4dbc-a51d-ac61cae5555d admin admin] PATH_INFO: `/v3/projects/064a3311b6d748b4993ab4ceff2af8af/users/18684e6126b340b1b5eff2ac0c8d739e/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.749520 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2bd73-3ab1-4dbc-a51d-ac61cae5555d admin admin] RBAC: Authorizing `identity:create_grant(project_id=064a3311b6d748b4993ab4ceff2af8af, user_id=18684e6126b340b1b5eff2ac0c8d739e, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:35.753129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2bd73-3ab1-4dbc-a51d-ac61cae5555d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:35.753690 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1270/2540] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:35 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:17:35.757728 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd43503-3038-40dc-a2d6-f0d9de1e8e1d admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.762896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1271/2541] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:35 2022] PUT /identity/v3/projects/064a3311b6d748b4993ab4ceff2af8af/users/18684e6126b340b1b5eff2ac0c8d739e/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:35.768171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd43503-3038-40dc-a2d6-f0d9de1e8e1d admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:35.801103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:35.827695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09297734-15f1-4e3f-b3e6-c6d475f31037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:35.828634 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297734-15f1-4e3f-b3e6-c6d475f31037 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.828899 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297734-15f1-4e3f-b3e6-c6d475f31037 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.829178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09297734-15f1-4e3f-b3e6-c6d475f31037 admin admin] PATH_INFO: `/v3/projects/19e1302be5ad4d0184c5e27cbcdfe7ea/users/e2427fbef00745a682e8c3d885f8e3ed/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.833369 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09297734-15f1-4e3f-b3e6-c6d475f31037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e1302be5ad4d0184c5e27cbcdfe7ea, user_id=e2427fbef00745a682e8c3d885f8e3ed, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:35.833820 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09297734-15f1-4e3f-b3e6-c6d475f31037 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:35.844430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1271/2542] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:35 2022] PUT /identity/v3/projects/19e1302be5ad4d0184c5e27cbcdfe7ea/users/e2427fbef00745a682e8c3d885f8e3ed/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:35.857204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f817c87-e3b1-4a71-bd69-77085f135a75 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:35.857954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f817c87-e3b1-4a71-bd69-77085f135a75 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:35.857954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f817c87-e3b1-4a71-bd69-77085f135a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:35.886667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-2f817c87-e3b1-4a71-bd69-77085f135a75 None None] MFA Rules not processed for user `e2427fbef00745a682e8c3d885f8e3ed`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:35.887945 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2f817c87-e3b1-4a71-bd69-77085f135a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:35.967262 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1272/2543] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:35 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:35.978052 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09297734-15f1-4e3f-b3e6-c6d475f31037 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:35.979732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-09297734-15f1-4e3f-b3e6-c6d475f31037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:36.038440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09297734-15f1-4e3f-b3e6-c6d475f31037 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:36.042373 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0894c61-70e7-466f-b064-89449df29536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:36.043023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0894c61-70e7-466f-b064-89449df29536 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:36.043310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0894c61-70e7-466f-b064-89449df29536 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:36.043707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0894c61-70e7-466f-b064-89449df29536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:36.053661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0894c61-70e7-466f-b064-89449df29536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:36.055109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0894c61-70e7-466f-b064-89449df29536 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:36.068120 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1272/2544] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:35 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:36.127145 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:36.319873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f817c87-e3b1-4a71-bd69-77085f135a75 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:36.336449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f817c87-e3b1-4a71-bd69-77085f135a75 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:36.336449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa96bf-68e2-40f2-add6-ff6f15e5e2d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:36.336449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa96bf-68e2-40f2-add6-ff6f15e5e2d5 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:36.336449 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa96bf-68e2-40f2-add6-ff6f15e5e2d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:36.336985 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fa96bf-68e2-40f2-add6-ff6f15e5e2d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:36.406632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa96bf-68e2-40f2-add6-ff6f15e5e2d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:36.409621 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fa96bf-68e2-40f2-add6-ff6f15e5e2d5 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:36.419804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1273/2545] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:37.010985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c7e33-d710-4773-bb05-5af4971a4049 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:37.011469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c7e33-d710-4773-bb05-5af4971a4049 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:37.011640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7c7e33-d710-4773-bb05-5af4971a4049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:37.048732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-cc7c7e33-d710-4773-bb05-5af4971a4049 None None] MFA Rules not processed for user `18684e6126b340b1b5eff2ac0c8d739e`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:37.049973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-cc7c7e33-d710-4773-bb05-5af4971a4049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:37.129483 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:37.134952 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1273/2546] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:37.178140 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa96bf-68e2-40f2-add6-ff6f15e5e2d5 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:37.179616 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-92fa96bf-68e2-40f2-add6-ff6f15e5e2d5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:37.256327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:37.261075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fa96bf-68e2-40f2-add6-ff6f15e5e2d5 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:37.266875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:37.267904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:37.268548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:37.268548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] PATH_INFO: `/v3/users/3c42ff3b5a7e4ec1adec47f5bf030b5c` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:37.270130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c42ff3b5a7e4ec1adec47f5bf030b5c)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:37.272456 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:37.495652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c42ff3b5a7e4ec1adec47f5bf030b5c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:37.526419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c42ff3b5a7e4ec1adec47f5bf030b5c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:37.527876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c42ff3b5a7e4ec1adec47f5bf030b5c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:37.529567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c42ff3b5a7e4ec1adec47f5bf030b5c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:37.612460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c42ff3b5a7e4ec1adec47f5bf030b5c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:37.627361 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1274/2547] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:37 2022] DELETE /identity/v3/users/3c42ff3b5a7e4ec1adec47f5bf030b5c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:37.632114 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0f559-dc23-411e-9abb-e34c102e05ea None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:37.632410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0f559-dc23-411e-9abb-e34c102e05ea None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:37.632695 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d0f559-dc23-411e-9abb-e34c102e05ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:37.652040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-09d0f559-dc23-411e-9abb-e34c102e05ea None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:37.653997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-09d0f559-dc23-411e-9abb-e34c102e05ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:37.726268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1274/2548] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:37.732821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:37.734556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:37.799153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43994503-b8da-41b8-b8ca-2d90d22a2c25 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:37.803013 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d55059-8476-44cd-a8e5-831720a85b6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:37.803668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d55059-8476-44cd-a8e5-831720a85b6e service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:37.804016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d55059-8476-44cd-a8e5-831720a85b6e service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:37.804253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d55059-8476-44cd-a8e5-831720a85b6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:37.815624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d55059-8476-44cd-a8e5-831720a85b6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:37.817217 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d55059-8476-44cd-a8e5-831720a85b6e service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:37.827239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1275/2549] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:38.365154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0f559-dc23-411e-9abb-e34c102e05ea None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:38.368750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-09d0f559-dc23-411e-9abb-e34c102e05ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:38.383482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d0f559-dc23-411e-9abb-e34c102e05ea None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:38.389591 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406165e1-e9ff-4e68-b552-dc16454a4be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:38.390473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406165e1-e9ff-4e68-b552-dc16454a4be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:38.390780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406165e1-e9ff-4e68-b552-dc16454a4be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:38.391114 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406165e1-e9ff-4e68-b552-dc16454a4be7 admin admin] PATH_INFO: `/v3/projects/734b8e0606fa40a3bcbf7bd521910835` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:38.392389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406165e1-e9ff-4e68-b552-dc16454a4be7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=734b8e0606fa40a3bcbf7bd521910835)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:38.394435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406165e1-e9ff-4e68-b552-dc16454a4be7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:38.506098 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-406165e1-e9ff-4e68-b552-dc16454a4be7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734b8e0606fa40a3bcbf7bd521910835', 'request_id': 'req-406165e1-e9ff-4e68-b552-dc16454a4be7'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:38.512677 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-406165e1-e9ff-4e68-b552-dc16454a4be7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734b8e0606fa40a3bcbf7bd521910835', 'request_id': 'req-406165e1-e9ff-4e68-b552-dc16454a4be7'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:38.518596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-406165e1-e9ff-4e68-b552-dc16454a4be7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734b8e0606fa40a3bcbf7bd521910835', 'request_id': 'req-406165e1-e9ff-4e68-b552-dc16454a4be7'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:38.634999 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-406165e1-e9ff-4e68-b552-dc16454a4be7 admin admin] The token cache is being invalidate because project 734b8e0606fa40a3bcbf7bd521910835 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:38.635296 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-406165e1-e9ff-4e68-b552-dc16454a4be7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:38.635967 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-406165e1-e9ff-4e68-b552-dc16454a4be7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:38.637652 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1275/2550] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:38 2022] DELETE /identity/v3/projects/734b8e0606fa40a3bcbf7bd521910835 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:38.642614 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe1917-fccc-4d22-bd42-d20563160822 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:38.643130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe1917-fccc-4d22-bd42-d20563160822 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:38.643130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe1917-fccc-4d22-bd42-d20563160822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:38.661650 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-8ffe1917-fccc-4d22-bd42-d20563160822 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:38.662931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8ffe1917-fccc-4d22-bd42-d20563160822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:38.726524 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1276/2551] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:38.735262 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c6151-c301-4f05-86bc-2c7e13d616c9 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:38.735631 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c6151-c301-4f05-86bc-2c7e13d616c9 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:38.736040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2c6151-c301-4f05-86bc-2c7e13d616c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:38.758269 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-5e2c6151-c301-4f05-86bc-2c7e13d616c9 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:38.759626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5e2c6151-c301-4f05-86bc-2c7e13d616c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:38.762802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe1917-fccc-4d22-bd42-d20563160822 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:38.764746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8ffe1917-fccc-4d22-bd42-d20563160822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:38.770026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1276/2552] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:38.778216 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c6151-c301-4f05-86bc-2c7e13d616c9 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:38.793310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe1917-fccc-4d22-bd42-d20563160822 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:38.793445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2c6151-c301-4f05-86bc-2c7e13d616c9 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:38.793538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:38.793538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:38.793538 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:38.793816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] PATH_INFO: `/v3/users/706a226ef573445a8fd3c3d5fc083221` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:38.795966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=706a226ef573445a8fd3c3d5fc083221)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:38.797957 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:38.798143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d6f2e-e9c4-4b21-8dfa-98d80d33d75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:38.798817 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d6f2e-e9c4-4b21-8dfa-98d80d33d75b admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:38.799123 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d6f2e-e9c4-4b21-8dfa-98d80d33d75b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:38.799511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449d6f2e-e9c4-4b21-8dfa-98d80d33d75b admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:38.800196 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d6f2e-e9c4-4b21-8dfa-98d80d33d75b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:38.802821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d6f2e-e9c4-4b21-8dfa-98d80d33d75b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:38.802821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449d6f2e-e9c4-4b21-8dfa-98d80d33d75b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:38.814526 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:38.815791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1277/2553] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:38.820109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d6f2e-e9c4-4b21-8dfa-98d80d33d75b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:38.830257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449d6f2e-e9c4-4b21-8dfa-98d80d33d75b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:38.835111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423f65d-55b3-48ce-85bc-dd4f85a5e686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:38.836019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423f65d-55b3-48ce-85bc-dd4f85a5e686 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:38.836308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423f65d-55b3-48ce-85bc-dd4f85a5e686 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:38.836585 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0423f65d-55b3-48ce-85bc-dd4f85a5e686 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:38.837292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423f65d-55b3-48ce-85bc-dd4f85a5e686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:38.839266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0423f65d-55b3-48ce-85bc-dd4f85a5e686 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:38.952412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1278/2554] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:38 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:38.956503 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423f65d-55b3-48ce-85bc-dd4f85a5e686 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:39.004984 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:39.016495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '706a226ef573445a8fd3c3d5fc083221'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:39.023294 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0423f65d-55b3-48ce-85bc-dd4f85a5e686 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:39.029539 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b11a1-c783-4861-8da2-7c7040f2b573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:39.030499 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b11a1-c783-4861-8da2-7c7040f2b573 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:39.031574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b11a1-c783-4861-8da2-7c7040f2b573 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:39.031574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b11a1-c783-4861-8da2-7c7040f2b573 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:39.031782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b11a1-c783-4861-8da2-7c7040f2b573 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:39.033630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '706a226ef573445a8fd3c3d5fc083221'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:39.034133 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b11a1-c783-4861-8da2-7c7040f2b573 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:39.034370 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '706a226ef573445a8fd3c3d5fc083221'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:39.034991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '706a226ef573445a8fd3c3d5fc083221'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:39.172281 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '706a226ef573445a8fd3c3d5fc083221'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:39.181351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1279/2555] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:38 2022] POST /identity/v3/users => generated 287 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:17:39.182639 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b11a1-c783-4861-8da2-7c7040f2b573 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:39.186613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d33b11a1-c783-4861-8da2-7c7040f2b573 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:39.193886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1277/2556] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:38 2022] DELETE /identity/v3/users/706a226ef573445a8fd3c3d5fc083221 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:39.199126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b11a1-c783-4861-8da2-7c7040f2b573 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:39.270363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02850a0a-13b7-404f-a9d3-81135a237aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:39.271055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02850a0a-13b7-404f-a9d3-81135a237aab admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:39.271345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02850a0a-13b7-404f-a9d3-81135a237aab admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:39.271623 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02850a0a-13b7-404f-a9d3-81135a237aab admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:39.272411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02850a0a-13b7-404f-a9d3-81135a237aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:39.277546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02850a0a-13b7-404f-a9d3-81135a237aab admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:39.299283 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1280/2557] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:39.299725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:39.310802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f3f4e4-29f2-4656-a9c5-fefa854d4f22 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:39.316004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759319a3-5c37-4dec-a563-fdc7d5704125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:39.316809 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759319a3-5c37-4dec-a563-fdc7d5704125 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:39.317163 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759319a3-5c37-4dec-a563-fdc7d5704125 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:39.317515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759319a3-5c37-4dec-a563-fdc7d5704125 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:39.318316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759319a3-5c37-4dec-a563-fdc7d5704125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:39.320095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759319a3-5c37-4dec-a563-fdc7d5704125 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:39.331111 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1278/2558] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:39.335071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02850a0a-13b7-404f-a9d3-81135a237aab admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:39.346657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02850a0a-13b7-404f-a9d3-81135a237aab admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:39.351963 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23f18f-aacf-4859-8ca9-ccb0385d21c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:39.352855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23f18f-aacf-4859-8ca9-ccb0385d21c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:39.353166 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23f18f-aacf-4859-8ca9-ccb0385d21c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:39.353445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23f18f-aacf-4859-8ca9-ccb0385d21c0 admin admin] PATH_INFO: `/v3/projects/6c83508b7cb444e481db967f6f7261da/users/28d37a0453fb4a06b9edba995c04f878/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:39.371757 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23f18f-aacf-4859-8ca9-ccb0385d21c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c83508b7cb444e481db967f6f7261da, user_id=28d37a0453fb4a06b9edba995c04f878, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:39.375059 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a23f18f-aacf-4859-8ca9-ccb0385d21c0 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:39.453828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1281/2559] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:39 2022] PUT /identity/v3/projects/6c83508b7cb444e481db967f6f7261da/users/28d37a0453fb4a06b9edba995c04f878/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:39.465105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4470c-93c1-4626-a735-4155f88f320c None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:39.465435 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4470c-93c1-4626-a735-4155f88f320c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:39.465720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4470c-93c1-4626-a735-4155f88f320c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:39.493913 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-32f4470c-93c1-4626-a735-4155f88f320c None None] MFA Rules not processed for user `28d37a0453fb4a06b9edba995c04f878`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:39.495056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-32f4470c-93c1-4626-a735-4155f88f320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:39.563457 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1279/2560] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:39.575255 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23f18f-aacf-4859-8ca9-ccb0385d21c0 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:39.577812 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8a23f18f-aacf-4859-8ca9-ccb0385d21c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:39.590306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4470c-93c1-4626-a735-4155f88f320c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:39.594587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-32f4470c-93c1-4626-a735-4155f88f320c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:39.663555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23f18f-aacf-4859-8ca9-ccb0385d21c0 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:39.666619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4470c-93c1-4626-a735-4155f88f320c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:39.667745 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201d8db-4631-4630-82a5-2533215b7373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:39.668280 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201d8db-4631-4630-82a5-2533215b7373 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:39.668603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201d8db-4631-4630-82a5-2533215b7373 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:39.668844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201d8db-4631-4630-82a5-2533215b7373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:39.672108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:39.672959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:39.673241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:39.673516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] PATH_INFO: `/v3/projects/e989d929c0f2416db269b161eafc0f68` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:39.674709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e989d929c0f2416db269b161eafc0f68)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:39.676677 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:39.679022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201d8db-4631-4630-82a5-2533215b7373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:39.680505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201d8db-4631-4630-82a5-2533215b7373 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:39.690986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1282/2561] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:17:39.692634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:39.819354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e989d929c0f2416db269b161eafc0f68', 'request_id': 'req-5fa37e70-3540-4cdc-9834-9af92577a32b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:39.827491 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e989d929c0f2416db269b161eafc0f68', 'request_id': 'req-5fa37e70-3540-4cdc-9834-9af92577a32b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:39.849900 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e989d929c0f2416db269b161eafc0f68', 'request_id': 'req-5fa37e70-3540-4cdc-9834-9af92577a32b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:39.909030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] The token cache is being invalidate because project e989d929c0f2416db269b161eafc0f68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:39.909396 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:39.911441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:39.915019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1280/2562] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:39 2022] DELETE /identity/v3/projects/e989d929c0f2416db269b161eafc0f68 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:39.916183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201d8db-4631-4630-82a5-2533215b7373 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:39.929301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201d8db-4631-4630-82a5-2533215b7373 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:39.991729 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3df7a27-7a77-426a-b78d-43259b6087d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:39.992516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df7a27-7a77-426a-b78d-43259b6087d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:39.992897 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df7a27-7a77-426a-b78d-43259b6087d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:39.993154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3df7a27-7a77-426a-b78d-43259b6087d8 admin admin] PATH_INFO: `/v3/users/18684e6126b340b1b5eff2ac0c8d739e` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:39.994607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df7a27-7a77-426a-b78d-43259b6087d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18684e6126b340b1b5eff2ac0c8d739e)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:39.997914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3df7a27-7a77-426a-b78d-43259b6087d8 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:40.191254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a3df7a27-7a77-426a-b78d-43259b6087d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18684e6126b340b1b5eff2ac0c8d739e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:40.191959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a3df7a27-7a77-426a-b78d-43259b6087d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18684e6126b340b1b5eff2ac0c8d739e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:40.192574 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a3df7a27-7a77-426a-b78d-43259b6087d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18684e6126b340b1b5eff2ac0c8d739e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:40.303545 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a3df7a27-7a77-426a-b78d-43259b6087d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18684e6126b340b1b5eff2ac0c8d739e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:40.311610 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a3df7a27-7a77-426a-b78d-43259b6087d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18684e6126b340b1b5eff2ac0c8d739e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:40.328778 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1283/2563] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:39 2022] DELETE /identity/v3/users/18684e6126b340b1b5eff2ac0c8d739e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:40.587610 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:40.592544 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:40.606720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa37e70-3540-4cdc-9834-9af92577a32b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:40.669873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e66a1a-4b87-4a79-a930-16a8960428b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:40.670788 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e66a1a-4b87-4a79-a930-16a8960428b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:40.671080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e66a1a-4b87-4a79-a930-16a8960428b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:40.671366 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e66a1a-4b87-4a79-a930-16a8960428b2 admin admin] PATH_INFO: `/v3/projects/064a3311b6d748b4993ab4ceff2af8af` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:40.672737 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e66a1a-4b87-4a79-a930-16a8960428b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=064a3311b6d748b4993ab4ceff2af8af)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:40.674994 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e66a1a-4b87-4a79-a930-16a8960428b2 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:40.698600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:40.766558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-72e66a1a-4b87-4a79-a930-16a8960428b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '064a3311b6d748b4993ab4ceff2af8af', 'request_id': 'req-72e66a1a-4b87-4a79-a930-16a8960428b2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:40.772000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-72e66a1a-4b87-4a79-a930-16a8960428b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '064a3311b6d748b4993ab4ceff2af8af', 'request_id': 'req-72e66a1a-4b87-4a79-a930-16a8960428b2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:40.778144 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-72e66a1a-4b87-4a79-a930-16a8960428b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '064a3311b6d748b4993ab4ceff2af8af', 'request_id': 'req-72e66a1a-4b87-4a79-a930-16a8960428b2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:40.865725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-72e66a1a-4b87-4a79-a930-16a8960428b2 admin admin] The token cache is being invalidate because project 064a3311b6d748b4993ab4ceff2af8af was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:40.869920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-72e66a1a-4b87-4a79-a930-16a8960428b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:40.870687 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-72e66a1a-4b87-4a79-a930-16a8960428b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:40.873410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1281/2564] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:40 2022] DELETE /identity/v3/projects/064a3311b6d748b4993ab4ceff2af8af => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:40.878446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b55cc-bb94-45ac-8295-177dc793c94d None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:40.878756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b55cc-bb94-45ac-8295-177dc793c94d None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:40.879045 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b55cc-bb94-45ac-8295-177dc793c94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:40.897580 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-434b55cc-bb94-45ac-8295-177dc793c94d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:40.898818 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-434b55cc-bb94-45ac-8295-177dc793c94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:40.967549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1284/2565] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:40.976566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca08ce-a23f-4ecc-9e1a-ca0ce1d649de None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:40.991584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca08ce-a23f-4ecc-9e1a-ca0ce1d649de None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:40.991584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca08ce-a23f-4ecc-9e1a-ca0ce1d649de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:41.006324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-6aca08ce-a23f-4ecc-9e1a-ca0ce1d649de None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:41.007574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6aca08ce-a23f-4ecc-9e1a-ca0ce1d649de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:41.016468 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1282/2566] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:17:41.020777 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b55cc-bb94-45ac-8295-177dc793c94d None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:41.031216 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b55cc-bb94-45ac-8295-177dc793c94d None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:41.035959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806c5bc-cc5b-46ef-897a-9ce53e0ee40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:41.036627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806c5bc-cc5b-46ef-897a-9ce53e0ee40a admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:41.036913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806c5bc-cc5b-46ef-897a-9ce53e0ee40a admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:41.037194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806c5bc-cc5b-46ef-897a-9ce53e0ee40a admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:41.037928 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806c5bc-cc5b-46ef-897a-9ce53e0ee40a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:41.038241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806c5bc-cc5b-46ef-897a-9ce53e0ee40a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:41.039882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806c5bc-cc5b-46ef-897a-9ce53e0ee40a admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:41.052523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1285/2567] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:17:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:41.057056 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca08ce-a23f-4ecc-9e1a-ca0ce1d649de None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:41.066772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca08ce-a23f-4ecc-9e1a-ca0ce1d649de None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:41.071901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7d3cc-1022-405d-8e86-1afbb8c41813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:41.077584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7d3cc-1022-405d-8e86-1afbb8c41813 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:41.077584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7d3cc-1022-405d-8e86-1afbb8c41813 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:41.077584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7d3cc-1022-405d-8e86-1afbb8c41813 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:41.077584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7d3cc-1022-405d-8e86-1afbb8c41813 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:41.077584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7d3cc-1022-405d-8e86-1afbb8c41813 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:41.210494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1283/2568] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:41 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:41.214976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806c5bc-cc5b-46ef-897a-9ce53e0ee40a admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:41.226386 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806c5bc-cc5b-46ef-897a-9ce53e0ee40a admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:41.286850 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3cb2a-fadb-4ee6-9e48-0af663558dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:41.287532 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3cb2a-fadb-4ee6-9e48-0af663558dcd admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:41.287868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3cb2a-fadb-4ee6-9e48-0af663558dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:41.288151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba3cb2a-fadb-4ee6-9e48-0af663558dcd admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:41.288844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3cb2a-fadb-4ee6-9e48-0af663558dcd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:41.290820 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba3cb2a-fadb-4ee6-9e48-0af663558dcd admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:41.412877 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1286/2569] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:41 2022] POST /identity/v3/users => generated 291 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:41.417105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7d3cc-1022-405d-8e86-1afbb8c41813 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:41.423230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:41.430447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7d3cc-1022-405d-8e86-1afbb8c41813 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:41.435904 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d632fe-2ed2-4078-9d79-bc90d98d8e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:41.436576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d632fe-2ed2-4078-9d79-bc90d98d8e0d admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:41.436858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d632fe-2ed2-4078-9d79-bc90d98d8e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:41.437138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d632fe-2ed2-4078-9d79-bc90d98d8e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:41.437871 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d632fe-2ed2-4078-9d79-bc90d98d8e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:41.439508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d632fe-2ed2-4078-9d79-bc90d98d8e0d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:41.450179 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1284/2570] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:41.459719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3cb2a-fadb-4ee6-9e48-0af663558dcd admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:41.470486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba3cb2a-fadb-4ee6-9e48-0af663558dcd admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:41.475277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405811c-10cc-4510-b324-11537103edfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:41.476104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405811c-10cc-4510-b324-11537103edfb admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:41.476272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405811c-10cc-4510-b324-11537103edfb admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:41.476542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405811c-10cc-4510-b324-11537103edfb admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:41.477276 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405811c-10cc-4510-b324-11537103edfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:41.478985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405811c-10cc-4510-b324-11537103edfb admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:41.490953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1287/2571] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:41.494795 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d632fe-2ed2-4078-9d79-bc90d98d8e0d admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:41.506136 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d632fe-2ed2-4078-9d79-bc90d98d8e0d admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:41.511742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6e6214-62c6-4b8d-8519-0ee50ba99d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:41.512696 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6214-62c6-4b8d-8519-0ee50ba99d93 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:41.512980 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6214-62c6-4b8d-8519-0ee50ba99d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:41.513388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6e6214-62c6-4b8d-8519-0ee50ba99d93 admin admin] PATH_INFO: `/v3/projects/f4a556f06b684358acab5a84e29962c3/users/31beb7b277234ddc91a2663ae2cde0e0/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:41.528441 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e6214-62c6-4b8d-8519-0ee50ba99d93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4a556f06b684358acab5a84e29962c3, user_id=31beb7b277234ddc91a2663ae2cde0e0, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:41.531101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6e6214-62c6-4b8d-8519-0ee50ba99d93 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:41.635224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:41.641377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1285/2572] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:41 2022] PUT /identity/v3/projects/f4a556f06b684358acab5a84e29962c3/users/31beb7b277234ddc91a2663ae2cde0e0/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:41.653071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7e605-3d02-439c-b873-7e47f3690a29 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:41.654109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7e605-3d02-439c-b873-7e47f3690a29 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:41.654393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e7e605-3d02-439c-b873-7e47f3690a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:41.668922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89255f4f-0dd0-4816-870d-3ab7f9fe7a07 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:41.670082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89255f4f-0dd0-4816-870d-3ab7f9fe7a07 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:41.670082 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89255f4f-0dd0-4816-870d-3ab7f9fe7a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:41.687429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-d2e7e605-3d02-439c-b873-7e47f3690a29 None None] MFA Rules not processed for user `31beb7b277234ddc91a2663ae2cde0e0`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:41.688769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d2e7e605-3d02-439c-b873-7e47f3690a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:41.689092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-89255f4f-0dd0-4816-870d-3ab7f9fe7a07 None None] MFA Rules not processed for user `28d37a0453fb4a06b9edba995c04f878`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:41.690337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-89255f4f-0dd0-4816-870d-3ab7f9fe7a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:41.754568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1286/2573] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:17:41.776395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1288/2574] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:41.788598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89255f4f-0dd0-4816-870d-3ab7f9fe7a07 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:41.861925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89255f4f-0dd0-4816-870d-3ab7f9fe7a07 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:41.866801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a83b7-7978-4bb0-b290-fce5b208f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:41.867500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a83b7-7978-4bb0-b290-fce5b208f2b0 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:41.867801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a83b7-7978-4bb0-b290-fce5b208f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:41.868085 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42a83b7-7978-4bb0-b290-fce5b208f2b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:41.868815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a83b7-7978-4bb0-b290-fce5b208f2b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:41.870731 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42a83b7-7978-4bb0-b290-fce5b208f2b0 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:41.969810 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1287/2575] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:41 2022] POST /identity/v3/projects => generated 381 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:17:41.972749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7e605-3d02-439c-b873-7e47f3690a29 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:41.984638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e7e605-3d02-439c-b873-7e47f3690a29 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:42.028482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a83b7-7978-4bb0-b290-fce5b208f2b0 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:42.030332 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f42a83b7-7978-4bb0-b290-fce5b208f2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:42.072890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dd433-1f5d-43ad-971d-2d42da7751c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:42.074108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dd433-1f5d-43ad-971d-2d42da7751c2 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:42.074616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dd433-1f5d-43ad-971d-2d42da7751c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:42.075154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09dd433-1f5d-43ad-971d-2d42da7751c2 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:42.076157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dd433-1f5d-43ad-971d-2d42da7751c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:42.078621 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09dd433-1f5d-43ad-971d-2d42da7751c2 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:42.107920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42a83b7-7978-4bb0-b290-fce5b208f2b0 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:42.114528 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74226510-b315-4232-9af3-17bcffea14f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:42.115425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74226510-b315-4232-9af3-17bcffea14f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:42.115709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74226510-b315-4232-9af3-17bcffea14f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:42.116016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74226510-b315-4232-9af3-17bcffea14f2 admin admin] PATH_INFO: `/v3/users/010b6a448e9f4c8fa9bfdc371912cd51` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:42.117271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74226510-b315-4232-9af3-17bcffea14f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010b6a448e9f4c8fa9bfdc371912cd51)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:42.119537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74226510-b315-4232-9af3-17bcffea14f2 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:42.180416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1289/2576] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:41 2022] POST /identity/v3/users => generated 297 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:42.185240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dd433-1f5d-43ad-971d-2d42da7751c2 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:42.196792 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09dd433-1f5d-43ad-971d-2d42da7751c2 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:42.202921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cac37d-7ef7-4100-9a3e-522d68dd20a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:42.204079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cac37d-7ef7-4100-9a3e-522d68dd20a3 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:42.204882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cac37d-7ef7-4100-9a3e-522d68dd20a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:42.206659 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:42.207864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cac37d-7ef7-4100-9a3e-522d68dd20a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:42.208788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cac37d-7ef7-4100-9a3e-522d68dd20a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:42.210955 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cac37d-7ef7-4100-9a3e-522d68dd20a3 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:42.226581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1290/2577] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:17:42.228997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cac37d-7ef7-4100-9a3e-522d68dd20a3 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:42.244859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cac37d-7ef7-4100-9a3e-522d68dd20a3 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:42.251106 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80826750-4ab9-4ea4-a658-07c648f12983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:42.253786 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80826750-4ab9-4ea4-a658-07c648f12983 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:42.253786 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80826750-4ab9-4ea4-a658-07c648f12983 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:42.253786 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80826750-4ab9-4ea4-a658-07c648f12983 admin admin] PATH_INFO: `/v3/projects/a63601e896ad472bb6cd47bb2f780b5c/users/39deedef4ea0412c842b9951f58f1083/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:42.274730 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80826750-4ab9-4ea4-a658-07c648f12983 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63601e896ad472bb6cd47bb2f780b5c, user_id=39deedef4ea0412c842b9951f58f1083, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:42.277507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80826750-4ab9-4ea4-a658-07c648f12983 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:42.303909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-74226510-b315-4232-9af3-17bcffea14f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010b6a448e9f4c8fa9bfdc371912cd51'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:42.317811 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-74226510-b315-4232-9af3-17bcffea14f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010b6a448e9f4c8fa9bfdc371912cd51'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:42.318586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-74226510-b315-4232-9af3-17bcffea14f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010b6a448e9f4c8fa9bfdc371912cd51'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:42.319215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-74226510-b315-4232-9af3-17bcffea14f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010b6a448e9f4c8fa9bfdc371912cd51'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:42.338882 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1291/2578] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:42 2022] PUT /identity/v3/projects/a63601e896ad472bb6cd47bb2f780b5c/users/39deedef4ea0412c842b9951f58f1083/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:42.343164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80826750-4ab9-4ea4-a658-07c648f12983 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:42.345053 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-80826750-4ab9-4ea4-a658-07c648f12983 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:42.368592 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:42.417361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80826750-4ab9-4ea4-a658-07c648f12983 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:42.423056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04274a-5275-4fbb-85af-e79f6c9f3665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:42.423766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04274a-5275-4fbb-85af-e79f6c9f3665 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:42.429176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04274a-5275-4fbb-85af-e79f6c9f3665 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:42.429176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04274a-5275-4fbb-85af-e79f6c9f3665 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:42.429176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04274a-5275-4fbb-85af-e79f6c9f3665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:42.429573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-74226510-b315-4232-9af3-17bcffea14f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010b6a448e9f4c8fa9bfdc371912cd51'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:42.429766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04274a-5275-4fbb-85af-e79f6c9f3665 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:42.439097 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1292/2579] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:42 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:42.443284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04274a-5275-4fbb-85af-e79f6c9f3665 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:42.443885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1288/2580] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:42 2022] DELETE /identity/v3/users/010b6a448e9f4c8fa9bfdc371912cd51 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:42.448275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a953d50-deb5-46c2-beea-160eed61d6c3 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:42.448581 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a953d50-deb5-46c2-beea-160eed61d6c3 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:42.448877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a953d50-deb5-46c2-beea-160eed61d6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:42.456277 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04274a-5275-4fbb-85af-e79f6c9f3665 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:42.467377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-1a953d50-deb5-46c2-beea-160eed61d6c3 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:42.468737 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1a953d50-deb5-46c2-beea-160eed61d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:42.514421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57486ec9-cdcc-4485-bbfc-10b6e8c434e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:42.515295 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486ec9-cdcc-4485-bbfc-10b6e8c434e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:42.515576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486ec9-cdcc-4485-bbfc-10b6e8c434e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:42.515885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57486ec9-cdcc-4485-bbfc-10b6e8c434e9 admin admin] PATH_INFO: `/v3/projects/a63601e896ad472bb6cd47bb2f780b5c/users/39deedef4ea0412c842b9951f58f1083/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:42.517982 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57486ec9-cdcc-4485-bbfc-10b6e8c434e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a63601e896ad472bb6cd47bb2f780b5c, user_id=39deedef4ea0412c842b9951f58f1083, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:42.520776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57486ec9-cdcc-4485-bbfc-10b6e8c434e9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:42.529345 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1289/2581] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:17:42.536729 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1293/2582] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:42 2022] PUT /identity/v3/projects/a63601e896ad472bb6cd47bb2f780b5c/users/39deedef4ea0412c842b9951f58f1083/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:42.543174 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a953d50-deb5-46c2-beea-160eed61d6c3 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:42.545192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1a953d50-deb5-46c2-beea-160eed61d6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:42.547413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6999-3b1d-475f-a3d3-8059088d8b40 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:42.547722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6999-3b1d-475f-a3d3-8059088d8b40 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:42.548036 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b6999-3b1d-475f-a3d3-8059088d8b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:42.580782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0b6b6999-3b1d-475f-a3d3-8059088d8b40 None None] MFA Rules not processed for user `39deedef4ea0412c842b9951f58f1083`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:42.581978 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0b6b6999-3b1d-475f-a3d3-8059088d8b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:42.605516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a953d50-deb5-46c2-beea-160eed61d6c3 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:42.653562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1294/2583] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:17:42.655555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af773f6-153c-4f85-a922-278684b9801b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:42.656311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af773f6-153c-4f85-a922-278684b9801b service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:42.656723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af773f6-153c-4f85-a922-278684b9801b service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:42.664242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af773f6-153c-4f85-a922-278684b9801b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:42.665674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b6999-3b1d-475f-a3d3-8059088d8b40 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:42.667187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0b6b6999-3b1d-475f-a3d3-8059088d8b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:42.719531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af773f6-153c-4f85-a922-278684b9801b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:42.721050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af773f6-153c-4f85-a922-278684b9801b service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:42.726630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b6999-3b1d-475f-a3d3-8059088d8b40 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:42.730289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3af4a-5e5b-4537-92bf-c667e0da0821 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:42.730957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3af4a-5e5b-4537-92bf-c667e0da0821 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:42.731407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1290/2584] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:42.731550 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3af4a-5e5b-4537-92bf-c667e0da0821 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:42.731648 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea3af4a-5e5b-4537-92bf-c667e0da0821 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:42.741301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3af4a-5e5b-4537-92bf-c667e0da0821 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:42.746727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea3af4a-5e5b-4537-92bf-c667e0da0821 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:42.754377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1295/2585] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:42 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:17:42.799905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:42.910885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:43.044929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af773f6-153c-4f85-a922-278684b9801b service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:43.054494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af773f6-153c-4f85-a922-278684b9801b service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:43.058102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6682196-833a-4a21-9309-37949e1e1856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:43.058829 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6682196-833a-4a21-9309-37949e1e1856 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:43.059121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6682196-833a-4a21-9309-37949e1e1856 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:43.059423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6682196-833a-4a21-9309-37949e1e1856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:43.061995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a6682196-833a-4a21-9309-37949e1e1856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:43.120436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6682196-833a-4a21-9309-37949e1e1856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:43.121878 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6682196-833a-4a21-9309-37949e1e1856 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:43.131274 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1291/2586] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:43 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:43.230970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3af4a-5e5b-4537-92bf-c667e0da0821 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:43.233075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2ea3af4a-5e5b-4537-92bf-c667e0da0821 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:43.248728 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea3af4a-5e5b-4537-92bf-c667e0da0821 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:43.256768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:43.257602 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:43.257891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:43.258309 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] PATH_INFO: `/v3/projects/1fb3867c0fd349de98c3852e152a7c2d` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:43.259562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fb3867c0fd349de98c3852e152a7c2d)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:43.261562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:43.421394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fb3867c0fd349de98c3852e152a7c2d', 'request_id': 'req-1160ac4a-3232-4ace-bd94-be368b244d6f'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:43.428468 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fb3867c0fd349de98c3852e152a7c2d', 'request_id': 'req-1160ac4a-3232-4ace-bd94-be368b244d6f'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:43.435266 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fb3867c0fd349de98c3852e152a7c2d', 'request_id': 'req-1160ac4a-3232-4ace-bd94-be368b244d6f'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:43.526087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] The token cache is being invalidate because project 1fb3867c0fd349de98c3852e152a7c2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:43.526500 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:43.527616 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:43.530329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1296/2587] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:43 2022] DELETE /identity/v3/projects/1fb3867c0fd349de98c3852e152a7c2d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:43.534280 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6682196-833a-4a21-9309-37949e1e1856 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:43.545897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6682196-833a-4a21-9309-37949e1e1856 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:43.609229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5d71a6-d2f4-41ad-91c0-858ef4dbfe1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:43.610103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d71a6-d2f4-41ad-91c0-858ef4dbfe1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:43.610385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d71a6-d2f4-41ad-91c0-858ef4dbfe1e admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:43.610660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5d71a6-d2f4-41ad-91c0-858ef4dbfe1e admin admin] PATH_INFO: `/v3/users/e2427fbef00745a682e8c3d885f8e3ed` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:43.611991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d71a6-d2f4-41ad-91c0-858ef4dbfe1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2427fbef00745a682e8c3d885f8e3ed)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:43.613987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5d71a6-d2f4-41ad-91c0-858ef4dbfe1e admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:43.642854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:43.780716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1b5d71a6-d2f4-41ad-91c0-858ef4dbfe1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2427fbef00745a682e8c3d885f8e3ed'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:43.792071 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1b5d71a6-d2f4-41ad-91c0-858ef4dbfe1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2427fbef00745a682e8c3d885f8e3ed'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:43.792772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1b5d71a6-d2f4-41ad-91c0-858ef4dbfe1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2427fbef00745a682e8c3d885f8e3ed'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:43.793375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1b5d71a6-d2f4-41ad-91c0-858ef4dbfe1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2427fbef00745a682e8c3d885f8e3ed'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:43.852028 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1b5d71a6-d2f4-41ad-91c0-858ef4dbfe1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2427fbef00745a682e8c3d885f8e3ed'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:43.864571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1292/2588] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:43 2022] DELETE /identity/v3/users/e2427fbef00745a682e8c3d885f8e3ed => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:44.328180 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:44.329683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:44.345318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1160ac4a-3232-4ace-bd94-be368b244d6f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:44.412501 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:44.413711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:44.413990 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:44.414270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394 admin admin] PATH_INFO: `/v3/projects/19e1302be5ad4d0184c5e27cbcdfe7ea` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:44.415508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e1302be5ad4d0184c5e27cbcdfe7ea)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:44.417542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:44.572632 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e1302be5ad4d0184c5e27cbcdfe7ea', 'request_id': 'req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:44.582599 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e1302be5ad4d0184c5e27cbcdfe7ea', 'request_id': 'req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:44.586774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:44.589003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e1302be5ad4d0184c5e27cbcdfe7ea', 'request_id': 'req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:44.674636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394 admin admin] The token cache is being invalidate because project 19e1302be5ad4d0184c5e27cbcdfe7ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:44.674837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:44.675473 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b45a9cfc-0c82-4888-9c5b-5cf25a84d394 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:44.677113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1297/2589] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:44 2022] DELETE /identity/v3/projects/19e1302be5ad4d0184c5e27cbcdfe7ea => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:44.682027 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f109-7888-49b1-b081-f6675e1a806a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:44.682312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f109-7888-49b1-b081-f6675e1a806a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:44.682589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0f109-7888-49b1-b081-f6675e1a806a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:44.700549 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-5ec0f109-7888-49b1-b081-f6675e1a806a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:44.701798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5ec0f109-7888-49b1-b081-f6675e1a806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:44.770114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1293/2590] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:44.777764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6709d20-368d-454f-889f-a2560ed9874f None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:44.778186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6709d20-368d-454f-889f-a2560ed9874f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:44.778347 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6709d20-368d-454f-889f-a2560ed9874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:44.799234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a6709d20-368d-454f-889f-a2560ed9874f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:44.800472 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a6709d20-368d-454f-889f-a2560ed9874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:44.808359 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1298/2591] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:44.813121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f109-7888-49b1-b081-f6675e1a806a None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:44.823273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0f109-7888-49b1-b081-f6675e1a806a None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:44.828050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58463ba-1d4c-44fb-a430-6d4ef7728e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:44.828737 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58463ba-1d4c-44fb-a430-6d4ef7728e2c admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:44.829023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58463ba-1d4c-44fb-a430-6d4ef7728e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:44.829352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58463ba-1d4c-44fb-a430-6d4ef7728e2c admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:44.830301 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58463ba-1d4c-44fb-a430-6d4ef7728e2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:44.830505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58463ba-1d4c-44fb-a430-6d4ef7728e2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:44.832193 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58463ba-1d4c-44fb-a430-6d4ef7728e2c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:44.847841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1294/2592] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:17:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:44.848999 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6709d20-368d-454f-889f-a2560ed9874f None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:44.859031 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6709d20-368d-454f-889f-a2560ed9874f None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:44.863824 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5960924-1540-4e17-a268-ceaaf006ecd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:44.865172 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5960924-1540-4e17-a268-ceaaf006ecd9 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:44.877153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5960924-1540-4e17-a268-ceaaf006ecd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:44.877153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5960924-1540-4e17-a268-ceaaf006ecd9 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:44.877153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5960924-1540-4e17-a268-ceaaf006ecd9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:44.877153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5960924-1540-4e17-a268-ceaaf006ecd9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:44.979254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1299/2593] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:44 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:44.984207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58463ba-1d4c-44fb-a430-6d4ef7728e2c admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:44.994835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58463ba-1d4c-44fb-a430-6d4ef7728e2c admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:45.058789 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666d5d5-a88e-48eb-8763-64a01bf04646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:45.059482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666d5d5-a88e-48eb-8763-64a01bf04646 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:45.060059 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666d5d5-a88e-48eb-8763-64a01bf04646 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:45.060370 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c666d5d5-a88e-48eb-8763-64a01bf04646 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:45.061102 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666d5d5-a88e-48eb-8763-64a01bf04646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:45.063058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c666d5d5-a88e-48eb-8763-64a01bf04646 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:45.153210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1295/2594] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:44 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:45.155190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5960924-1540-4e17-a268-ceaaf006ecd9 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:45.166072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5960924-1540-4e17-a268-ceaaf006ecd9 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:45.171698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fb41c-e651-48f7-89a7-6ac2fe64c116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:45.172565 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fb41c-e651-48f7-89a7-6ac2fe64c116 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:45.172980 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fb41c-e651-48f7-89a7-6ac2fe64c116 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:45.173334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822fb41c-e651-48f7-89a7-6ac2fe64c116 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:45.174622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fb41c-e651-48f7-89a7-6ac2fe64c116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:45.175924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822fb41c-e651-48f7-89a7-6ac2fe64c116 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:45.187397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1300/2595] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:45.193238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666d5d5-a88e-48eb-8763-64a01bf04646 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:45.204686 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c666d5d5-a88e-48eb-8763-64a01bf04646 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:45.209606 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8eec4b-35be-44aa-bf4c-175d88e8b1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:45.210352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eec4b-35be-44aa-bf4c-175d88e8b1ac admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:45.210699 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eec4b-35be-44aa-bf4c-175d88e8b1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:45.211048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8eec4b-35be-44aa-bf4c-175d88e8b1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:45.211859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eec4b-35be-44aa-bf4c-175d88e8b1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:45.213660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8eec4b-35be-44aa-bf4c-175d88e8b1ac admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:45.228412 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1296/2596] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:45.232284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fb41c-e651-48f7-89a7-6ac2fe64c116 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:45.243929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822fb41c-e651-48f7-89a7-6ac2fe64c116 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:45.248731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929739fa-634b-4cd6-a423-c76bc2d355ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:45.249622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929739fa-634b-4cd6-a423-c76bc2d355ba admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:45.249910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929739fa-634b-4cd6-a423-c76bc2d355ba admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:45.250189 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929739fa-634b-4cd6-a423-c76bc2d355ba admin admin] PATH_INFO: `/v3/projects/fdb70cc3ce5b4beab3e2a85a8be87d78/users/e71ae2b72cf347228f083d436c868276/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:45.266046 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929739fa-634b-4cd6-a423-c76bc2d355ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdb70cc3ce5b4beab3e2a85a8be87d78, user_id=e71ae2b72cf347228f083d436c868276, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:45.270531 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929739fa-634b-4cd6-a423-c76bc2d355ba admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:45.367014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1301/2597] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:45 2022] PUT /identity/v3/projects/fdb70cc3ce5b4beab3e2a85a8be87d78/users/e71ae2b72cf347228f083d436c868276/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:45.377893 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22270b15-5785-4e30-9a98-c4e1b51058b0 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:45.378192 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22270b15-5785-4e30-9a98-c4e1b51058b0 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:45.378479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22270b15-5785-4e30-9a98-c4e1b51058b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:45.391852 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:45.407487 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-22270b15-5785-4e30-9a98-c4e1b51058b0 None None] MFA Rules not processed for user `e71ae2b72cf347228f083d436c868276`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:45.408761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-22270b15-5785-4e30-9a98-c4e1b51058b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:45.476460 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1297/2598] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:45.487886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929739fa-634b-4cd6-a423-c76bc2d355ba admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:45.489519 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-929739fa-634b-4cd6-a423-c76bc2d355ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:45.549609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929739fa-634b-4cd6-a423-c76bc2d355ba admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:45.553682 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1f20f-0392-42cb-a477-2ce798fe77e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:45.554331 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1f20f-0392-42cb-a477-2ce798fe77e0 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:45.554612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1f20f-0392-42cb-a477-2ce798fe77e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:45.554969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1f20f-0392-42cb-a477-2ce798fe77e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:45.566170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1f20f-0392-42cb-a477-2ce798fe77e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:45.569351 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1f20f-0392-42cb-a477-2ce798fe77e0 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:45.586604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1302/2599] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:52.211101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22270b15-5785-4e30-9a98-c4e1b51058b0 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:52.215245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-22270b15-5785-4e30-9a98-c4e1b51058b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:52.296691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22270b15-5785-4e30-9a98-c4e1b51058b0 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:52.303351 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:52.304257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:52.304759 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:52.305197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] PATH_INFO: `/v3/users/31beb7b277234ddc91a2663ae2cde0e0` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:52.306644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31beb7b277234ddc91a2663ae2cde0e0)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:52.308864 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:52.529602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31beb7b277234ddc91a2663ae2cde0e0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:52.541409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31beb7b277234ddc91a2663ae2cde0e0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:52.542090 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31beb7b277234ddc91a2663ae2cde0e0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:52.542714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31beb7b277234ddc91a2663ae2cde0e0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:52.606205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31beb7b277234ddc91a2663ae2cde0e0'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:52.620428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1298/2600] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:52 2022] DELETE /identity/v3/users/31beb7b277234ddc91a2663ae2cde0e0 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:52.624946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e697274-d37a-4803-937f-3480f975cffe None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:52.625460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e697274-d37a-4803-937f-3480f975cffe None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:52.625546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e697274-d37a-4803-937f-3480f975cffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:52.648366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0e697274-d37a-4803-937f-3480f975cffe None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:52.649601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0e697274-d37a-4803-937f-3480f975cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:52.724896 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1303/2601] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:52.734425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:52.735955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:52.760470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:52.813583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92210976-9c34-4a73-9dc9-b33e49fced96 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:52.816089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05a54a-c72a-437e-ad1f-bdb0da9d9331 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:52.816826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05a54a-c72a-437e-ad1f-bdb0da9d9331 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:52.817191 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05a54a-c72a-437e-ad1f-bdb0da9d9331 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:52.817559 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f05a54a-c72a-437e-ad1f-bdb0da9d9331 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:52.830741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05a54a-c72a-437e-ad1f-bdb0da9d9331 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:52.832280 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f05a54a-c72a-437e-ad1f-bdb0da9d9331 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:52.844587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1299/2602] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:52.931353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e697274-d37a-4803-937f-3480f975cffe None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:52.932723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0e697274-d37a-4803-937f-3480f975cffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:52.946663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e697274-d37a-4803-937f-3480f975cffe None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:52.952003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b869a-391c-4e02-98cf-9352c7db005c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:52.952884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b869a-391c-4e02-98cf-9352c7db005c admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:52.953195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b869a-391c-4e02-98cf-9352c7db005c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:52.953484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b869a-391c-4e02-98cf-9352c7db005c admin admin] PATH_INFO: `/v3/users/e71ae2b72cf347228f083d436c868276` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:52.954697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b869a-391c-4e02-98cf-9352c7db005c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e71ae2b72cf347228f083d436c868276)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:52.956888 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107b869a-391c-4e02-98cf-9352c7db005c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:52.980330 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:53.229026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-107b869a-391c-4e02-98cf-9352c7db005c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e71ae2b72cf347228f083d436c868276'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:53.229588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-107b869a-391c-4e02-98cf-9352c7db005c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e71ae2b72cf347228f083d436c868276'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:53.230471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-107b869a-391c-4e02-98cf-9352c7db005c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e71ae2b72cf347228f083d436c868276'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:53.320874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-107b869a-391c-4e02-98cf-9352c7db005c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e71ae2b72cf347228f083d436c868276'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:53.329333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05a54a-c72a-437e-ad1f-bdb0da9d9331 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:53.331181 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2f05a54a-c72a-437e-ad1f-bdb0da9d9331 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:53.334456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-107b869a-391c-4e02-98cf-9352c7db005c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e71ae2b72cf347228f083d436c868276'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:53.364427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f05a54a-c72a-437e-ad1f-bdb0da9d9331 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:53.369139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:53.370297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.370817 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.371188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] PATH_INFO: `/v3/projects/f4a556f06b684358acab5a84e29962c3` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.374568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4a556f06b684358acab5a84e29962c3)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:53.376225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1304/2603] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:52 2022] DELETE /identity/v3/users/e71ae2b72cf347228f083d436c868276 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:53.376738 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:53.380335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f1d7c-210b-4785-9c88-259ce6cb7a86 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.380632 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f1d7c-210b-4785-9c88-259ce6cb7a86 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.380910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348f1d7c-210b-4785-9c88-259ce6cb7a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.401953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-348f1d7c-210b-4785-9c88-259ce6cb7a86 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:53.407115 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-348f1d7c-210b-4785-9c88-259ce6cb7a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:53.471766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1305/2604] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:17:53.481593 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f1d7c-210b-4785-9c88-259ce6cb7a86 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:53.483539 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-348f1d7c-210b-4785-9c88-259ce6cb7a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:53.547798 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4a556f06b684358acab5a84e29962c3', 'request_id': 'req-0a8df135-9494-435b-a062-f891d08fd722'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:53.548086 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348f1d7c-210b-4785-9c88-259ce6cb7a86 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:53.553565 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4a556f06b684358acab5a84e29962c3', 'request_id': 'req-0a8df135-9494-435b-a062-f891d08fd722'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:53.560836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4a556f06b684358acab5a84e29962c3', 'request_id': 'req-0a8df135-9494-435b-a062-f891d08fd722'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:53.599644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce82acc-d4bd-4682-9c3b-73bcbd082074 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:53.604254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce82acc-d4bd-4682-9c3b-73bcbd082074 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.604254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce82acc-d4bd-4682-9c3b-73bcbd082074 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.604254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce82acc-d4bd-4682-9c3b-73bcbd082074 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.609937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:53.670261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce82acc-d4bd-4682-9c3b-73bcbd082074 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:53.671768 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce82acc-d4bd-4682-9c3b-73bcbd082074 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:53.681914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1306/2605] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:17:53.772995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] The token cache is being invalidate because project f4a556f06b684358acab5a84e29962c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:53.776103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:53.776103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:53.776103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1300/2606] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:53 2022] DELETE /identity/v3/projects/f4a556f06b684358acab5a84e29962c3 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:53.780126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce82acc-d4bd-4682-9c3b-73bcbd082074 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:53.781560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3ce82acc-d4bd-4682-9c3b-73bcbd082074 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:53.794126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce82acc-d4bd-4682-9c3b-73bcbd082074 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:53.798730 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:53.799594 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:53.799912 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:53.800193 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] PATH_INFO: `/v3/users/39deedef4ea0412c842b9951f58f1083` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:53.801382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=39deedef4ea0412c842b9951f58f1083)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:53.803301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:54.027069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39deedef4ea0412c842b9951f58f1083'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.027767 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39deedef4ea0412c842b9951f58f1083'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.028403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39deedef4ea0412c842b9951f58f1083'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.131646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39deedef4ea0412c842b9951f58f1083'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.139518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39deedef4ea0412c842b9951f58f1083'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.151335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:54.153483 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:54.163389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1307/2607] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:53 2022] DELETE /identity/v3/users/39deedef4ea0412c842b9951f58f1083 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:54.171515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8df135-9494-435b-a062-f891d08fd722 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:54.240362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc76575d-d267-4eef-9d97-898a64b7e308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:54.241335 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76575d-d267-4eef-9d97-898a64b7e308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.241678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76575d-d267-4eef-9d97-898a64b7e308 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.242311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc76575d-d267-4eef-9d97-898a64b7e308 admin admin] PATH_INFO: `/v3/projects/fdb70cc3ce5b4beab3e2a85a8be87d78` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.243644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76575d-d267-4eef-9d97-898a64b7e308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdb70cc3ce5b4beab3e2a85a8be87d78)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:54.245838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc76575d-d267-4eef-9d97-898a64b7e308 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:54.353818 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:54.355431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:54.377481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:54.381930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-fc76575d-d267-4eef-9d97-898a64b7e308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdb70cc3ce5b4beab3e2a85a8be87d78', 'request_id': 'req-fc76575d-d267-4eef-9d97-898a64b7e308'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.390733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-fc76575d-d267-4eef-9d97-898a64b7e308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdb70cc3ce5b4beab3e2a85a8be87d78', 'request_id': 'req-fc76575d-d267-4eef-9d97-898a64b7e308'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.398285 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-fc76575d-d267-4eef-9d97-898a64b7e308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdb70cc3ce5b4beab3e2a85a8be87d78', 'request_id': 'req-fc76575d-d267-4eef-9d97-898a64b7e308'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.437783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9876af3-1ec2-4bba-9af3-01b56d334aec admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:54.491929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-fc76575d-d267-4eef-9d97-898a64b7e308 admin admin] The token cache is being invalidate because project fdb70cc3ce5b4beab3e2a85a8be87d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:54.492229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-fc76575d-d267-4eef-9d97-898a64b7e308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.492988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-fc76575d-d267-4eef-9d97-898a64b7e308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.495921 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02ef59-89c5-4e57-a66b-c932c2f9af51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:54.496670 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02ef59-89c5-4e57-a66b-c932c2f9af51 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.497030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02ef59-89c5-4e57-a66b-c932c2f9af51 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.497581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02ef59-89c5-4e57-a66b-c932c2f9af51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.498682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1301/2608] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:54 2022] DELETE /identity/v3/projects/fdb70cc3ce5b4beab3e2a85a8be87d78 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:54.499855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0b02ef59-89c5-4e57-a66b-c932c2f9af51 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:54.503415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b716219-2b15-4f4d-b11d-6d4f140120f5 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.503947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b716219-2b15-4f4d-b11d-6d4f140120f5 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.504379 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b716219-2b15-4f4d-b11d-6d4f140120f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.526881 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-6b716219-2b15-4f4d-b11d-6d4f140120f5 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:54.528392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6b716219-2b15-4f4d-b11d-6d4f140120f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:54.618717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02ef59-89c5-4e57-a66b-c932c2f9af51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:54.620459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02ef59-89c5-4e57-a66b-c932c2f9af51 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:54.636918 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1302/2609] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:54.638392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b716219-2b15-4f4d-b11d-6d4f140120f5 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:54.645240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6b716219-2b15-4f4d-b11d-6d4f140120f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:54.651410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1308/2610] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:17:54.653394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24739e-7667-4ab6-95ba-1680c6bb4a76 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.654329 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24739e-7667-4ab6-95ba-1680c6bb4a76 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.654711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da24739e-7667-4ab6-95ba-1680c6bb4a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.667911 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b716219-2b15-4f4d-b11d-6d4f140120f5 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:54.674376 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:54.675508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.675670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.676061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710 admin admin] PATH_INFO: `/v3/projects/a63601e896ad472bb6cd47bb2f780b5c` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.677213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-da24739e-7667-4ab6-95ba-1680c6bb4a76 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:54.677975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a63601e896ad472bb6cd47bb2f780b5c)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:54.678787 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-da24739e-7667-4ab6-95ba-1680c6bb4a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:54.679530 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:54.697410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1309/2611] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:54.703188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24739e-7667-4ab6-95ba-1680c6bb4a76 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:54.720815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da24739e-7667-4ab6-95ba-1680c6bb4a76 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:54.728553 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60ddd0-e978-4c11-936b-95e1bff15f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:54.729452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60ddd0-e978-4c11-936b-95e1bff15f59 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.729897 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60ddd0-e978-4c11-936b-95e1bff15f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.730398 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec60ddd0-e978-4c11-936b-95e1bff15f59 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.731321 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60ddd0-e978-4c11-936b-95e1bff15f59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:54.732396 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60ddd0-e978-4c11-936b-95e1bff15f59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:54.734703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec60ddd0-e978-4c11-936b-95e1bff15f59 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:54.752474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1310/2612] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:17:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:17:54.753640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60ddd0-e978-4c11-936b-95e1bff15f59 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:54.765517 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec60ddd0-e978-4c11-936b-95e1bff15f59 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:54.775446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d591-c0f1-4011-942e-08ed2193aa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:54.775446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d591-c0f1-4011-942e-08ed2193aa30 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.775446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d591-c0f1-4011-942e-08ed2193aa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.775446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc93d591-c0f1-4011-942e-08ed2193aa30 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.776170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93d591-c0f1-4011-942e-08ed2193aa30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:54.777439 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc93d591-c0f1-4011-942e-08ed2193aa30 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:54.852884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a63601e896ad472bb6cd47bb2f780b5c', 'request_id': 'req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.859116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a63601e896ad472bb6cd47bb2f780b5c', 'request_id': 'req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.865632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a63601e896ad472bb6cd47bb2f780b5c', 'request_id': 'req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.914129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1311/2613] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:54 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:54.915170 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d591-c0f1-4011-942e-08ed2193aa30 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:54.938674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710 admin admin] The token cache is being invalidate because project a63601e896ad472bb6cd47bb2f780b5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:54.939087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.939929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-e7366a39-5c1a-4bed-ae0a-2cbde38dd710 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:54.945108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1303/2614] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:54 2022] DELETE /identity/v3/projects/a63601e896ad472bb6cd47bb2f780b5c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:54.946611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ddec2-9359-48f5-a331-198480513122 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.947044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ddec2-9359-48f5-a331-198480513122 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.947478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67ddec2-9359-48f5-a331-198480513122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.971705 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b67ddec2-9359-48f5-a331-198480513122 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:54.973153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b67ddec2-9359-48f5-a331-198480513122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:54.987969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc93d591-c0f1-4011-942e-08ed2193aa30 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:54.992998 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0b991-048e-468b-8902-97c8703ee690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:54.995340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0b991-048e-468b-8902-97c8703ee690 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:54.995340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0b991-048e-468b-8902-97c8703ee690 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:54.995340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0b991-048e-468b-8902-97c8703ee690 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:54.995340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0b991-048e-468b-8902-97c8703ee690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:55.004390 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb0b991-048e-468b-8902-97c8703ee690 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:55.025353 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:55.058099 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1304/2615] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:55.066478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becd61a-6b48-4956-8205-b519e182b85a None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.066816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becd61a-6b48-4956-8205-b519e182b85a None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.067177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6becd61a-6b48-4956-8205-b519e182b85a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.085409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-6becd61a-6b48-4956-8205-b519e182b85a None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:55.086634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-6becd61a-6b48-4956-8205-b519e182b85a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:55.095469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1305/2616] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:17:55.099599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becd61a-6b48-4956-8205-b519e182b85a None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:55.109434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6becd61a-6b48-4956-8205-b519e182b85a None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:55.116627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1312/2617] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:54 2022] POST /identity/v3/users => generated 289 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:55.118549 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8f6f9-585d-44a7-9c62-0e2a2c7e9091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:55.119378 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8f6f9-585d-44a7-9c62-0e2a2c7e9091 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.119856 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8f6f9-585d-44a7-9c62-0e2a2c7e9091 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.120594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f8f6f9-585d-44a7-9c62-0e2a2c7e9091 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.121451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8f6f9-585d-44a7-9c62-0e2a2c7e9091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:17:55.121597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0b991-048e-468b-8902-97c8703ee690 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:55.121874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8f6f9-585d-44a7-9c62-0e2a2c7e9091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:55.123842 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-1cb0b991-048e-468b-8902-97c8703ee690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:55.123995 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f8f6f9-585d-44a7-9c62-0e2a2c7e9091 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:55.138460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0b991-048e-468b-8902-97c8703ee690 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:55.143280 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1306/2618] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:17:55.147087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8f6f9-585d-44a7-9c62-0e2a2c7e9091 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:55.148043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6163a0-e596-4ad5-994e-7a9e52771b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:55.148732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6163a0-e596-4ad5-994e-7a9e52771b77 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.149014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6163a0-e596-4ad5-994e-7a9e52771b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.149291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6163a0-e596-4ad5-994e-7a9e52771b77 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.150135 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6163a0-e596-4ad5-994e-7a9e52771b77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:55.151835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6163a0-e596-4ad5-994e-7a9e52771b77 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:55.157202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f8f6f9-585d-44a7-9c62-0e2a2c7e9091 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:55.163199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfa12e-f3a2-4f86-a461-21dbe66aebac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:55.163982 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfa12e-f3a2-4f86-a461-21dbe66aebac admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.167516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1313/2619] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:17:55.167674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfa12e-f3a2-4f86-a461-21dbe66aebac admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.167674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cfa12e-f3a2-4f86-a461-21dbe66aebac admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.167674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfa12e-f3a2-4f86-a461-21dbe66aebac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:55.168073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cfa12e-f3a2-4f86-a461-21dbe66aebac admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:55.169014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6163a0-e596-4ad5-994e-7a9e52771b77 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:55.181871 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6163a0-e596-4ad5-994e-7a9e52771b77 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:55.188365 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e199da4-8c52-4bab-a545-ab53f0deefb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:55.189128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e199da4-8c52-4bab-a545-ab53f0deefb7 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.189470 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e199da4-8c52-4bab-a545-ab53f0deefb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.189808 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e199da4-8c52-4bab-a545-ab53f0deefb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.190541 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e199da4-8c52-4bab-a545-ab53f0deefb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:55.192178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e199da4-8c52-4bab-a545-ab53f0deefb7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:55.202630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1314/2620] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:55.206825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e199da4-8c52-4bab-a545-ab53f0deefb7 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:55.218150 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e199da4-8c52-4bab-a545-ab53f0deefb7 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:55.222977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88104706-81d5-4c1c-b85c-610f4473de23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:55.223894 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88104706-81d5-4c1c-b85c-610f4473de23 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.224199 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88104706-81d5-4c1c-b85c-610f4473de23 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.224474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88104706-81d5-4c1c-b85c-610f4473de23 admin admin] PATH_INFO: `/v3/projects/e0d9edd2488341808be621e32940649f/users/9bcfc5f20c05432ca955aff73568c374/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.241080 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88104706-81d5-4c1c-b85c-610f4473de23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d9edd2488341808be621e32940649f, user_id=9bcfc5f20c05432ca955aff73568c374, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:55.244047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88104706-81d5-4c1c-b85c-610f4473de23 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:55.301289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1307/2621] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:55 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:17:55.305161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfa12e-f3a2-4f86-a461-21dbe66aebac admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:55.328488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1315/2622] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:55 2022] PUT /identity/v3/projects/e0d9edd2488341808be621e32940649f/users/9bcfc5f20c05432ca955aff73568c374/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:17:55.338698 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763f3e6-ab41-4802-ad1e-b9b1e7a72567 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.338989 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763f3e6-ab41-4802-ad1e-b9b1e7a72567 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.339273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763f3e6-ab41-4802-ad1e-b9b1e7a72567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.369056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-f763f3e6-ab41-4802-ad1e-b9b1e7a72567 None None] MFA Rules not processed for user `9bcfc5f20c05432ca955aff73568c374`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:55.371420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f763f3e6-ab41-4802-ad1e-b9b1e7a72567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:55.372984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cfa12e-f3a2-4f86-a461-21dbe66aebac admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:55.447263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8398507-8b5b-4178-8832-ca33fde8d84b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:55.448046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8398507-8b5b-4178-8832-ca33fde8d84b admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.448334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8398507-8b5b-4178-8832-ca33fde8d84b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.448611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8398507-8b5b-4178-8832-ca33fde8d84b admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.450127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8398507-8b5b-4178-8832-ca33fde8d84b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:55.450268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1316/2623] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:55 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:17:55.453031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8398507-8b5b-4178-8832-ca33fde8d84b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:55.463929 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763f3e6-ab41-4802-ad1e-b9b1e7a72567 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:55.465345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f763f3e6-ab41-4802-ad1e-b9b1e7a72567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:55.524287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763f3e6-ab41-4802-ad1e-b9b1e7a72567 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:55.528367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff4f17-36d1-4f3f-bf3f-2b08f0c9479b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:55.529817 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4f17-36d1-4f3f-bf3f-2b08f0c9479b service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.530009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4f17-36d1-4f3f-bf3f-2b08f0c9479b service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.530306 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff4f17-36d1-4f3f-bf3f-2b08f0c9479b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.539212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff4f17-36d1-4f3f-bf3f-2b08f0c9479b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:55.540701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff4f17-36d1-4f3f-bf3f-2b08f0c9479b service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:55.550298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1317/2624] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:17:55.572184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1308/2625] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:55 2022] POST /identity/v3/users => generated 283 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:17:55.579931 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff4f17-36d1-4f3f-bf3f-2b08f0c9479b service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:55.593114 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff4f17-36d1-4f3f-bf3f-2b08f0c9479b service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:55.598189 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e4527-e80f-4038-a1c2-dacad08d3b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:55.598886 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e4527-e80f-4038-a1c2-dacad08d3b76 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.599192 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e4527-e80f-4038-a1c2-dacad08d3b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.599498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e4527-e80f-4038-a1c2-dacad08d3b76 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.600235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e4527-e80f-4038-a1c2-dacad08d3b76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:55.602289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e4527-e80f-4038-a1c2-dacad08d3b76 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:55.613445 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1318/2626] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:55.617791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8398507-8b5b-4178-8832-ca33fde8d84b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:55.628340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8398507-8b5b-4178-8832-ca33fde8d84b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:55.638734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68df468-326d-44e9-afc0-65759f1a91c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:55.638734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68df468-326d-44e9-afc0-65759f1a91c4 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.638734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68df468-326d-44e9-afc0-65759f1a91c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.638734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68df468-326d-44e9-afc0-65759f1a91c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.639041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68df468-326d-44e9-afc0-65759f1a91c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:55.639630 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68df468-326d-44e9-afc0-65759f1a91c4 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:55.656168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1309/2627] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:55.657469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e4527-e80f-4038-a1c2-dacad08d3b76 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:55.667606 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e4527-e80f-4038-a1c2-dacad08d3b76 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:55.672465 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9295-0800-47c1-b53e-7c9130b9f77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:55.673372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9295-0800-47c1-b53e-7c9130b9f77c admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.673657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9295-0800-47c1-b53e-7c9130b9f77c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.673938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7c9295-0800-47c1-b53e-7c9130b9f77c admin admin] PATH_INFO: `/v3/projects/364dcbf2700b4a5a858cbdcb28f8c197/users/007d35e452714028ab7ba495d1b5daf4/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.691105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9295-0800-47c1-b53e-7c9130b9f77c admin admin] RBAC: Authorizing `identity:create_grant(project_id=364dcbf2700b4a5a858cbdcb28f8c197, user_id=007d35e452714028ab7ba495d1b5daf4, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:55.695614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7c9295-0800-47c1-b53e-7c9130b9f77c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:55.798758 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1319/2628] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:55 2022] PUT /identity/v3/projects/364dcbf2700b4a5a858cbdcb28f8c197/users/007d35e452714028ab7ba495d1b5daf4/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:55.801827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eecef6-246b-4ea3-9878-7c8efaf94cb4 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:55.801827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eecef6-246b-4ea3-9878-7c8efaf94cb4 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:55.802061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10eecef6-246b-4ea3-9878-7c8efaf94cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:55.849618 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-10eecef6-246b-4ea3-9878-7c8efaf94cb4 None None] MFA Rules not processed for user `007d35e452714028ab7ba495d1b5daf4`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:55.850847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-10eecef6-246b-4ea3-9878-7c8efaf94cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:55.928522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1310/2629] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:55 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:17:55.933638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9295-0800-47c1-b53e-7c9130b9f77c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:56.029438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7c9295-0800-47c1-b53e-7c9130b9f77c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:56.038406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61167321-2d9a-4693-98fe-dfb739517fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:56.039219 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61167321-2d9a-4693-98fe-dfb739517fd3 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.039575 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61167321-2d9a-4693-98fe-dfb739517fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.039956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61167321-2d9a-4693-98fe-dfb739517fd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.040736 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61167321-2d9a-4693-98fe-dfb739517fd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:56.042927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61167321-2d9a-4693-98fe-dfb739517fd3 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:56.146420 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1320/2630] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:17:55 2022] POST /identity/v3/projects => generated 365 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:17:56.150736 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eecef6-246b-4ea3-9878-7c8efaf94cb4 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:56.163185 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10eecef6-246b-4ea3-9878-7c8efaf94cb4 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:56.227001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949af103-842b-4370-9f6a-18c2db97adbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:56.227886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949af103-842b-4370-9f6a-18c2db97adbb admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.228547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949af103-842b-4370-9f6a-18c2db97adbb admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.228547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949af103-842b-4370-9f6a-18c2db97adbb admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.229267 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949af103-842b-4370-9f6a-18c2db97adbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:56.231354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949af103-842b-4370-9f6a-18c2db97adbb admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:56.318331 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1311/2631] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:17:56 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:17:56.322392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61167321-2d9a-4693-98fe-dfb739517fd3 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:56.338214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61167321-2d9a-4693-98fe-dfb739517fd3 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:56.344047 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854dcc7-85f2-4259-bd3b-47b993cab004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:56.344395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854dcc7-85f2-4259-bd3b-47b993cab004 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.344691 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854dcc7-85f2-4259-bd3b-47b993cab004 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.344972 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854dcc7-85f2-4259-bd3b-47b993cab004 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.346109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854dcc7-85f2-4259-bd3b-47b993cab004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:56.347370 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854dcc7-85f2-4259-bd3b-47b993cab004 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:56.365975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949af103-842b-4370-9f6a-18c2db97adbb admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:56.384261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1321/2632] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:17:56.385283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949af103-842b-4370-9f6a-18c2db97adbb admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:56.389327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:56.392892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28533ad4-3b4a-4c9a-bc95-4a36858d48b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:56.393907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28533ad4-3b4a-4c9a-bc95-4a36858d48b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.394294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28533ad4-3b4a-4c9a-bc95-4a36858d48b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.394739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28533ad4-3b4a-4c9a-bc95-4a36858d48b8 admin admin] PATH_INFO: `/v3/projects/5f9c2e1d5d6e43d9b39fe93550b8165a/users/88663b494e094bae85e439f557b6f727/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.417654 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28533ad4-3b4a-4c9a-bc95-4a36858d48b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9c2e1d5d6e43d9b39fe93550b8165a, user_id=88663b494e094bae85e439f557b6f727, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:56.421294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28533ad4-3b4a-4c9a-bc95-4a36858d48b8 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:56.540057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1312/2633] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:56 2022] PUT /identity/v3/projects/5f9c2e1d5d6e43d9b39fe93550b8165a/users/88663b494e094bae85e439f557b6f727/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:56.544012 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854dcc7-85f2-4259-bd3b-47b993cab004 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:56.556087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854dcc7-85f2-4259-bd3b-47b993cab004 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:56.631910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ff63c-4946-4546-8b60-b9d9e6f3c318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:56.632156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff63c-4946-4546-8b60-b9d9e6f3c318 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.632437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff63c-4946-4546-8b60-b9d9e6f3c318 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.632713 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ff63c-4946-4546-8b60-b9d9e6f3c318 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.633486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ff63c-4946-4546-8b60-b9d9e6f3c318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:56.636394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ff63c-4946-4546-8b60-b9d9e6f3c318 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:56.652001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1322/2634] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:17:56.656750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28533ad4-3b4a-4c9a-bc95-4a36858d48b8 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:56.667784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28533ad4-3b4a-4c9a-bc95-4a36858d48b8 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:56.673377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678040a1-4038-4b4c-b3ae-d98438c91a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:56.674289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678040a1-4038-4b4c-b3ae-d98438c91a6b admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.674572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678040a1-4038-4b4c-b3ae-d98438c91a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.674868 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678040a1-4038-4b4c-b3ae-d98438c91a6b admin admin] PATH_INFO: `/v3/projects/5f9c2e1d5d6e43d9b39fe93550b8165a/users/88663b494e094bae85e439f557b6f727/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.676897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678040a1-4038-4b4c-b3ae-d98438c91a6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f9c2e1d5d6e43d9b39fe93550b8165a, user_id=88663b494e094bae85e439f557b6f727, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:56.679523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678040a1-4038-4b4c-b3ae-d98438c91a6b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:56.691052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1313/2635] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:17:56 2022] PUT /identity/v3/projects/5f9c2e1d5d6e43d9b39fe93550b8165a/users/88663b494e094bae85e439f557b6f727/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:56.702997 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95360b38-05c7-47c0-bc77-3e7d4dbe17c6 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.703665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95360b38-05c7-47c0-bc77-3e7d4dbe17c6 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.703665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95360b38-05c7-47c0-bc77-3e7d4dbe17c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.732816 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-95360b38-05c7-47c0-bc77-3e7d4dbe17c6 None None] MFA Rules not processed for user `88663b494e094bae85e439f557b6f727`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:17:56.734509 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-95360b38-05c7-47c0-bc77-3e7d4dbe17c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:56.811017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1323/2636] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:17:56 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:17:56.822677 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678040a1-4038-4b4c-b3ae-d98438c91a6b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:56.884940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678040a1-4038-4b4c-b3ae-d98438c91a6b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:56.889563 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816aada-bcfb-4e7d-bfd3-da740ca90856 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:56.892955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816aada-bcfb-4e7d-bfd3-da740ca90856 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:56.892955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816aada-bcfb-4e7d-bfd3-da740ca90856 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:56.892955 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4816aada-bcfb-4e7d-bfd3-da740ca90856 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:56.900744 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816aada-bcfb-4e7d-bfd3-da740ca90856 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:56.902299 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4816aada-bcfb-4e7d-bfd3-da740ca90856 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:56.913377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1314/2637] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:56 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:57.204303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95360b38-05c7-47c0-bc77-3e7d4dbe17c6 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:57.214129 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95360b38-05c7-47c0-bc77-3e7d4dbe17c6 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:57.218433 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394986a-f342-4b2a-9ea5-c577ffc0e208 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:57.219077 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394986a-f342-4b2a-9ea5-c577ffc0e208 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:57.219671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394986a-f342-4b2a-9ea5-c577ffc0e208 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:57.220126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5394986a-f342-4b2a-9ea5-c577ffc0e208 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:57.267966 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:57.333940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394986a-f342-4b2a-9ea5-c577ffc0e208 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:57.336830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5394986a-f342-4b2a-9ea5-c577ffc0e208 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:57.370337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1324/2638] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:57 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:58.504573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:58.664479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816aada-bcfb-4e7d-bfd3-da740ca90856 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:58.665947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4816aada-bcfb-4e7d-bfd3-da740ca90856 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:58.743358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4816aada-bcfb-4e7d-bfd3-da740ca90856 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:58.748328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce37458-f102-41a8-93a3-b564ba30af4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e838dd9aa24f4571b64719125610c528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:58.748974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce37458-f102-41a8-93a3-b564ba30af4f service placement] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:58.749257 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce37458-f102-41a8-93a3-b564ba30af4f service placement] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:58.749536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce37458-f102-41a8-93a3-b564ba30af4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:58.751312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2ce37458-f102-41a8-93a3-b564ba30af4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:58.764069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce37458-f102-41a8-93a3-b564ba30af4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:58.765718 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce37458-f102-41a8-93a3-b564ba30af4f service placement] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:58.776234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1315/2639] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:17:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:17:58.852561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394986a-f342-4b2a-9ea5-c577ffc0e208 service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:58.854104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5394986a-f342-4b2a-9ea5-c577ffc0e208 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:17:58.883962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:17:58.922741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5394986a-f342-4b2a-9ea5-c577ffc0e208 service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:58.927416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7254ea77-a4ec-4f3a-a08c-d4b889016791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:58.928306 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254ea77-a4ec-4f3a-a08c-d4b889016791 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:58.928590 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254ea77-a4ec-4f3a-a08c-d4b889016791 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:58.928868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7254ea77-a4ec-4f3a-a08c-d4b889016791 admin admin] PATH_INFO: `/v3/users/bdc5ef02c9fd4b2888239b9b19ae4d5e` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:58.930063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254ea77-a4ec-4f3a-a08c-d4b889016791 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdc5ef02c9fd4b2888239b9b19ae4d5e)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:58.932010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7254ea77-a4ec-4f3a-a08c-d4b889016791 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:59.162979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7254ea77-a4ec-4f3a-a08c-d4b889016791 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdc5ef02c9fd4b2888239b9b19ae4d5e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:59.163651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7254ea77-a4ec-4f3a-a08c-d4b889016791 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdc5ef02c9fd4b2888239b9b19ae4d5e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:59.164319 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7254ea77-a4ec-4f3a-a08c-d4b889016791 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdc5ef02c9fd4b2888239b9b19ae4d5e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:59.276198 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7254ea77-a4ec-4f3a-a08c-d4b889016791 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdc5ef02c9fd4b2888239b9b19ae4d5e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:59.290584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-7254ea77-a4ec-4f3a-a08c-d4b889016791 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdc5ef02c9fd4b2888239b9b19ae4d5e'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:59.315644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1325/2640] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:17:58 2022] DELETE /identity/v3/users/bdc5ef02c9fd4b2888239b9b19ae4d5e => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:17:59.656568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce37458-f102-41a8-93a3-b564ba30af4f service placement] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:17:59.673601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce37458-f102-41a8-93a3-b564ba30af4f service placement] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:17:59.772179 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fc40d-a5f6-4568-b14f-9f924553412a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:17:59.773041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fc40d-a5f6-4568-b14f-9f924553412a admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:17:59.773327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fc40d-a5f6-4568-b14f-9f924553412a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:17:59.773607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fc40d-a5f6-4568-b14f-9f924553412a admin admin] PATH_INFO: `/v3/projects/52d337d92f2b463eb96fe92501a0c4cc` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:17:59.778234 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fc40d-a5f6-4568-b14f-9f924553412a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52d337d92f2b463eb96fe92501a0c4cc)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:17:59.781584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fc40d-a5f6-4568-b14f-9f924553412a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:17:59.898269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-596fc40d-a5f6-4568-b14f-9f924553412a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52d337d92f2b463eb96fe92501a0c4cc', 'request_id': 'req-596fc40d-a5f6-4568-b14f-9f924553412a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:59.904975 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-596fc40d-a5f6-4568-b14f-9f924553412a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52d337d92f2b463eb96fe92501a0c4cc', 'request_id': 'req-596fc40d-a5f6-4568-b14f-9f924553412a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:59.913161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-596fc40d-a5f6-4568-b14f-9f924553412a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52d337d92f2b463eb96fe92501a0c4cc', 'request_id': 'req-596fc40d-a5f6-4568-b14f-9f924553412a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:59.994471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-596fc40d-a5f6-4568-b14f-9f924553412a admin admin] The token cache is being invalidate because project 52d337d92f2b463eb96fe92501a0c4cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:17:59.994765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-596fc40d-a5f6-4568-b14f-9f924553412a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:59.995422 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-596fc40d-a5f6-4568-b14f-9f924553412a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:17:59.997226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1316/2641] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:17:59 2022] DELETE /identity/v3/projects/52d337d92f2b463eb96fe92501a0c4cc => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:00.005082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47615f-f266-49ea-b816-49a79d1bc298 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:00.006367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47615f-f266-49ea-b816-49a79d1bc298 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:00.006868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d47615f-f266-49ea-b816-49a79d1bc298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:00.040088 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-5d47615f-f266-49ea-b816-49a79d1bc298 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:00.041330 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5d47615f-f266-49ea-b816-49a79d1bc298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:00.121867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1326/2642] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:00.129917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58ad56-84a4-48a4-81d5-2f45770a948d None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:00.130235 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58ad56-84a4-48a4-81d5-2f45770a948d None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:00.130529 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58ad56-84a4-48a4-81d5-2f45770a948d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:00.154616 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-9c58ad56-84a4-48a4-81d5-2f45770a948d None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:00.155894 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-9c58ad56-84a4-48a4-81d5-2f45770a948d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:00.165660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1317/2643] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:00.169899 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47615f-f266-49ea-b816-49a79d1bc298 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:00.180057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d47615f-f266-49ea-b816-49a79d1bc298 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:00.185179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbce25c-288b-4411-b622-6beaf440fb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:00.185855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce25c-288b-4411-b622-6beaf440fb26 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:00.186141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce25c-288b-4411-b622-6beaf440fb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:00.186447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbce25c-288b-4411-b622-6beaf440fb26 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:00.187211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbce25c-288b-4411-b622-6beaf440fb26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:00.187530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbce25c-288b-4411-b622-6beaf440fb26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:00.189313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbce25c-288b-4411-b622-6beaf440fb26 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:00.204953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1327/2644] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:18:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:00.209108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58ad56-84a4-48a4-81d5-2f45770a948d None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:00.220854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58ad56-84a4-48a4-81d5-2f45770a948d None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:00.225814 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477ad16-4c22-4996-a776-b6561fa01283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:00.226502 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ad16-4c22-4996-a776-b6561fa01283 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:00.226788 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ad16-4c22-4996-a776-b6561fa01283 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:00.228623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2477ad16-4c22-4996-a776-b6561fa01283 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:00.228623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477ad16-4c22-4996-a776-b6561fa01283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:00.230078 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2477ad16-4c22-4996-a776-b6561fa01283 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:00.311141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1318/2645] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:00 2022] POST /identity/v3/projects => generated 365 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:00.315203 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbce25c-288b-4411-b622-6beaf440fb26 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:00.325746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbce25c-288b-4411-b622-6beaf440fb26 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:00.388422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419087a-31a1-41d2-bedf-72433ded1195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:00.389096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419087a-31a1-41d2-bedf-72433ded1195 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:00.389378 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419087a-31a1-41d2-bedf-72433ded1195 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:00.389656 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b419087a-31a1-41d2-bedf-72433ded1195 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:00.390375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419087a-31a1-41d2-bedf-72433ded1195 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:00.392318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b419087a-31a1-41d2-bedf-72433ded1195 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:00.477797 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1328/2646] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:00 2022] POST /identity/v3/users => generated 283 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:00.479053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477ad16-4c22-4996-a776-b6561fa01283 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:00.489967 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2477ad16-4c22-4996-a776-b6561fa01283 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:00.494715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2fbb3-d928-4c3f-876b-6a29dd40f724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:00.495382 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2fbb3-d928-4c3f-876b-6a29dd40f724 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:00.495666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2fbb3-d928-4c3f-876b-6a29dd40f724 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:00.495960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d2fbb3-d928-4c3f-876b-6a29dd40f724 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:00.496683 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2fbb3-d928-4c3f-876b-6a29dd40f724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:00.498799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d2fbb3-d928-4c3f-876b-6a29dd40f724 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:00.503386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:00.513545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1319/2647] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:00.516942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419087a-31a1-41d2-bedf-72433ded1195 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:00.527195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b419087a-31a1-41d2-bedf-72433ded1195 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:00.532810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3fca8f-e9b6-4096-b353-ab8cc8e3df27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:00.533479 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fca8f-e9b6-4096-b353-ab8cc8e3df27 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:00.533770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fca8f-e9b6-4096-b353-ab8cc8e3df27 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:00.534050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3fca8f-e9b6-4096-b353-ab8cc8e3df27 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:00.534780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fca8f-e9b6-4096-b353-ab8cc8e3df27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:00.536417 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3fca8f-e9b6-4096-b353-ab8cc8e3df27 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:00.546631 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1329/2648] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:00.551011 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2fbb3-d928-4c3f-876b-6a29dd40f724 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:00.562329 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d2fbb3-d928-4c3f-876b-6a29dd40f724 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:00.565953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:00.567070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56964684-fe1a-486e-a781-db8e417c8d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:00.567977 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56964684-fe1a-486e-a781-db8e417c8d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:00.568279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56964684-fe1a-486e-a781-db8e417c8d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:00.568580 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56964684-fe1a-486e-a781-db8e417c8d29 admin admin] PATH_INFO: `/v3/projects/2d38084f71dd419a81ff8db30f12db2c/users/8b0347d61d5d45428a52206055405e33/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:00.585113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56964684-fe1a-486e-a781-db8e417c8d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d38084f71dd419a81ff8db30f12db2c, user_id=8b0347d61d5d45428a52206055405e33, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:00.588799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56964684-fe1a-486e-a781-db8e417c8d29 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:00.663736 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1320/2649] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:00 2022] PUT /identity/v3/projects/2d38084f71dd419a81ff8db30f12db2c/users/8b0347d61d5d45428a52206055405e33/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:00.674354 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6963b8-8126-4cda-a7e3-946343bc10e6 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:00.674638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6963b8-8126-4cda-a7e3-946343bc10e6 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:00.674914 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6963b8-8126-4cda-a7e3-946343bc10e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:00.702813 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-2e6963b8-8126-4cda-a7e3-946343bc10e6 None None] MFA Rules not processed for user `8b0347d61d5d45428a52206055405e33`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:00.704239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2e6963b8-8126-4cda-a7e3-946343bc10e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:00.773384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1330/2650] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:00 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:00.784267 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56964684-fe1a-486e-a781-db8e417c8d29 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:00.786123 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-56964684-fe1a-486e-a781-db8e417c8d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:00.847094 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56964684-fe1a-486e-a781-db8e417c8d29 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:00.851213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e981a-379e-467b-8a4e-a502581a9c4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:00.851905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e981a-379e-467b-8a4e-a502581a9c4d service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:00.852205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e981a-379e-467b-8a4e-a502581a9c4d service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:00.852479 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e981a-379e-467b-8a4e-a502581a9c4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:00.862370 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e981a-379e-467b-8a4e-a502581a9c4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:00.864079 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0e981a-379e-467b-8a4e-a502581a9c4d service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:00.874892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1321/2651] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:00 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:01.492199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:01.524938 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6963b8-8126-4cda-a7e3-946343bc10e6 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:01.526403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2e6963b8-8126-4cda-a7e3-946343bc10e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:01.618810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6963b8-8126-4cda-a7e3-946343bc10e6 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:01.624384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:01.625384 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:01.626484 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:01.626766 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:01.627042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] PATH_INFO: `/v3/users/007d35e452714028ab7ba495d1b5daf4` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:01.628429 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] RBAC: Authorizing `identity:delete_user(user_id=007d35e452714028ab7ba495d1b5daf4)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:01.630405 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:01.826566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d65bc9-9276-4001-888c-e995cf6958bb None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:01.827389 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d65bc9-9276-4001-888c-e995cf6958bb None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:01.827566 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d65bc9-9276-4001-888c-e995cf6958bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:01.837763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '007d35e452714028ab7ba495d1b5daf4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:01.838511 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '007d35e452714028ab7ba495d1b5daf4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:01.839122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '007d35e452714028ab7ba495d1b5daf4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:01.847691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-b9d65bc9-9276-4001-888c-e995cf6958bb None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:01.848954 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b9d65bc9-9276-4001-888c-e995cf6958bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:01.903797 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1322/2652] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:18:01 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:01.943173 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '007d35e452714028ab7ba495d1b5daf4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:01.951502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '007d35e452714028ab7ba495d1b5daf4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:01.968753 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1331/2653] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:01 2022] DELETE /identity/v3/users/007d35e452714028ab7ba495d1b5daf4 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:01.973259 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce548a-4644-4547-94ed-df02fc024389 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:01.973547 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce548a-4644-4547-94ed-df02fc024389 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:01.973824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce548a-4644-4547-94ed-df02fc024389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:01.991212 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-ecce548a-4644-4547-94ed-df02fc024389 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:01.992597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ecce548a-4644-4547-94ed-df02fc024389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:02.050789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:02.050789 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:02.055679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1323/2654] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:02.067999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce548a-4644-4547-94ed-df02fc024389 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:02.069374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ecce548a-4644-4547-94ed-df02fc024389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:02.128243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce548a-4644-4547-94ed-df02fc024389 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:02.129762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3e3bc-a13e-41ca-9cfe-5ee078589845 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:02.132025 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b51826-dbb5-4b3b-87fa-72b3131329d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:02.132679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b51826-dbb5-4b3b-87fa-72b3131329d3 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:02.132965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b51826-dbb5-4b3b-87fa-72b3131329d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:02.133245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b51826-dbb5-4b3b-87fa-72b3131329d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:02.135023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089980be-e2b1-4206-ae05-4d74771aaeaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:02.135753 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089980be-e2b1-4206-ae05-4d74771aaeaf service swift] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:02.136122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089980be-e2b1-4206-ae05-4d74771aaeaf service swift] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:02.136469 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089980be-e2b1-4206-ae05-4d74771aaeaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:02.143583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b51826-dbb5-4b3b-87fa-72b3131329d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:02.145176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b51826-dbb5-4b3b-87fa-72b3131329d3 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:02.154828 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1324/2655] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:02.194719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089980be-e2b1-4206-ae05-4d74771aaeaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:02.196376 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089980be-e2b1-4206-ae05-4d74771aaeaf service swift] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:02.205665 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1332/2656] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:18:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:18:02.619509 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b51826-dbb5-4b3b-87fa-72b3131329d3 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:02.621922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-74b51826-dbb5-4b3b-87fa-72b3131329d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:02.637893 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b51826-dbb5-4b3b-87fa-72b3131329d3 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:02.644623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b93e221-9a3e-45a1-94a2-5bd271e2819e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:02.645582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93e221-9a3e-45a1-94a2-5bd271e2819e admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:02.646003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93e221-9a3e-45a1-94a2-5bd271e2819e admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:02.646567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b93e221-9a3e-45a1-94a2-5bd271e2819e admin admin] PATH_INFO: `/v3/projects/364dcbf2700b4a5a858cbdcb28f8c197` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:02.648072 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93e221-9a3e-45a1-94a2-5bd271e2819e admin admin] RBAC: Authorizing `identity:delete_project(project_id=364dcbf2700b4a5a858cbdcb28f8c197)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:02.658791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b93e221-9a3e-45a1-94a2-5bd271e2819e admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:02.800884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-9b93e221-9a3e-45a1-94a2-5bd271e2819e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '364dcbf2700b4a5a858cbdcb28f8c197', 'request_id': 'req-9b93e221-9a3e-45a1-94a2-5bd271e2819e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:02.806501 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-9b93e221-9a3e-45a1-94a2-5bd271e2819e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '364dcbf2700b4a5a858cbdcb28f8c197', 'request_id': 'req-9b93e221-9a3e-45a1-94a2-5bd271e2819e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:02.813953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-9b93e221-9a3e-45a1-94a2-5bd271e2819e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '364dcbf2700b4a5a858cbdcb28f8c197', 'request_id': 'req-9b93e221-9a3e-45a1-94a2-5bd271e2819e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:02.909769 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-9b93e221-9a3e-45a1-94a2-5bd271e2819e admin admin] The token cache is being invalidate because project 364dcbf2700b4a5a858cbdcb28f8c197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:02.910342 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-9b93e221-9a3e-45a1-94a2-5bd271e2819e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:02.910697 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-9b93e221-9a3e-45a1-94a2-5bd271e2819e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:02.912523 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1325/2657] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:02 2022] DELETE /identity/v3/projects/364dcbf2700b4a5a858cbdcb28f8c197 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:02.916620 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089980be-e2b1-4206-ae05-4d74771aaeaf service swift] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:02.929062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089980be-e2b1-4206-ae05-4d74771aaeaf service swift] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:02.997674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:02.999317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:03.000237 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.000521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.000806 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] PATH_INFO: `/v3/users/88663b494e094bae85e439f557b6f727` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.002027 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] RBAC: Authorizing `identity:delete_user(user_id=88663b494e094bae85e439f557b6f727)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:03.003968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:03.063183 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:03.203333 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88663b494e094bae85e439f557b6f727'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:03.204019 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88663b494e094bae85e439f557b6f727'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:03.204626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88663b494e094bae85e439f557b6f727'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:03.280284 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1bab-e3a1-4904-9194-aa305a2350f1 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.280577 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1bab-e3a1-4904-9194-aa305a2350f1 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.280858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47e1bab-e3a1-4904-9194-aa305a2350f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.291293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88663b494e094bae85e439f557b6f727'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:03.300260 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88663b494e094bae85e439f557b6f727'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:03.310662 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-a47e1bab-e3a1-4904-9194-aa305a2350f1 None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:03.311905 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a47e1bab-e3a1-4904-9194-aa305a2350f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:03.329417 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1333/2658] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:02 2022] DELETE /identity/v3/users/88663b494e094bae85e439f557b6f727 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:03.386453 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1326/2659] 10.222.0.52 () {58 vars in 967 bytes} [Thu Jun 23 11:18:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:03.406666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:03.408959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:03.493299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b70ad0-1269-4423-9b9d-8312020eddca admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:03.499185 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c8197c-89cb-469c-96f6-cd6680b2ca95 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:03.500061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8197c-89cb-469c-96f6-cd6680b2ca95 service swift] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.500349 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8197c-89cb-469c-96f6-cd6680b2ca95 service swift] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.500633 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c8197c-89cb-469c-96f6-cd6680b2ca95 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.564272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8197c-89cb-469c-96f6-cd6680b2ca95 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:03.566341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c8197c-89cb-469c-96f6-cd6680b2ca95 service swift] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:03.575080 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1334/2660] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:18:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 23 11:18:03.737187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:03.802041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e1bab-e3a1-4904-9194-aa305a2350f1 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:03.803624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a47e1bab-e3a1-4904-9194-aa305a2350f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:03.831144 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47e1bab-e3a1-4904-9194-aa305a2350f1 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:03.890827 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e8e20-3b58-44b8-bfc9-e4a580319325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:03.891600 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e8e20-3b58-44b8-bfc9-e4a580319325 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:03.891910 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e8e20-3b58-44b8-bfc9-e4a580319325 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:03.892183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e8e20-3b58-44b8-bfc9-e4a580319325 admin admin] PATH_INFO: `/v3/projects/5f9c2e1d5d6e43d9b39fe93550b8165a` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:03.893358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e8e20-3b58-44b8-bfc9-e4a580319325 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f9c2e1d5d6e43d9b39fe93550b8165a)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:03.895262 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e8e20-3b58-44b8-bfc9-e4a580319325 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:03.896799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:04.077029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0b4e8e20-3b58-44b8-bfc9-e4a580319325 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f9c2e1d5d6e43d9b39fe93550b8165a', 'request_id': 'req-0b4e8e20-3b58-44b8-bfc9-e4a580319325'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:04.082801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0b4e8e20-3b58-44b8-bfc9-e4a580319325 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f9c2e1d5d6e43d9b39fe93550b8165a', 'request_id': 'req-0b4e8e20-3b58-44b8-bfc9-e4a580319325'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:04.092127 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0b4e8e20-3b58-44b8-bfc9-e4a580319325 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f9c2e1d5d6e43d9b39fe93550b8165a', 'request_id': 'req-0b4e8e20-3b58-44b8-bfc9-e4a580319325'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:04.160730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0b4e8e20-3b58-44b8-bfc9-e4a580319325 admin admin] The token cache is being invalidate because project 5f9c2e1d5d6e43d9b39fe93550b8165a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:04.161016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0b4e8e20-3b58-44b8-bfc9-e4a580319325 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:04.161670 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-0b4e8e20-3b58-44b8-bfc9-e4a580319325 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:04.163356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1327/2661] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:03 2022] DELETE /identity/v3/projects/5f9c2e1d5d6e43d9b39fe93550b8165a => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:04.170932 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaa2e2-5f25-4bf5-8ac8-c039bc3d34a8 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.171458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaa2e2-5f25-4bf5-8ac8-c039bc3d34a8 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.171561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbaa2e2-5f25-4bf5-8ac8-c039bc3d34a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.192302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-ddbaa2e2-5f25-4bf5-8ac8-c039bc3d34a8 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:04.193542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ddbaa2e2-5f25-4bf5-8ac8-c039bc3d34a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:04.269956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1335/2662] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:04.278447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcc8cd-3dc2-47d3-9b16-26b8be7da490 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.278743 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcc8cd-3dc2-47d3-9b16-26b8be7da490 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.279059 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fcc8cd-3dc2-47d3-9b16-26b8be7da490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.297362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-e2fcc8cd-3dc2-47d3-9b16-26b8be7da490 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:04.298575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e2fcc8cd-3dc2-47d3-9b16-26b8be7da490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:04.306640 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1328/2663] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:04.314148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaa2e2-5f25-4bf5-8ac8-c039bc3d34a8 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.324039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbaa2e2-5f25-4bf5-8ac8-c039bc3d34a8 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.329646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd6f368-95a7-49d2-b4c5-6a55678f6a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.330322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6f368-95a7-49d2-b4c5-6a55678f6a76 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.330855 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6f368-95a7-49d2-b4c5-6a55678f6a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.331345 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd6f368-95a7-49d2-b4c5-6a55678f6a76 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.332642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6f368-95a7-49d2-b4c5-6a55678f6a76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:04.333009 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6f368-95a7-49d2-b4c5-6a55678f6a76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.334623 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd6f368-95a7-49d2-b4c5-6a55678f6a76 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.350284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1336/2664] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:04.351469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcc8cd-3dc2-47d3-9b16-26b8be7da490 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.360972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fcc8cd-3dc2-47d3-9b16-26b8be7da490 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.365784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31acf4-3e73-4c1b-b5db-37f1d5f02b0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.366440 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31acf4-3e73-4c1b-b5db-37f1d5f02b0a admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.366724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31acf4-3e73-4c1b-b5db-37f1d5f02b0a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.367004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b31acf4-3e73-4c1b-b5db-37f1d5f02b0a admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.367692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31acf4-3e73-4c1b-b5db-37f1d5f02b0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.369651 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b31acf4-3e73-4c1b-b5db-37f1d5f02b0a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.428956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9161c2-4996-4e33-b85e-d9b23af43003 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.429560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9161c2-4996-4e33-b85e-d9b23af43003 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.429750 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9161c2-4996-4e33-b85e-d9b23af43003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.449093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-3f9161c2-4996-4e33-b85e-d9b23af43003 None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:04.450359 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3f9161c2-4996-4e33-b85e-d9b23af43003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:04.500429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1329/2665] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:04 2022] POST /identity/v3/projects => generated 379 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:04.504751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31acf4-3e73-4c1b-b5db-37f1d5f02b0a admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.510678 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1337/2666] 10.222.0.52 () {58 vars in 1009 bytes} [Thu Jun 23 11:18:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:04.524225 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9161c2-4996-4e33-b85e-d9b23af43003 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.525953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-3f9161c2-4996-4e33-b85e-d9b23af43003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:04.576238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b31acf4-3e73-4c1b-b5db-37f1d5f02b0a admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.581506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ce9df-a8b7-4232-9ddc-63f468028967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.582253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ce9df-a8b7-4232-9ddc-63f468028967 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.582768 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ce9df-a8b7-4232-9ddc-63f468028967 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.583110 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ce9df-a8b7-4232-9ddc-63f468028967 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.584026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ce9df-a8b7-4232-9ddc-63f468028967 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.585964 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5ce9df-a8b7-4232-9ddc-63f468028967 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.600489 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:04.605093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9161c2-4996-4e33-b85e-d9b23af43003 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.665552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3dd6-6875-4bbc-a0a3-7fcefd3205ee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.666259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3dd6-6875-4bbc-a0a3-7fcefd3205ee service swift] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.666540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3dd6-6875-4bbc-a0a3-7fcefd3205ee service swift] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.666892 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb3dd6-6875-4bbc-a0a3-7fcefd3205ee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.716243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1330/2667] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:04 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:04.720469 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ce9df-a8b7-4232-9ddc-63f468028967 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.727885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb3dd6-6875-4bbc-a0a3-7fcefd3205ee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.729507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb3dd6-6875-4bbc-a0a3-7fcefd3205ee service swift] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.730558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5ce9df-a8b7-4232-9ddc-63f468028967 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.735865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfd495-89e5-4ad7-9ae3-a0dbd8704dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.741372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfd495-89e5-4ad7-9ae3-a0dbd8704dac admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.741372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfd495-89e5-4ad7-9ae3-a0dbd8704dac admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.741372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfd495-89e5-4ad7-9ae3-a0dbd8704dac admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.741372 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfd495-89e5-4ad7-9ae3-a0dbd8704dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.742243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1338/2668] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 11:18:04.742549 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dfd495-89e5-4ad7-9ae3-a0dbd8704dac admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.750548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1331/2669] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:18:04.754614 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3dd6-6875-4bbc-a0a3-7fcefd3205ee service swift] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.765459 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb3dd6-6875-4bbc-a0a3-7fcefd3205ee service swift] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.770054 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde0688-c289-4186-8953-e356baece27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.770711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0688-c289-4186-8953-e356baece27b admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.770996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0688-c289-4186-8953-e356baece27b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.771274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde0688-c289-4186-8953-e356baece27b admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.772101 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde0688-c289-4186-8953-e356baece27b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.773707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecde0688-c289-4186-8953-e356baece27b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.783714 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1339/2670] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:04.788108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfd495-89e5-4ad7-9ae3-a0dbd8704dac admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:04.798939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dfd495-89e5-4ad7-9ae3-a0dbd8704dac admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:04.803802 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb2647-3d1d-43e3-aa3c-08767f4ac0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:04.804749 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2647-3d1d-43e3-aa3c-08767f4ac0c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.805040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2647-3d1d-43e3-aa3c-08767f4ac0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.805319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb2647-3d1d-43e3-aa3c-08767f4ac0c4 admin admin] PATH_INFO: `/v3/projects/3e4340b10b0e426e81174fd2c32cf164/users/3844f97b181842d9b98a9e8285116d1c/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.821603 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb2647-3d1d-43e3-aa3c-08767f4ac0c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e4340b10b0e426e81174fd2c32cf164, user_id=3844f97b181842d9b98a9e8285116d1c, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:04.824327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb2647-3d1d-43e3-aa3c-08767f4ac0c4 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:04.954939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1332/2671] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:04 2022] PUT /identity/v3/projects/3e4340b10b0e426e81174fd2c32cf164/users/3844f97b181842d9b98a9e8285116d1c/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:04.965957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58975-ed77-4ebc-ab7b-7bfe7409f7c7 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:04.966251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58975-ed77-4ebc-ab7b-7bfe7409f7c7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:04.967037 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be58975-ed77-4ebc-ab7b-7bfe7409f7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:04.995191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-7be58975-ed77-4ebc-ab7b-7bfe7409f7c7 None None] MFA Rules not processed for user `3844f97b181842d9b98a9e8285116d1c`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:04.996447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7be58975-ed77-4ebc-ab7b-7bfe7409f7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:05.063310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1340/2672] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:05.067899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb2647-3d1d-43e3-aa3c-08767f4ac0c4 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.092409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:05.133803 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb2647-3d1d-43e3-aa3c-08767f4ac0c4 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.138656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3da97d-b1a0-4265-8e23-dacda05ab1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.141101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3da97d-b1a0-4265-8e23-dacda05ab1cc admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.141101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3da97d-b1a0-4265-8e23-dacda05ab1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.141101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3da97d-b1a0-4265-8e23-dacda05ab1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.141101 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3da97d-b1a0-4265-8e23-dacda05ab1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.142506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3da97d-b1a0-4265-8e23-dacda05ab1cc admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.268254 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1333/2673] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:05 2022] POST /identity/v3/projects => generated 377 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:05.271422 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be58975-ed77-4ebc-ab7b-7bfe7409f7c7 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.286125 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be58975-ed77-4ebc-ab7b-7bfe7409f7c7 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.349156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cff90f-bcc7-4835-9434-edfb721b21c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.349830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cff90f-bcc7-4835-9434-edfb721b21c7 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.350114 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cff90f-bcc7-4835-9434-edfb721b21c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.350394 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cff90f-bcc7-4835-9434-edfb721b21c7 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.351087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cff90f-bcc7-4835-9434-edfb721b21c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.353140 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cff90f-bcc7-4835-9434-edfb721b21c7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.371392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:05.466306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23956606-528b-43b1-b72a-0c2931178f81 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.467222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23956606-528b-43b1-b72a-0c2931178f81 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.467581 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23956606-528b-43b1-b72a-0c2931178f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.486046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-23956606-528b-43b1-b72a-0c2931178f81 None None] MFA Rules not processed for user `d2bf9ab55d984c3ea3b99126d063e47a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:05.487297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-23956606-528b-43b1-b72a-0c2931178f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:05.511910 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1341/2674] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:05 2022] POST /identity/v3/users => generated 295 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:05.513024 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cff90f-bcc7-4835-9434-edfb721b21c7 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.523399 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cff90f-bcc7-4835-9434-edfb721b21c7 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.528212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6509-6097-4686-972a-f639d9c23794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.529700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6509-6097-4686-972a-f639d9c23794 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.529846 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6509-6097-4686-972a-f639d9c23794 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.530130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbb6509-6097-4686-972a-f639d9c23794 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.530890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb6509-6097-4686-972a-f639d9c23794 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.532554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbb6509-6097-4686-972a-f639d9c23794 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.546094 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1342/2675] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:05.547193 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6509-6097-4686-972a-f639d9c23794 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.552419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1334/2676] 10.222.0.52 () {58 vars in 967 bytes} [Thu Jun 23 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:05.557631 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbb6509-6097-4686-972a-f639d9c23794 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.561467 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23956606-528b-43b1-b72a-0c2931178f81 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.563290 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1042f-0a6a-4562-ae02-b3ecac7170d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.564372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1042f-0a6a-4562-ae02-b3ecac7170d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.564661 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1042f-0a6a-4562-ae02-b3ecac7170d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.564941 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1042f-0a6a-4562-ae02-b3ecac7170d2 admin admin] PATH_INFO: `/v3/projects/a99084d124d747a7bd46214965ebdb4b/users/3bd71335a14f415185696879d5d3f4bd/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.582061 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1042f-0a6a-4562-ae02-b3ecac7170d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99084d124d747a7bd46214965ebdb4b, user_id=3bd71335a14f415185696879d5d3f4bd, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.584828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e1042f-0a6a-4562-ae02-b3ecac7170d2 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.630014 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23956606-528b-43b1-b72a-0c2931178f81 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.635223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1cc9-b446-4def-ab94-991af474c08f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd54976bc4b541a89a0c15788bfb71ed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.638946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1cc9-b446-4def-ab94-991af474c08f service swift] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.638946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1cc9-b446-4def-ab94-991af474c08f service swift] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.638946 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccb1cc9-b446-4def-ab94-991af474c08f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.645838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb1cc9-b446-4def-ab94-991af474c08f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.647447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccb1cc9-b446-4def-ab94-991af474c08f service swift] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.655629 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1335/2677] 10.222.0.52 () {60 vars in 1384 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 23 11:18:05.697791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1343/2678] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:05 2022] PUT /identity/v3/projects/a99084d124d747a7bd46214965ebdb4b/users/3bd71335a14f415185696879d5d3f4bd/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:05.702602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1cc9-b446-4def-ab94-991af474c08f service swift] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.713421 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccb1cc9-b446-4def-ab94-991af474c08f service swift] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.777411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1a523-5b68-4420-bf3f-799d31a356d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.778203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1a523-5b68-4420-bf3f-799d31a356d1 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.778465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1a523-5b68-4420-bf3f-799d31a356d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.778809 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1a523-5b68-4420-bf3f-799d31a356d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.779524 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1a523-5b68-4420-bf3f-799d31a356d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.781241 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1a523-5b68-4420-bf3f-799d31a356d1 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.791681 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1336/2679] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:05.796015 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1042f-0a6a-4562-ae02-b3ecac7170d2 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.806443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1042f-0a6a-4562-ae02-b3ecac7170d2 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:05.812071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdcbe1-706c-49ca-b967-aca75202e676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:05.812939 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdcbe1-706c-49ca-b967-aca75202e676 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.813215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdcbe1-706c-49ca-b967-aca75202e676 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.813487 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecdcbe1-706c-49ca-b967-aca75202e676 admin admin] PATH_INFO: `/v3/projects/a99084d124d747a7bd46214965ebdb4b/users/3bd71335a14f415185696879d5d3f4bd/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.815452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdcbe1-706c-49ca-b967-aca75202e676 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99084d124d747a7bd46214965ebdb4b, user_id=3bd71335a14f415185696879d5d3f4bd, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:05.818107 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecdcbe1-706c-49ca-b967-aca75202e676 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:05.828926 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1344/2680] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:05 2022] PUT /identity/v3/projects/a99084d124d747a7bd46214965ebdb4b/users/3bd71335a14f415185696879d5d3f4bd/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:05.840240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:05.840408 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7b6e-54a5-4a08-a4b1-cbe666af97ad None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:05.840593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7b6e-54a5-4a08-a4b1-cbe666af97ad None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:05.840876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c7b6e-54a5-4a08-a4b1-cbe666af97ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:05.867315 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-849c7b6e-54a5-4a08-a4b1-cbe666af97ad None None] MFA Rules not processed for user `3bd71335a14f415185696879d5d3f4bd`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:05.868560 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-849c7b6e-54a5-4a08-a4b1-cbe666af97ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:05.938734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1337/2681] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:05 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:05.950644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdcbe1-706c-49ca-b967-aca75202e676 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:05.953138 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-1ecdcbe1-706c-49ca-b967-aca75202e676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:06.011576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecdcbe1-706c-49ca-b967-aca75202e676 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:06.015673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2932117-a5e0-4416-af55-71c70042c9cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:06.016358 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2932117-a5e0-4416-af55-71c70042c9cd service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:06.016649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2932117-a5e0-4416-af55-71c70042c9cd service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:06.016923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2932117-a5e0-4416-af55-71c70042c9cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:06.083057 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2932117-a5e0-4416-af55-71c70042c9cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:06.084555 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2932117-a5e0-4416-af55-71c70042c9cd service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:06.095438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1345/2682] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:06.097948 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:08.079195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c7b6e-54a5-4a08-a4b1-cbe666af97ad None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:08.080692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-849c7b6e-54a5-4a08-a4b1-cbe666af97ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:08.101112 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c7b6e-54a5-4a08-a4b1-cbe666af97ad None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:08.104851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3903b2-cc22-4cb6-8aac-7c8c6ca0bb35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:08.105592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3903b2-cc22-4cb6-8aac-7c8c6ca0bb35 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:08.105882 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3903b2-cc22-4cb6-8aac-7c8c6ca0bb35 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:08.106162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3903b2-cc22-4cb6-8aac-7c8c6ca0bb35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:08.124239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3903b2-cc22-4cb6-8aac-7c8c6ca0bb35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:08.125706 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3903b2-cc22-4cb6-8aac-7c8c6ca0bb35 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:08.135747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1338/2683] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:09.455836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2932117-a5e0-4416-af55-71c70042c9cd service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:09.457523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d2932117-a5e0-4416-af55-71c70042c9cd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:09.490308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:09.543940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2932117-a5e0-4416-af55-71c70042c9cd service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:09.549224 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:09.550149 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.550423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.550704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] PATH_INFO: `/v3/users/28d37a0453fb4a06b9edba995c04f878` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.551942 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d37a0453fb4a06b9edba995c04f878)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:09.553985 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:09.764889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d37a0453fb4a06b9edba995c04f878'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:09.765584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d37a0453fb4a06b9edba995c04f878'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:09.766194 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d37a0453fb4a06b9edba995c04f878'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:09.834233 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d37a0453fb4a06b9edba995c04f878'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:09.842223 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d37a0453fb4a06b9edba995c04f878'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:09.859334 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1346/2684] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:09 2022] DELETE /identity/v3/users/28d37a0453fb4a06b9edba995c04f878 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:09.864016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578ce24-6a1d-4e16-9aaf-e24d1f0af6a6 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:09.864562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578ce24-6a1d-4e16-9aaf-e24d1f0af6a6 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:09.864562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578ce24-6a1d-4e16-9aaf-e24d1f0af6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:09.882511 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-d578ce24-6a1d-4e16-9aaf-e24d1f0af6a6 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:09.883839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d578ce24-6a1d-4e16-9aaf-e24d1f0af6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:09.944848 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1339/2685] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:09.956115 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:09.957551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:10.016499 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3188fe-a520-4918-9e24-0ec972265c68 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.020105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580d29d-8da2-4e86-9cce-e3a7c7d1411e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.020815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580d29d-8da2-4e86-9cce-e3a7c7d1411e service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.021075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580d29d-8da2-4e86-9cce-e3a7c7d1411e service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.021363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580d29d-8da2-4e86-9cce-e3a7c7d1411e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.032105 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580d29d-8da2-4e86-9cce-e3a7c7d1411e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:10.037680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580d29d-8da2-4e86-9cce-e3a7c7d1411e service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:10.044937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1347/2686] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:10.321269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578ce24-6a1d-4e16-9aaf-e24d1f0af6a6 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.325235 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d578ce24-6a1d-4e16-9aaf-e24d1f0af6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:10.337487 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578ce24-6a1d-4e16-9aaf-e24d1f0af6a6 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.349030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbc5118-a04a-4291-8b6b-221ce06256c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.349030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc5118-a04a-4291-8b6b-221ce06256c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.349030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc5118-a04a-4291-8b6b-221ce06256c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.349030 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbc5118-a04a-4291-8b6b-221ce06256c7 admin admin] PATH_INFO: `/v3/projects/6c83508b7cb444e481db967f6f7261da` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.349473 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc5118-a04a-4291-8b6b-221ce06256c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c83508b7cb444e481db967f6f7261da)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:10.358483 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbc5118-a04a-4291-8b6b-221ce06256c7 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:10.499349 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:10.506354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-fbbc5118-a04a-4291-8b6b-221ce06256c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c83508b7cb444e481db967f6f7261da', 'request_id': 'req-fbbc5118-a04a-4291-8b6b-221ce06256c7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:10.511760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-fbbc5118-a04a-4291-8b6b-221ce06256c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c83508b7cb444e481db967f6f7261da', 'request_id': 'req-fbbc5118-a04a-4291-8b6b-221ce06256c7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:10.517847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-fbbc5118-a04a-4291-8b6b-221ce06256c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c83508b7cb444e481db967f6f7261da', 'request_id': 'req-fbbc5118-a04a-4291-8b6b-221ce06256c7'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:10.675366 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-fbbc5118-a04a-4291-8b6b-221ce06256c7 admin admin] The token cache is being invalidate because project 6c83508b7cb444e481db967f6f7261da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:10.675661 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-fbbc5118-a04a-4291-8b6b-221ce06256c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:10.676334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-fbbc5118-a04a-4291-8b6b-221ce06256c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:10.677893 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1340/2687] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:10 2022] DELETE /identity/v3/projects/6c83508b7cb444e481db967f6f7261da => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:10.683273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a20d0a-83cb-459d-9fa7-76c5ac2ba2bd None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.683771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a20d0a-83cb-459d-9fa7-76c5ac2ba2bd None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.684190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a20d0a-83cb-459d-9fa7-76c5ac2ba2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.703675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-72a20d0a-83cb-459d-9fa7-76c5ac2ba2bd None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:10.704925 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-72a20d0a-83cb-459d-9fa7-76c5ac2ba2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:10.750146 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:10.768763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1348/2688] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:10.777327 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a76c63-a055-4085-bf1f-164aa2452654 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.777628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a76c63-a055-4085-bf1f-164aa2452654 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.777898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a76c63-a055-4085-bf1f-164aa2452654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.796722 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-05a76c63-a055-4085-bf1f-164aa2452654 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:10.797966 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-05a76c63-a055-4085-bf1f-164aa2452654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:10.806170 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1341/2689] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:10.811562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a20d0a-83cb-459d-9fa7-76c5ac2ba2bd None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.821700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a20d0a-83cb-459d-9fa7-76c5ac2ba2bd None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.826388 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd388dbc-e425-4d83-9744-f9e4e52a91af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.827132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd388dbc-e425-4d83-9744-f9e4e52a91af admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.827467 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd388dbc-e425-4d83-9744-f9e4e52a91af admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.827693 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd388dbc-e425-4d83-9744-f9e4e52a91af admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.828475 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd388dbc-e425-4d83-9744-f9e4e52a91af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:10.832474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd388dbc-e425-4d83-9744-f9e4e52a91af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:10.832474 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd388dbc-e425-4d83-9744-f9e4e52a91af admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:10.844297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1349/2690] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:10.848646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a76c63-a055-4085-bf1f-164aa2452654 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.858527 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a76c63-a055-4085-bf1f-164aa2452654 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:10.863269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f001cf-b8ed-40a9-bba0-e41d6ca1cbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:10.863901 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f001cf-b8ed-40a9-bba0-e41d6ca1cbc3 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:10.864183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f001cf-b8ed-40a9-bba0-e41d6ca1cbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:10.864796 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f001cf-b8ed-40a9-bba0-e41d6ca1cbc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:10.865140 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f001cf-b8ed-40a9-bba0-e41d6ca1cbc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:10.867080 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f001cf-b8ed-40a9-bba0-e41d6ca1cbc3 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:10.961509 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1342/2691] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:10 2022] POST /identity/v3/projects => generated 391 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:10.965828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd388dbc-e425-4d83-9744-f9e4e52a91af admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:10.976973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd388dbc-e425-4d83-9744-f9e4e52a91af admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.038876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f5a7b-62b2-4fb4-9b2e-cbef1d3622a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.039236 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f5a7b-62b2-4fb4-9b2e-cbef1d3622a9 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.039898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f5a7b-62b2-4fb4-9b2e-cbef1d3622a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.040191 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221f5a7b-62b2-4fb4-9b2e-cbef1d3622a9 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.040902 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f5a7b-62b2-4fb4-9b2e-cbef1d3622a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.042835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221f5a7b-62b2-4fb4-9b2e-cbef1d3622a9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.178457 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1350/2692] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:10 2022] POST /identity/v3/users => generated 296 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:11.182620 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f001cf-b8ed-40a9-bba0-e41d6ca1cbc3 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:11.193032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f001cf-b8ed-40a9-bba0-e41d6ca1cbc3 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.197754 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d1da8-36b9-46aa-9a10-b844e074b9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.198465 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d1da8-36b9-46aa-9a10-b844e074b9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.198762 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d1da8-36b9-46aa-9a10-b844e074b9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.199029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d1da8-36b9-46aa-9a10-b844e074b9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.199799 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d1da8-36b9-46aa-9a10-b844e074b9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.202884 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d1da8-36b9-46aa-9a10-b844e074b9c3 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.213190 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1343/2693] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:18:11.218014 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f5a7b-62b2-4fb4-9b2e-cbef1d3622a9 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:11.229212 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221f5a7b-62b2-4fb4-9b2e-cbef1d3622a9 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.234043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766bc1c-4252-4f20-bcac-748253f4461c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.234781 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766bc1c-4252-4f20-bcac-748253f4461c admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.235157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766bc1c-4252-4f20-bcac-748253f4461c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.235509 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b766bc1c-4252-4f20-bcac-748253f4461c admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.236352 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766bc1c-4252-4f20-bcac-748253f4461c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.238010 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b766bc1c-4252-4f20-bcac-748253f4461c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.248583 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1351/2694] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:11.305691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d1da8-36b9-46aa-9a10-b844e074b9c3 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:11.316375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d1da8-36b9-46aa-9a10-b844e074b9c3 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.320949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0037edac-22d6-4e9c-8ebc-4c99347938ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.321818 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037edac-22d6-4e9c-8ebc-4c99347938ad admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.322103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037edac-22d6-4e9c-8ebc-4c99347938ad admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.322404 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0037edac-22d6-4e9c-8ebc-4c99347938ad admin admin] PATH_INFO: `/v3/projects/7e1b975328e84d31956aa673bc391f4c/users/616ca2f256ff4f108aac1ed708bc323a/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.337987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037edac-22d6-4e9c-8ebc-4c99347938ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e1b975328e84d31956aa673bc391f4c, user_id=616ca2f256ff4f108aac1ed708bc323a, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.340673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0037edac-22d6-4e9c-8ebc-4c99347938ad admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.428186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766bc1c-4252-4f20-bcac-748253f4461c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:11.429930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b766bc1c-4252-4f20-bcac-748253f4461c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:11.440637 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1344/2695] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:11 2022] PUT /identity/v3/projects/7e1b975328e84d31956aa673bc391f4c/users/616ca2f256ff4f108aac1ed708bc323a/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:11.448096 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b766bc1c-4252-4f20-bcac-748253f4461c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.450655 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ed83b-74a7-44d8-8589-20f6771c66f8 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.450973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ed83b-74a7-44d8-8589-20f6771c66f8 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.451261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0ed83b-74a7-44d8-8589-20f6771c66f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.485740 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-fd0ed83b-74a7-44d8-8589-20f6771c66f8 None None] MFA Rules not processed for user `616ca2f256ff4f108aac1ed708bc323a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:11.487187 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-fd0ed83b-74a7-44d8-8589-20f6771c66f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:11.516964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.517867 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.518136 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.518409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] PATH_INFO: `/v3/users/8b0347d61d5d45428a52206055405e33` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.519617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b0347d61d5d45428a52206055405e33)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.521640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.570959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1345/2696] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:11.583401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ed83b-74a7-44d8-8589-20f6771c66f8 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:11.584862 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-fd0ed83b-74a7-44d8-8589-20f6771c66f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:11.642628 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0ed83b-74a7-44d8-8589-20f6771c66f8 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.646371 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec0589-0701-4af0-bd8b-44eeaa940c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.647015 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0589-0701-4af0-bd8b-44eeaa940c3b service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.647297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0589-0701-4af0-bd8b-44eeaa940c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.647576 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec0589-0701-4af0-bd8b-44eeaa940c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.653990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:11.656339 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec0589-0701-4af0-bd8b-44eeaa940c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.657863 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec0589-0701-4af0-bd8b-44eeaa940c3b service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.666597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1346/2697] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:11.689028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b0347d61d5d45428a52206055405e33'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:11.689764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b0347d61d5d45428a52206055405e33'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:11.690403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b0347d61d5d45428a52206055405e33'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:11.696372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:11.742603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b0347d61d5d45428a52206055405e33'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:11.753995 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b0347d61d5d45428a52206055405e33'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:11.784944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1352/2698] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:11 2022] DELETE /identity/v3/users/8b0347d61d5d45428a52206055405e33 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:11.788836 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fdd4b-ecc5-46a9-a19f-d3ee3605fe54 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.789124 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fdd4b-ecc5-46a9-a19f-d3ee3605fe54 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.789406 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010fdd4b-ecc5-46a9-a19f-d3ee3605fe54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.808275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-010fdd4b-ecc5-46a9-a19f-d3ee3605fe54 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:11.809865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-010fdd4b-ecc5-46a9-a19f-d3ee3605fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:11.838453 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:11.840117 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:11.878779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1347/2699] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:11.891369 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fdd4b-ecc5-46a9-a19f-d3ee3605fe54 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:11.893415 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-010fdd4b-ecc5-46a9-a19f-d3ee3605fe54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:11.910865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84c9f8-4bf5-49b1-b650-8fac8b548093 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.915785 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.916686 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.916976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.917257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] PATH_INFO: `/v3/users/9bcfc5f20c05432ca955aff73568c374` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.918534 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bcfc5f20c05432ca955aff73568c374)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.920556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.952222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010fdd4b-ecc5-46a9-a19f-d3ee3605fe54 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:11.956010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34416997-6bcd-4955-b41e-d8fa77842d87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:11.956652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34416997-6bcd-4955-b41e-d8fa77842d87 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:11.956941 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34416997-6bcd-4955-b41e-d8fa77842d87 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:11.957213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34416997-6bcd-4955-b41e-d8fa77842d87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:11.966804 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34416997-6bcd-4955-b41e-d8fa77842d87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:11.968413 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34416997-6bcd-4955-b41e-d8fa77842d87 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:11.978668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1348/2700] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:12.107081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bcfc5f20c05432ca955aff73568c374'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.108299 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bcfc5f20c05432ca955aff73568c374'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.108954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bcfc5f20c05432ca955aff73568c374'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.205462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bcfc5f20c05432ca955aff73568c374'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.214451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bcfc5f20c05432ca955aff73568c374'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.234596 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1353/2701] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:11 2022] DELETE /identity/v3/users/9bcfc5f20c05432ca955aff73568c374 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:12.240172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e9a11-969b-49dc-af9e-b3969f3efd13 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.240172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e9a11-969b-49dc-af9e-b3969f3efd13 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.240172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82e9a11-969b-49dc-af9e-b3969f3efd13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.259686 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-e82e9a11-969b-49dc-af9e-b3969f3efd13 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:12.261078 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e82e9a11-969b-49dc-af9e-b3969f3efd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:12.342464 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1349/2702] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:12.352529 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:12.354214 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:12.418438 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:12.423239 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace3094d-8fa5-470e-b435-be78dc528dff admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:12.426991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45208e8-8273-4cf9-992f-f36419de6a31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:12.427650 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45208e8-8273-4cf9-992f-f36419de6a31 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.427992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45208e8-8273-4cf9-992f-f36419de6a31 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.428272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45208e8-8273-4cf9-992f-f36419de6a31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.438556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45208e8-8273-4cf9-992f-f36419de6a31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:12.440100 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45208e8-8273-4cf9-992f-f36419de6a31 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:12.450409 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1354/2703] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:12.472111 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e9a11-969b-49dc-af9e-b3969f3efd13 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:12.473554 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e82e9a11-969b-49dc-af9e-b3969f3efd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:12.488195 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82e9a11-969b-49dc-af9e-b3969f3efd13 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:12.494405 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:12.495429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.496314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.496314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2 admin admin] PATH_INFO: `/v3/projects/2d38084f71dd419a81ff8db30f12db2c` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.497536 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d38084f71dd419a81ff8db30f12db2c)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:12.500024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:12.586516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45208e8-8273-4cf9-992f-f36419de6a31 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:12.587975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a45208e8-8273-4cf9-992f-f36419de6a31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:12.596509 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:12.601628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45208e8-8273-4cf9-992f-f36419de6a31 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:12.605899 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d38084f71dd419a81ff8db30f12db2c', 'request_id': 'req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.612253 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d38084f71dd419a81ff8db30f12db2c', 'request_id': 'req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.618501 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d38084f71dd419a81ff8db30f12db2c', 'request_id': 'req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.660783 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:12.661719 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.662007 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.662285 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] PATH_INFO: `/v3/users/3844f97b181842d9b98a9e8285116d1c` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.663515 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3844f97b181842d9b98a9e8285116d1c)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:12.665513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:12.721087 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2 admin admin] The token cache is being invalidate because project 2d38084f71dd419a81ff8db30f12db2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:12.721381 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.722050 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-caad5ef9-9326-4217-a1f6-d2c164e2b1a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.723653 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1350/2704] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:12 2022] DELETE /identity/v3/projects/2d38084f71dd419a81ff8db30f12db2c => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:12.728522 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5d607-f993-4997-9598-2a34b3df5d66 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.728889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5d607-f993-4997-9598-2a34b3df5d66 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.729311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a5d607-f993-4997-9598-2a34b3df5d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.748484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-98a5d607-f993-4997-9598-2a34b3df5d66 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:12.749710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-98a5d607-f993-4997-9598-2a34b3df5d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:12.758733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1351/2705] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:12.767132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863d85-5f22-4ebe-b159-42f3b41d89bd None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.769765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863d85-5f22-4ebe-b159-42f3b41d89bd None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.769765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49863d85-5f22-4ebe-b159-42f3b41d89bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.786678 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-49863d85-5f22-4ebe-b159-42f3b41d89bd None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:12.788890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-49863d85-5f22-4ebe-b159-42f3b41d89bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:12.798308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1352/2706] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:12.802639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863d85-5f22-4ebe-b159-42f3b41d89bd None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:12.812094 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49863d85-5f22-4ebe-b159-42f3b41d89bd None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:12.817020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589e678-0206-48de-a620-4906811b75d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:12.817668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589e678-0206-48de-a620-4906811b75d1 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.817952 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589e678-0206-48de-a620-4906811b75d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.818230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589e678-0206-48de-a620-4906811b75d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.818944 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589e678-0206-48de-a620-4906811b75d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:12.819331 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589e678-0206-48de-a620-4906811b75d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:12.821132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589e678-0206-48de-a620-4906811b75d1 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:12.833625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1353/2707] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:18:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:12.837956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589e678-0206-48de-a620-4906811b75d1 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:12.848689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589e678-0206-48de-a620-4906811b75d1 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:12.853304 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4d529-489a-4dc7-b1e2-b6fa095c5dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:12.854873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4d529-489a-4dc7-b1e2-b6fa095c5dad admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:12.854873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4d529-489a-4dc7-b1e2-b6fa095c5dad admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:12.854873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a4d529-489a-4dc7-b1e2-b6fa095c5dad admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:12.855194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4d529-489a-4dc7-b1e2-b6fa095c5dad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:12.857130 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a4d529-489a-4dc7-b1e2-b6fa095c5dad admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:12.861038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3844f97b181842d9b98a9e8285116d1c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.861647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3844f97b181842d9b98a9e8285116d1c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.862278 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3844f97b181842d9b98a9e8285116d1c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.969540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3844f97b181842d9b98a9e8285116d1c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.974833 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3844f97b181842d9b98a9e8285116d1c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:12.981771 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1354/2708] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:12 2022] POST /identity/v3/projects => generated 381 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:12.983175 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4d529-489a-4dc7-b1e2-b6fa095c5dad admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:12.984683 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-c5a4d529-489a-4dc7-b1e2-b6fa095c5dad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:13.000638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1355/2709] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:12 2022] DELETE /identity/v3/users/3844f97b181842d9b98a9e8285116d1c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:13.000638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.001987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:13.051135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a4d529-489a-4dc7-b1e2-b6fa095c5dad admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.068163 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2864c19-9962-49c0-93db-295f50a4ea5f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.073167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2861c2-6e1f-4eb0-8d31-2ec5de6f43b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.073881 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2861c2-6e1f-4eb0-8d31-2ec5de6f43b5 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.074171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2861c2-6e1f-4eb0-8d31-2ec5de6f43b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.074510 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2861c2-6e1f-4eb0-8d31-2ec5de6f43b5 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.075200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2861c2-6e1f-4eb0-8d31-2ec5de6f43b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.077440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2861c2-6e1f-4eb0-8d31-2ec5de6f43b5 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.109240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.110103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.110388 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.110671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] PATH_INFO: `/v3/projects/e0d9edd2488341808be621e32940649f` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.111902 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d9edd2488341808be621e32940649f)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.113866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.138986 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:13.195481 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:13.201494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1356/2710] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:12 2022] POST /identity/v3/users => generated 291 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:13.202823 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e9301-c1d7-4239-acd8-0a028bf70a02 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.203113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e9301-c1d7-4239-acd8-0a028bf70a02 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.203395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e9301-c1d7-4239-acd8-0a028bf70a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.212588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d9edd2488341808be621e32940649f', 'request_id': 'req-2b307d24-8d28-43cd-bc37-ab59f31c457e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:13.218667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d9edd2488341808be621e32940649f', 'request_id': 'req-2b307d24-8d28-43cd-bc37-ab59f31c457e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:13.221138 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-389e9301-c1d7-4239-acd8-0a028bf70a02 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:13.222328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-389e9301-c1d7-4239-acd8-0a028bf70a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:13.225118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d9edd2488341808be621e32940649f', 'request_id': 'req-2b307d24-8d28-43cd-bc37-ab59f31c457e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:13.280444 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1357/2711] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:13.281282 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e9301-c1d7-4239-acd8-0a028bf70a02 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.290328 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e9301-c1d7-4239-acd8-0a028bf70a02 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.294931 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b42e36-7964-449b-97aa-7667b03a40cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.296195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b42e36-7964-449b-97aa-7667b03a40cc admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.296476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b42e36-7964-449b-97aa-7667b03a40cc admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.296747 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b42e36-7964-449b-97aa-7667b03a40cc admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.297462 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b42e36-7964-449b-97aa-7667b03a40cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.299048 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b42e36-7964-449b-97aa-7667b03a40cc admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.313491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1358/2712] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:13.313491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b42e36-7964-449b-97aa-7667b03a40cc admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.313491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-44b42e36-7964-449b-97aa-7667b03a40cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:13.314736 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] The token cache is being invalidate because project e0d9edd2488341808be621e32940649f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:13.315031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:13.315684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:13.317330 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1355/2713] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:12 2022] DELETE /identity/v3/projects/e0d9edd2488341808be621e32940649f => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:13.318258 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.319569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:13.332446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b307d24-8d28-43cd-bc37-ab59f31c457e admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.337438 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a597ad-21ea-43ea-8b69-421ad036e584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.338099 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a597ad-21ea-43ea-8b69-421ad036e584 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.338384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a597ad-21ea-43ea-8b69-421ad036e584 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.338695 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a597ad-21ea-43ea-8b69-421ad036e584 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.339426 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a597ad-21ea-43ea-8b69-421ad036e584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.341084 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a597ad-21ea-43ea-8b69-421ad036e584 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.351649 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1356/2714] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:13.354322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e346124-63d8-4286-b15f-38bbdb7cf955 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.354322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e346124-63d8-4286-b15f-38bbdb7cf955 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.354322 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e346124-63d8-4286-b15f-38bbdb7cf955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.372081 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-2e346124-63d8-4286-b15f-38bbdb7cf955 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:13.373314 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2e346124-63d8-4286-b15f-38bbdb7cf955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:13.374707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b42e36-7964-449b-97aa-7667b03a40cc admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.378432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df501a3-e4fd-4e07-ae0a-15846c9ad0ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.381171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df501a3-e4fd-4e07-ae0a-15846c9ad0ce service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.381171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df501a3-e4fd-4e07-ae0a-15846c9ad0ce service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.381171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df501a3-e4fd-4e07-ae0a-15846c9ad0ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.381549 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5df501a3-e4fd-4e07-ae0a-15846c9ad0ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:13.382015 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1357/2715] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:13.382794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e346124-63d8-4286-b15f-38bbdb7cf955 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.394476 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e346124-63d8-4286-b15f-38bbdb7cf955 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.395317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df501a3-e4fd-4e07-ae0a-15846c9ad0ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.396815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df501a3-e4fd-4e07-ae0a-15846c9ad0ce service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.399715 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc717b-b37f-4f5f-9ab8-2ebc66a28f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.400723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc717b-b37f-4f5f-9ab8-2ebc66a28f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.401011 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc717b-b37f-4f5f-9ab8-2ebc66a28f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.401288 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc717b-b37f-4f5f-9ab8-2ebc66a28f9a admin admin] PATH_INFO: `/v3/projects/957b46e3dc2947b2aefd267a5699004f/users/928cb3130594455b9e796fd322eb16ca/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.408175 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1359/2716] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:13.409782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7715b6-9084-46bb-b9a0-bd5053f088e7 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.410227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7715b6-9084-46bb-b9a0-bd5053f088e7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.410675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7715b6-9084-46bb-b9a0-bd5053f088e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.419548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc717b-b37f-4f5f-9ab8-2ebc66a28f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=957b46e3dc2947b2aefd267a5699004f, user_id=928cb3130594455b9e796fd322eb16ca, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.423255 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc717b-b37f-4f5f-9ab8-2ebc66a28f9a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.432243 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-dd7715b6-9084-46bb-b9a0-bd5053f088e7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:13.434362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-dd7715b6-9084-46bb-b9a0-bd5053f088e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:13.443787 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1360/2717] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:13.448213 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7715b6-9084-46bb-b9a0-bd5053f088e7 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.458387 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7715b6-9084-46bb-b9a0-bd5053f088e7 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.465389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b92fb6-474f-4731-8552-d06e64ef5729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.466346 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b92fb6-474f-4731-8552-d06e64ef5729 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.466346 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b92fb6-474f-4731-8552-d06e64ef5729 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.466680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b92fb6-474f-4731-8552-d06e64ef5729 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.467992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b92fb6-474f-4731-8552-d06e64ef5729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:13.473083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b92fb6-474f-4731-8552-d06e64ef5729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.473083 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b92fb6-474f-4731-8552-d06e64ef5729 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.482701 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1361/2718] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:18:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:13.487421 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b92fb6-474f-4731-8552-d06e64ef5729 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.502298 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1358/2719] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:13 2022] PUT /identity/v3/projects/957b46e3dc2947b2aefd267a5699004f/users/928cb3130594455b9e796fd322eb16ca/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:13.513095 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895014-228d-4b68-82d2-bf57a5d684ae None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.514252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895014-228d-4b68-82d2-bf57a5d684ae None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.514755 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa895014-228d-4b68-82d2-bf57a5d684ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.515342 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b92fb6-474f-4731-8552-d06e64ef5729 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.546647 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-aa895014-228d-4b68-82d2-bf57a5d684ae None None] MFA Rules not processed for user `928cb3130594455b9e796fd322eb16ca`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:13.548073 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-aa895014-228d-4b68-82d2-bf57a5d684ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:13.574906 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88252d-687d-4aee-a8b9-b2e1b28351b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.575891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88252d-687d-4aee-a8b9-b2e1b28351b8 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.576804 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88252d-687d-4aee-a8b9-b2e1b28351b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.582292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed88252d-687d-4aee-a8b9-b2e1b28351b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.582292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88252d-687d-4aee-a8b9-b2e1b28351b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.582292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed88252d-687d-4aee-a8b9-b2e1b28351b8 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.626240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1359/2720] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:13.630956 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa895014-228d-4b68-82d2-bf57a5d684ae None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.642089 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa895014-228d-4b68-82d2-bf57a5d684ae None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.650569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c607f-2383-4413-8e19-79f6b8a936ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.650569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c607f-2383-4413-8e19-79f6b8a936ac admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.650569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c607f-2383-4413-8e19-79f6b8a936ac admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.650569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c607f-2383-4413-8e19-79f6b8a936ac admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.650989 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c607f-2383-4413-8e19-79f6b8a936ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.650989 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c607f-2383-4413-8e19-79f6b8a936ac admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.702149 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1362/2721] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:13 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:13.704066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88252d-687d-4aee-a8b9-b2e1b28351b8 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.772971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1360/2722] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:13 2022] POST /identity/v3/projects => generated 381 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:13.775055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c607f-2383-4413-8e19-79f6b8a936ac admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.778273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed88252d-687d-4aee-a8b9-b2e1b28351b8 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.822843 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:13.840254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81d9c2-7ce5-4cff-92d3-7b4c0ff8e3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.841072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81d9c2-7ce5-4cff-92d3-7b4c0ff8e3e3 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.841363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81d9c2-7ce5-4cff-92d3-7b4c0ff8e3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.841648 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81d9c2-7ce5-4cff-92d3-7b4c0ff8e3e3 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.842376 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81d9c2-7ce5-4cff-92d3-7b4c0ff8e3e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.844316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c607f-2383-4413-8e19-79f6b8a936ac admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:13.844489 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81d9c2-7ce5-4cff-92d3-7b4c0ff8e3e3 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.849767 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9b09c-b632-41bc-8b44-db9d6c286dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:13.853115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9b09c-b632-41bc-8b44-db9d6c286dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:13.853115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9b09c-b632-41bc-8b44-db9d6c286dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:13.853115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9b09c-b632-41bc-8b44-db9d6c286dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:13.853115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9b09c-b632-41bc-8b44-db9d6c286dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:13.856172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b9b09c-b632-41bc-8b44-db9d6c286dc0 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:13.988722 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1363/2723] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:13 2022] POST /identity/v3/users => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:13.989372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81d9c2-7ce5-4cff-92d3-7b4c0ff8e3e3 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:13.991273 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7d81d9c2-7ce5-4cff-92d3-7b4c0ff8e3e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:14.003681 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81d9c2-7ce5-4cff-92d3-7b4c0ff8e3e3 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.008622 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.009500 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.009791 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.011286 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] PATH_INFO: `/v3/projects/3e4340b10b0e426e81174fd2c32cf164` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.013446 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e4340b10b0e426e81174fd2c32cf164)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.016487 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.018519 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1361/2724] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:13 2022] POST /identity/v3/users => generated 297 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:14.019385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9b09c-b632-41bc-8b44-db9d6c286dc0 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.021994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:14.029365 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9b09c-b632-41bc-8b44-db9d6c286dc0 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.034103 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f889c8f-709a-4588-8170-b0c5e085319b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.034751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f889c8f-709a-4588-8170-b0c5e085319b admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.035031 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f889c8f-709a-4588-8170-b0c5e085319b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.035308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f889c8f-709a-4588-8170-b0c5e085319b admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.036060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f889c8f-709a-4588-8170-b0c5e085319b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.037680 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f889c8f-709a-4588-8170-b0c5e085319b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.048816 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1362/2725] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:14.049750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f889c8f-709a-4588-8170-b0c5e085319b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.059826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f889c8f-709a-4588-8170-b0c5e085319b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.065246 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d711dda-e97f-4202-9537-7e30878e7130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.065892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d711dda-e97f-4202-9537-7e30878e7130 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.066172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d711dda-e97f-4202-9537-7e30878e7130 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.066443 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d711dda-e97f-4202-9537-7e30878e7130 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.067141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d711dda-e97f-4202-9537-7e30878e7130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.068742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d711dda-e97f-4202-9537-7e30878e7130 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.078972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1363/2726] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:14.079745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d711dda-e97f-4202-9537-7e30878e7130 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.088972 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d711dda-e97f-4202-9537-7e30878e7130 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.094632 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38befa22-6631-4f8d-a7cd-2776dd2d6e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.095249 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38befa22-6631-4f8d-a7cd-2776dd2d6e56 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.095545 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38befa22-6631-4f8d-a7cd-2776dd2d6e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.095951 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38befa22-6631-4f8d-a7cd-2776dd2d6e56 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.104471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38befa22-6631-4f8d-a7cd-2776dd2d6e56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.104471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38befa22-6631-4f8d-a7cd-2776dd2d6e56 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.108657 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1364/2727] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:14.109664 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38befa22-6631-4f8d-a7cd-2776dd2d6e56 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.120242 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38befa22-6631-4f8d-a7cd-2776dd2d6e56 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.125001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435f39-2c5c-41b3-948f-32d02e4a99fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.125877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435f39-2c5c-41b3-948f-32d02e4a99fd admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.126157 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435f39-2c5c-41b3-948f-32d02e4a99fd admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.126436 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5435f39-2c5c-41b3-948f-32d02e4a99fd admin admin] PATH_INFO: `/v3/projects/00739cd87d754237b5ded3ed848d10da/users/914c3f5c22bd4da4916bead50f5068db/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.143006 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e4340b10b0e426e81174fd2c32cf164', 'request_id': 'req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:14.144937 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5435f39-2c5c-41b3-948f-32d02e4a99fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=00739cd87d754237b5ded3ed848d10da, user_id=914c3f5c22bd4da4916bead50f5068db, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.147619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5435f39-2c5c-41b3-948f-32d02e4a99fd admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.151498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e4340b10b0e426e81174fd2c32cf164', 'request_id': 'req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:14.173582 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e4340b10b0e426e81174fd2c32cf164', 'request_id': 'req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:14.287132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1365/2728] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:14 2022] PUT /identity/v3/projects/00739cd87d754237b5ded3ed848d10da/users/914c3f5c22bd4da4916bead50f5068db/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:14.287903 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435f39-2c5c-41b3-948f-32d02e4a99fd admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.319969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] The token cache is being invalidate because project 3e4340b10b0e426e81174fd2c32cf164 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:14.320250 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:14.327087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:14.327087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1364/2729] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:13 2022] DELETE /identity/v3/projects/3e4340b10b0e426e81174fd2c32cf164 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:14.327087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.327087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:14.352495 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5435f39-2c5c-41b3-948f-32d02e4a99fd admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.357290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bd244-5807-479c-bf4b-9185d569c7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.358309 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bd244-5807-479c-bf4b-9185d569c7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.358528 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bd244-5807-479c-bf4b-9185d569c7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.358794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bd244-5807-479c-bf4b-9185d569c7ca admin admin] PATH_INFO: `/v3/projects/0f562eb955eb402ca23a00224f454905/users/2ec09c68457a4c858bb3365b05d3498e/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.373612 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bd244-5807-479c-bf4b-9185d569c7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f562eb955eb402ca23a00224f454905, user_id=2ec09c68457a4c858bb3365b05d3498e, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.376531 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58bd244-5807-479c-bf4b-9185d569c7ca admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.390507 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf70e9-b2d2-41e0-b9ab-7f5ea3e1b420 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.395594 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63c278-0590-4558-8790-063df7e24032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.396311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63c278-0590-4558-8790-063df7e24032 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.396600 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63c278-0590-4558-8790-063df7e24032 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.396884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a63c278-0590-4558-8790-063df7e24032 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.397612 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63c278-0590-4558-8790-063df7e24032 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.399297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a63c278-0590-4558-8790-063df7e24032 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.410187 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1365/2730] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:14 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:14.411104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63c278-0590-4558-8790-063df7e24032 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.412826 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0a63c278-0590-4558-8790-063df7e24032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:14.425443 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a63c278-0590-4558-8790-063df7e24032 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.430523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79592278-f729-408b-9d94-133312709e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.431649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79592278-f729-408b-9d94-133312709e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.431971 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79592278-f729-408b-9d94-133312709e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.432244 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79592278-f729-408b-9d94-133312709e08 admin admin] PATH_INFO: `/v3/users/3bd71335a14f415185696879d5d3f4bd` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.433577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79592278-f729-408b-9d94-133312709e08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bd71335a14f415185696879d5d3f4bd)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.436075 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79592278-f729-408b-9d94-133312709e08 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.463385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1366/2731] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:14 2022] PUT /identity/v3/projects/0f562eb955eb402ca23a00224f454905/users/2ec09c68457a4c858bb3365b05d3498e/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:14.464230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bd244-5807-479c-bf4b-9185d569c7ca admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.524604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bd244-5807-479c-bf4b-9185d569c7ca admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.530047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f51916-a7c7-491f-9dd7-45d0576b4d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.530324 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:14.530987 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f51916-a7c7-491f-9dd7-45d0576b4d17 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.531214 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f51916-a7c7-491f-9dd7-45d0576b4d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.531490 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f51916-a7c7-491f-9dd7-45d0576b4d17 admin admin] PATH_INFO: `/v3/projects/00739cd87d754237b5ded3ed848d10da/users/914c3f5c22bd4da4916bead50f5068db/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.533535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f51916-a7c7-491f-9dd7-45d0576b4d17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00739cd87d754237b5ded3ed848d10da, user_id=914c3f5c22bd4da4916bead50f5068db, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.536239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f51916-a7c7-491f-9dd7-45d0576b4d17 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.546592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1367/2732] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:14 2022] PUT /identity/v3/projects/00739cd87d754237b5ded3ed848d10da/users/914c3f5c22bd4da4916bead50f5068db/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:14.547746 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45cf05-5f7c-4c69-affa-7a14bdb03aab None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.548063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45cf05-5f7c-4c69-affa-7a14bdb03aab None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.548341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d45cf05-5f7c-4c69-affa-7a14bdb03aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.574092 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:14.579274 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4d45cf05-5f7c-4c69-affa-7a14bdb03aab None None] MFA Rules not processed for user `2ec09c68457a4c858bb3365b05d3498e`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:14.580826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4d45cf05-5f7c-4c69-affa-7a14bdb03aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:14.594281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-79592278-f729-408b-9d94-133312709e08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bd71335a14f415185696879d5d3f4bd'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:14.595072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-79592278-f729-408b-9d94-133312709e08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bd71335a14f415185696879d5d3f4bd'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:14.596037 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-79592278-f729-408b-9d94-133312709e08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bd71335a14f415185696879d5d3f4bd'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:14.653646 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1368/2733] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:14.654921 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d455090-9670-4059-b45c-7cc425dba067 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.655205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d455090-9670-4059-b45c-7cc425dba067 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.655476 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d455090-9670-4059-b45c-7cc425dba067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.680983 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-0d455090-9670-4059-b45c-7cc425dba067 None None] MFA Rules not processed for user `914c3f5c22bd4da4916bead50f5068db`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:14.682193 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0d455090-9670-4059-b45c-7cc425dba067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:14.686247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-79592278-f729-408b-9d94-133312709e08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bd71335a14f415185696879d5d3f4bd'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:14.694241 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-79592278-f729-408b-9d94-133312709e08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bd71335a14f415185696879d5d3f4bd'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:14.712258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1366/2734] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:14 2022] DELETE /identity/v3/users/3bd71335a14f415185696879d5d3f4bd => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:14.713091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79592278-f729-408b-9d94-133312709e08 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.714448 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-79592278-f729-408b-9d94-133312709e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:14.765557 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1369/2735] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:14 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:14.773235 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d455090-9670-4059-b45c-7cc425dba067 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:14.775251 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0d455090-9670-4059-b45c-7cc425dba067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:14.785969 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79592278-f729-408b-9d94-133312709e08 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.790303 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd197777-bc28-4571-910d-545de3aa4a8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.793643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd197777-bc28-4571-910d-545de3aa4a8e service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.793643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd197777-bc28-4571-910d-545de3aa4a8e service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.793643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd197777-bc28-4571-910d-545de3aa4a8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.836739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d455090-9670-4059-b45c-7cc425dba067 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:14.840407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae32efd-83b5-4c5e-a97a-9848a90a8201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:14.841057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae32efd-83b5-4c5e-a97a-9848a90a8201 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:14.841334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae32efd-83b5-4c5e-a97a-9848a90a8201 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:14.841604 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae32efd-83b5-4c5e-a97a-9848a90a8201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:14.855999 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd197777-bc28-4571-910d-545de3aa4a8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.856188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:14.866647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd197777-bc28-4571-910d-545de3aa4a8e service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.867292 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1367/2736] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:14.905821 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae32efd-83b5-4c5e-a97a-9848a90a8201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:14.907293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae32efd-83b5-4c5e-a97a-9848a90a8201 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:14.917766 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1370/2737] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:14 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:14.931450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:15.204640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd197777-bc28-4571-910d-545de3aa4a8e service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:15.205230 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-dd197777-bc28-4571-910d-545de3aa4a8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:15.280188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd197777-bc28-4571-910d-545de3aa4a8e service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:15.284801 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295e368-4c11-4534-ae77-e16a0576d16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:15.290491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295e368-4c11-4534-ae77-e16a0576d16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.290491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295e368-4c11-4534-ae77-e16a0576d16c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.290491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295e368-4c11-4534-ae77-e16a0576d16c admin admin] PATH_INFO: `/v3/projects/a99084d124d747a7bd46214965ebdb4b` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.290491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295e368-4c11-4534-ae77-e16a0576d16c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99084d124d747a7bd46214965ebdb4b)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:15.290491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295e368-4c11-4534-ae77-e16a0576d16c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:15.496180 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5295e368-4c11-4534-ae77-e16a0576d16c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99084d124d747a7bd46214965ebdb4b', 'request_id': 'req-5295e368-4c11-4534-ae77-e16a0576d16c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:15.508712 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5295e368-4c11-4534-ae77-e16a0576d16c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99084d124d747a7bd46214965ebdb4b', 'request_id': 'req-5295e368-4c11-4534-ae77-e16a0576d16c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:15.517265 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5295e368-4c11-4534-ae77-e16a0576d16c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99084d124d747a7bd46214965ebdb4b', 'request_id': 'req-5295e368-4c11-4534-ae77-e16a0576d16c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:15.647098 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5295e368-4c11-4534-ae77-e16a0576d16c admin admin] The token cache is being invalidate because project a99084d124d747a7bd46214965ebdb4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:15.651646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5295e368-4c11-4534-ae77-e16a0576d16c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:15.651646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5295e368-4c11-4534-ae77-e16a0576d16c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:15.651646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1368/2738] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:15 2022] DELETE /identity/v3/projects/a99084d124d747a7bd46214965ebdb4b => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:15.654835 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b39e46-cc22-4a9e-97e4-4f2686de8ab9 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.655300 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b39e46-cc22-4a9e-97e4-4f2686de8ab9 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.655724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b39e46-cc22-4a9e-97e4-4f2686de8ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.685365 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-02b39e46-cc22-4a9e-97e4-4f2686de8ab9 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:15.685365 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-02b39e46-cc22-4a9e-97e4-4f2686de8ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:15.759494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1371/2739] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:15.767411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbe07a-92d6-4b4b-a399-3a53cfaec2c9 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.767996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbe07a-92d6-4b4b-a399-3a53cfaec2c9 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.768497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbe07a-92d6-4b4b-a399-3a53cfaec2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.788138 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-b3cbe07a-92d6-4b4b-a399-3a53cfaec2c9 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:15.789493 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-b3cbe07a-92d6-4b4b-a399-3a53cfaec2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:15.803063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1369/2740] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:15.806033 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b39e46-cc22-4a9e-97e4-4f2686de8ab9 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:15.816230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b39e46-cc22-4a9e-97e4-4f2686de8ab9 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:15.821837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921437ff-b025-4910-a9ce-99efbc8f1cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:15.822494 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921437ff-b025-4910-a9ce-99efbc8f1cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.822778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921437ff-b025-4910-a9ce-99efbc8f1cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.823105 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921437ff-b025-4910-a9ce-99efbc8f1cf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.823858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921437ff-b025-4910-a9ce-99efbc8f1cf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:15.824168 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921437ff-b025-4910-a9ce-99efbc8f1cf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:15.825824 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921437ff-b025-4910-a9ce-99efbc8f1cf5 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:15.839537 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1372/2741] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:15.843601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbe07a-92d6-4b4b-a399-3a53cfaec2c9 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:15.854322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbe07a-92d6-4b4b-a399-3a53cfaec2c9 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:15.861764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ece95-8f0a-4147-9b25-3f9058dabdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:15.863860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ece95-8f0a-4147-9b25-3f9058dabdd7 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:15.863860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ece95-8f0a-4147-9b25-3f9058dabdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:15.863860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ece95-8f0a-4147-9b25-3f9058dabdd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:15.863860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ece95-8f0a-4147-9b25-3f9058dabdd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:15.865999 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ece95-8f0a-4147-9b25-3f9058dabdd7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:15.988683 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1370/2742] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:15 2022] POST /identity/v3/projects => generated 389 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:15.991341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ece95-8f0a-4147-9b25-3f9058dabdd7 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:15.991492 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921437ff-b025-4910-a9ce-99efbc8f1cf5 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:15.993429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-921437ff-b025-4910-a9ce-99efbc8f1cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:16.008149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921437ff-b025-4910-a9ce-99efbc8f1cf5 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.038887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:16.056756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ece95-8f0a-4147-9b25-3f9058dabdd7 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.062568 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046935a-59a7-4e6e-b550-975561331ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.063240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046935a-59a7-4e6e-b550-975561331ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.068066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046935a-59a7-4e6e-b550-975561331ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.068066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046935a-59a7-4e6e-b550-975561331ea3 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.068066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046935a-59a7-4e6e-b550-975561331ea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.068066 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7046935a-59a7-4e6e-b550-975561331ea3 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.068424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2379d3fb-a712-43be-86b1-3114a10a9fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.068999 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379d3fb-a712-43be-86b1-3114a10a9fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.069282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379d3fb-a712-43be-86b1-3114a10a9fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.069567 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2379d3fb-a712-43be-86b1-3114a10a9fe1 admin admin] PATH_INFO: `/v3/users/928cb3130594455b9e796fd322eb16ca` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.070774 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379d3fb-a712-43be-86b1-3114a10a9fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=928cb3130594455b9e796fd322eb16ca)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.072760 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2379d3fb-a712-43be-86b1-3114a10a9fe1 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.173643 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1371/2743] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:15 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:16.177904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046935a-59a7-4e6e-b550-975561331ea3 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.188554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046935a-59a7-4e6e-b550-975561331ea3 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.193607 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eca7f-57e0-454c-b131-602f4428fe66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.200201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eca7f-57e0-454c-b131-602f4428fe66 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.200201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eca7f-57e0-454c-b131-602f4428fe66 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.200201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6eca7f-57e0-454c-b131-602f4428fe66 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.200201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6eca7f-57e0-454c-b131-602f4428fe66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.200201 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6eca7f-57e0-454c-b131-602f4428fe66 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.208287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1372/2744] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:18:16.212380 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eca7f-57e0-454c-b131-602f4428fe66 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.223424 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6eca7f-57e0-454c-b131-602f4428fe66 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.229582 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344b3cb-f4d7-4fd4-b4f8-aa54295428be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.230240 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344b3cb-f4d7-4fd4-b4f8-aa54295428be admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.230528 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344b3cb-f4d7-4fd4-b4f8-aa54295428be admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.230810 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7344b3cb-f4d7-4fd4-b4f8-aa54295428be admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.231533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344b3cb-f4d7-4fd4-b4f8-aa54295428be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.233859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7344b3cb-f4d7-4fd4-b4f8-aa54295428be admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.244348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1373/2745] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:18:16.248862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344b3cb-f4d7-4fd4-b4f8-aa54295428be admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.258741 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7344b3cb-f4d7-4fd4-b4f8-aa54295428be admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.266410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:16.266530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e17fb-6bda-4b24-b59a-bc0ee06cdfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.266530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e17fb-6bda-4b24-b59a-bc0ee06cdfc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.266530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e17fb-6bda-4b24-b59a-bc0ee06cdfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.266530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e17fb-6bda-4b24-b59a-bc0ee06cdfc8 admin admin] PATH_INFO: `/v3/projects/c8e624041854453fb05726ae5e04c4f1/users/72747b1856f14106835127655a63fb0a/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.267312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2379d3fb-a712-43be-86b1-3114a10a9fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928cb3130594455b9e796fd322eb16ca'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:16.279091 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2379d3fb-a712-43be-86b1-3114a10a9fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928cb3130594455b9e796fd322eb16ca'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:16.280324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2379d3fb-a712-43be-86b1-3114a10a9fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928cb3130594455b9e796fd322eb16ca'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:16.280938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2379d3fb-a712-43be-86b1-3114a10a9fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928cb3130594455b9e796fd322eb16ca'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:16.281081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e17fb-6bda-4b24-b59a-bc0ee06cdfc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8e624041854453fb05726ae5e04c4f1, user_id=72747b1856f14106835127655a63fb0a, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.283872 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e17fb-6bda-4b24-b59a-bc0ee06cdfc8 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.400337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2379d3fb-a712-43be-86b1-3114a10a9fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928cb3130594455b9e796fd322eb16ca'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:16.407003 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1374/2746] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:16 2022] PUT /identity/v3/projects/c8e624041854453fb05726ae5e04c4f1/users/72747b1856f14106835127655a63fb0a/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:16.417151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1373/2747] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:15 2022] DELETE /identity/v3/users/928cb3130594455b9e796fd322eb16ca => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:16.418821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99656f8-8980-46f0-8fec-0fb412a8497e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.419117 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99656f8-8980-46f0-8fec-0fb412a8497e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.419401 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b08f5b-83b5-495a-bd53-acaa286b96d0 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.419506 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99656f8-8980-46f0-8fec-0fb412a8497e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.419694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b08f5b-83b5-495a-bd53-acaa286b96d0 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.420636 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b08f5b-83b5-495a-bd53-acaa286b96d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.439930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-e99656f8-8980-46f0-8fec-0fb412a8497e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:16.441080 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e99656f8-8980-46f0-8fec-0fb412a8497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:16.448489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-18b08f5b-83b5-495a-bd53-acaa286b96d0 None None] MFA Rules not processed for user `72747b1856f14106835127655a63fb0a`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:16.449759 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-18b08f5b-83b5-495a-bd53-acaa286b96d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:16.505930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1375/2748] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:16.516381 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99656f8-8980-46f0-8fec-0fb412a8497e None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.517799 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e99656f8-8980-46f0-8fec-0fb412a8497e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:16.536094 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1374/2749] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:16.543041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b08f5b-83b5-495a-bd53-acaa286b96d0 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.544851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-18b08f5b-83b5-495a-bd53-acaa286b96d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:16.563114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b08f5b-83b5-495a-bd53-acaa286b96d0 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.570973 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52dbd6-5dc9-4014-bb53-8c32fab562f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.571671 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52dbd6-5dc9-4014-bb53-8c32fab562f0 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.572001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52dbd6-5dc9-4014-bb53-8c32fab562f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.577273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52dbd6-5dc9-4014-bb53-8c32fab562f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.577273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52dbd6-5dc9-4014-bb53-8c32fab562f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.577273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f52dbd6-5dc9-4014-bb53-8c32fab562f0 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.580878 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99656f8-8980-46f0-8fec-0fb412a8497e None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.585131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08568b33-d0a7-4a7b-923a-916ec078b750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.585798 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08568b33-d0a7-4a7b-923a-916ec078b750 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.586080 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08568b33-d0a7-4a7b-923a-916ec078b750 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.586375 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08568b33-d0a7-4a7b-923a-916ec078b750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.598525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08568b33-d0a7-4a7b-923a-916ec078b750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.600100 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08568b33-d0a7-4a7b-923a-916ec078b750 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.610946 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1376/2750] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:16.659223 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1375/2751] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:16 2022] POST /identity/v3/projects => generated 387 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:16.663338 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08568b33-d0a7-4a7b-923a-916ec078b750 service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.673160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08568b33-d0a7-4a7b-923a-916ec078b750 service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.733672 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11bc0-6fa1-4e52-b38d-7e077f3d3db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.734371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11bc0-6fa1-4e52-b38d-7e077f3d3db5 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.734671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11bc0-6fa1-4e52-b38d-7e077f3d3db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.734935 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d11bc0-6fa1-4e52-b38d-7e077f3d3db5 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.735625 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d11bc0-6fa1-4e52-b38d-7e077f3d3db5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.737717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d11bc0-6fa1-4e52-b38d-7e077f3d3db5 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.824837 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52dbd6-5dc9-4014-bb53-8c32fab562f0 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.834044 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1377/2752] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:16 2022] POST /identity/v3/users => generated 300 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:16.838707 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f52dbd6-5dc9-4014-bb53-8c32fab562f0 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.844940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179a0e9-8389-4de8-bfff-07cfc7ff6d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.846021 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179a0e9-8389-4de8-bfff-07cfc7ff6d58 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.846312 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179a0e9-8389-4de8-bfff-07cfc7ff6d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.846584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a179a0e9-8389-4de8-bfff-07cfc7ff6d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.847320 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179a0e9-8389-4de8-bfff-07cfc7ff6d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.848940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a179a0e9-8389-4de8-bfff-07cfc7ff6d58 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.861016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1376/2753] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:16.866056 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11bc0-6fa1-4e52-b38d-7e077f3d3db5 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:16.878412 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d11bc0-6fa1-4e52-b38d-7e077f3d3db5 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:16.884234 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17041-709d-4464-9fb9-768e2b444274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:16.885479 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17041-709d-4464-9fb9-768e2b444274 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:16.885651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17041-709d-4464-9fb9-768e2b444274 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:16.885950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a17041-709d-4464-9fb9-768e2b444274 admin admin] PATH_INFO: `/v3/projects/5b6009b06e6b4c8a91a0c566385ad9dd/users/ad05052a363a422ab5d2b4ffa7bcdb5d/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:16.904518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a17041-709d-4464-9fb9-768e2b444274 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6009b06e6b4c8a91a0c566385ad9dd, user_id=ad05052a363a422ab5d2b4ffa7bcdb5d, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:16.907513 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a17041-709d-4464-9fb9-768e2b444274 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:16.990265 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1378/2754] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:16 2022] PUT /identity/v3/projects/5b6009b06e6b4c8a91a0c566385ad9dd/users/ad05052a363a422ab5d2b4ffa7bcdb5d/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:16.993867 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179a0e9-8389-4de8-bfff-07cfc7ff6d58 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:17.011429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a179a0e9-8389-4de8-bfff-07cfc7ff6d58 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.073912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5a9f2-d4c7-4f3c-ae39-d643f63942f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.074570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a9f2-d4c7-4f3c-ae39-d643f63942f2 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.074876 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a9f2-d4c7-4f3c-ae39-d643f63942f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.075155 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5a9f2-d4c7-4f3c-ae39-d643f63942f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.075919 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5a9f2-d4c7-4f3c-ae39-d643f63942f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:17.078172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5a9f2-d4c7-4f3c-ae39-d643f63942f2 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:17.087840 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1377/2755] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:17.092450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17041-709d-4464-9fb9-768e2b444274 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:17.102630 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a17041-709d-4464-9fb9-768e2b444274 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.107279 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad266f-9432-4ba1-a56d-5162c2973972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.108762 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad266f-9432-4ba1-a56d-5162c2973972 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.109041 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad266f-9432-4ba1-a56d-5162c2973972 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.109313 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad266f-9432-4ba1-a56d-5162c2973972 admin admin] PATH_INFO: `/v3/projects/5b6009b06e6b4c8a91a0c566385ad9dd/users/ad05052a363a422ab5d2b4ffa7bcdb5d/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.111312 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad266f-9432-4ba1-a56d-5162c2973972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b6009b06e6b4c8a91a0c566385ad9dd, user_id=ad05052a363a422ab5d2b4ffa7bcdb5d, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:17.114030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad266f-9432-4ba1-a56d-5162c2973972 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:17.124814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1379/2756] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:17 2022] PUT /identity/v3/projects/5b6009b06e6b4c8a91a0c566385ad9dd/users/ad05052a363a422ab5d2b4ffa7bcdb5d/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:17.135865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4d49e-9058-451e-9074-160353b3af6f None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.136230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4d49e-9058-451e-9074-160353b3af6f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.136581 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4d49e-9058-451e-9074-160353b3af6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.144512 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad266f-9432-4ba1-a56d-5162c2973972 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:17.146281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-26ad266f-9432-4ba1-a56d-5162c2973972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:17.171673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-48f4d49e-9058-451e-9074-160353b3af6f None None] MFA Rules not processed for user `ad05052a363a422ab5d2b4ffa7bcdb5d`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:17.181230 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-48f4d49e-9058-451e-9074-160353b3af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:17.226697 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad266f-9432-4ba1-a56d-5162c2973972 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.231742 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.238626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.238626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.238626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] PATH_INFO: `/v3/projects/957b46e3dc2947b2aefd267a5699004f` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.238626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] RBAC: Authorizing `identity:delete_project(project_id=957b46e3dc2947b2aefd267a5699004f)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:17.238626 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:17.248765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1378/2757] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:17.259561 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4d49e-9058-451e-9074-160353b3af6f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:17.260988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-48f4d49e-9058-451e-9074-160353b3af6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:17.319552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4d49e-9058-451e-9074-160353b3af6f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.323218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cec1b-62eb-4da0-a776-44f877212654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.323886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cec1b-62eb-4da0-a776-44f877212654 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.324232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cec1b-62eb-4da0-a776-44f877212654 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.324504 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459cec1b-62eb-4da0-a776-44f877212654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.334345 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459cec1b-62eb-4da0-a776-44f877212654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:17.335779 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459cec1b-62eb-4da0-a776-44f877212654 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:17.345889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1379/2758] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:17.373025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '957b46e3dc2947b2aefd267a5699004f', 'request_id': 'req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.379406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '957b46e3dc2947b2aefd267a5699004f', 'request_id': 'req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.385862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '957b46e3dc2947b2aefd267a5699004f', 'request_id': 'req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.481665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cec1b-62eb-4da0-a776-44f877212654 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:17.492323 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459cec1b-62eb-4da0-a776-44f877212654 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.543423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] The token cache is being invalidate because project 957b46e3dc2947b2aefd267a5699004f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:17.543898 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.544615 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.546821 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1380/2759] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:17 2022] DELETE /identity/v3/projects/957b46e3dc2947b2aefd267a5699004f => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:17.549235 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2349fa0-6206-4d84-83ea-09872716d941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.550114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2349fa0-6206-4d84-83ea-09872716d941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.550400 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2349fa0-6206-4d84-83ea-09872716d941 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.550679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2349fa0-6206-4d84-83ea-09872716d941 admin admin] PATH_INFO: `/v3/users/72747b1856f14106835127655a63fb0a` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.551257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:17.551948 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2349fa0-6206-4d84-83ea-09872716d941 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72747b1856f14106835127655a63fb0a)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:17.552973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:17.553912 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2349fa0-6206-4d84-83ea-09872716d941 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:17.567860 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd0eb68-7dee-41e4-a5cf-5f6ffd8aa714 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:17.573165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:17.574050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.574337 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.574618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] PATH_INFO: `/v3/users/914c3f5c22bd4da4916bead50f5068db` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.576893 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=914c3f5c22bd4da4916bead50f5068db)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:17.578947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:17.754611 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:17.847341 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b2349fa0-6206-4d84-83ea-09872716d941 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72747b1856f14106835127655a63fb0a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.859319 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b2349fa0-6206-4d84-83ea-09872716d941 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72747b1856f14106835127655a63fb0a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.860134 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b2349fa0-6206-4d84-83ea-09872716d941 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72747b1856f14106835127655a63fb0a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.860742 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b2349fa0-6206-4d84-83ea-09872716d941 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72747b1856f14106835127655a63fb0a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.863746 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '914c3f5c22bd4da4916bead50f5068db'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.864402 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '914c3f5c22bd4da4916bead50f5068db'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.865147 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '914c3f5c22bd4da4916bead50f5068db'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.914371 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b2349fa0-6206-4d84-83ea-09872716d941 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72747b1856f14106835127655a63fb0a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.914944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:17.927010 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1380/2760] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:17 2022] DELETE /identity/v3/users/72747b1856f14106835127655a63fb0a => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:17.931430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25654dd9-8b31-4a1d-9475-cf319c8c0806 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:17.931714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25654dd9-8b31-4a1d-9475-cf319c8c0806 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:17.932019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25654dd9-8b31-4a1d-9475-cf319c8c0806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:17.949858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-25654dd9-8b31-4a1d-9475-cf319c8c0806 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:17.951069 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-25654dd9-8b31-4a1d-9475-cf319c8c0806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:17.983068 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '914c3f5c22bd4da4916bead50f5068db'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:17.991050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '914c3f5c22bd4da4916bead50f5068db'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:18.012055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1381/2761] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:18.024650 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1381/2762] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:17 2022] DELETE /identity/v3/users/914c3f5c22bd4da4916bead50f5068db => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:18.024977 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25654dd9-8b31-4a1d-9475-cf319c8c0806 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.024977 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-25654dd9-8b31-4a1d-9475-cf319c8c0806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:18.094097 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25654dd9-8b31-4a1d-9475-cf319c8c0806 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.152007 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e773302-6da6-43de-80e0-e5421b312d40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.152656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773302-6da6-43de-80e0-e5421b312d40 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.152953 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773302-6da6-43de-80e0-e5421b312d40 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.153203 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e773302-6da6-43de-80e0-e5421b312d40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.229558 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e773302-6da6-43de-80e0-e5421b312d40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:18.232165 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e773302-6da6-43de-80e0-e5421b312d40 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:18.247054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1382/2763] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:18.257415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:18.316338 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:18.527022 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.528560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:18.544033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5df5f6-c0f7-4cf1-bb48-0fbe211718ab admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.550397 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b896f2d-7a8d-4e85-ae8c-5f806155989c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.551388 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b896f2d-7a8d-4e85-ae8c-5f806155989c admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.551672 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b896f2d-7a8d-4e85-ae8c-5f806155989c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.552152 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b896f2d-7a8d-4e85-ae8c-5f806155989c admin admin] PATH_INFO: `/v3/projects/00739cd87d754237b5ded3ed848d10da` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.553490 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b896f2d-7a8d-4e85-ae8c-5f806155989c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00739cd87d754237b5ded3ed848d10da)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:18.555486 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b896f2d-7a8d-4e85-ae8c-5f806155989c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:18.700556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-6b896f2d-7a8d-4e85-ae8c-5f806155989c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00739cd87d754237b5ded3ed848d10da', 'request_id': 'req-6b896f2d-7a8d-4e85-ae8c-5f806155989c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:18.708809 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-6b896f2d-7a8d-4e85-ae8c-5f806155989c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00739cd87d754237b5ded3ed848d10da', 'request_id': 'req-6b896f2d-7a8d-4e85-ae8c-5f806155989c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:18.716453 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-6b896f2d-7a8d-4e85-ae8c-5f806155989c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00739cd87d754237b5ded3ed848d10da', 'request_id': 'req-6b896f2d-7a8d-4e85-ae8c-5f806155989c'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:18.818122 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-6b896f2d-7a8d-4e85-ae8c-5f806155989c admin admin] The token cache is being invalidate because project 00739cd87d754237b5ded3ed848d10da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:18.818423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-6b896f2d-7a8d-4e85-ae8c-5f806155989c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:18.819628 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-6b896f2d-7a8d-4e85-ae8c-5f806155989c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:18.821359 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1382/2764] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:18 2022] DELETE /identity/v3/projects/00739cd87d754237b5ded3ed848d10da => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:18.827886 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a26287-b2ac-428f-b7c2-a94745a7ebf4 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.828383 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a26287-b2ac-428f-b7c2-a94745a7ebf4 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.828470 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a26287-b2ac-428f-b7c2-a94745a7ebf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.850354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-d7a26287-b2ac-428f-b7c2-a94745a7ebf4 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:18.851750 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d7a26287-b2ac-428f-b7c2-a94745a7ebf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:18.914745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1383/2765] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:18.922636 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dbcc7-5a29-4b2e-9abd-935ba984563e None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.923246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dbcc7-5a29-4b2e-9abd-935ba984563e None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.923562 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84dbcc7-5a29-4b2e-9abd-935ba984563e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.947649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a84dbcc7-5a29-4b2e-9abd-935ba984563e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:18.949016 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a84dbcc7-5a29-4b2e-9abd-935ba984563e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:18.957618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1383/2766] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:18.962132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a26287-b2ac-428f-b7c2-a94745a7ebf4 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:18.972617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a26287-b2ac-428f-b7c2-a94745a7ebf4 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:18.977138 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63c63a-9345-4e21-b2a7-fed86518f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:18.977782 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63c63a-9345-4e21-b2a7-fed86518f027 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:18.978063 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63c63a-9345-4e21-b2a7-fed86518f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:18.978337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63c63a-9345-4e21-b2a7-fed86518f027 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:18.979057 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63c63a-9345-4e21-b2a7-fed86518f027 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:18.979358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63c63a-9345-4e21-b2a7-fed86518f027 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:18.980986 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63c63a-9345-4e21-b2a7-fed86518f027 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:18.989190 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:18.994418 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1384/2767] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:18:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:18.998717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dbcc7-5a29-4b2e-9abd-935ba984563e None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.008700 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84dbcc7-5a29-4b2e-9abd-935ba984563e None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.014371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afffad-ee4e-404a-8d40-50d5f97ce56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.015033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afffad-ee4e-404a-8d40-50d5f97ce56e admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.015380 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afffad-ee4e-404a-8d40-50d5f97ce56e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.015668 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6afffad-ee4e-404a-8d40-50d5f97ce56e admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.016408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afffad-ee4e-404a-8d40-50d5f97ce56e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.018367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6afffad-ee4e-404a-8d40-50d5f97ce56e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.047266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63c63a-9345-4e21-b2a7-fed86518f027 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.049062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-0b63c63a-9345-4e21-b2a7-fed86518f027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:19.065316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63c63a-9345-4e21-b2a7-fed86518f027 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.071445 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.072669 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.072960 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.073245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] PATH_INFO: `/v3/projects/c8e624041854453fb05726ae5e04c4f1` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.074549 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8e624041854453fb05726ae5e04c4f1)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.077184 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.098827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1384/2768] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:18 2022] POST /identity/v3/projects => generated 377 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:19.103164 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afffad-ee4e-404a-8d40-50d5f97ce56e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.167371 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6afffad-ee4e-404a-8d40-50d5f97ce56e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.172369 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502f233-1612-4f72-8aad-6d29f9b0ad48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.173372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502f233-1612-4f72-8aad-6d29f9b0ad48 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.173666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502f233-1612-4f72-8aad-6d29f9b0ad48 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.173950 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502f233-1612-4f72-8aad-6d29f9b0ad48 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.174657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502f233-1612-4f72-8aad-6d29f9b0ad48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.176657 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502f233-1612-4f72-8aad-6d29f9b0ad48 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.187318 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8e624041854453fb05726ae5e04c4f1', 'request_id': 'req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:19.196048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8e624041854453fb05726ae5e04c4f1', 'request_id': 'req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:19.205532 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8e624041854453fb05726ae5e04c4f1', 'request_id': 'req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:19.253281 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:19.262141 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1385/2769] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:19 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:19.267533 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502f233-1612-4f72-8aad-6d29f9b0ad48 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.279718 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502f233-1612-4f72-8aad-6d29f9b0ad48 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.292619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] The token cache is being invalidate because project c8e624041854453fb05726ae5e04c4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:19.292619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:19.292997 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:19.295397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1385/2770] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:19 2022] DELETE /identity/v3/projects/c8e624041854453fb05726ae5e04c4f1 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:19.298642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.300032 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:19.343557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f759d80-79bf-4ae2-93ac-d670196bddbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.344367 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f759d80-79bf-4ae2-93ac-d670196bddbb admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.347687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f759d80-79bf-4ae2-93ac-d670196bddbb admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.347687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f759d80-79bf-4ae2-93ac-d670196bddbb admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.347687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f759d80-79bf-4ae2-93ac-d670196bddbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.347687 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f759d80-79bf-4ae2-93ac-d670196bddbb admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.362179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1386/2771] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:19.363261 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f759d80-79bf-4ae2-93ac-d670196bddbb admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.368640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-2f759d80-79bf-4ae2-93ac-d670196bddbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:19.382120 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f759d80-79bf-4ae2-93ac-d670196bddbb admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.386733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e00b0c-c3d1-4fb9-a771-8e7b2dc1f2f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.387518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e00b0c-c3d1-4fb9-a771-8e7b2dc1f2f9 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.387800 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e00b0c-c3d1-4fb9-a771-8e7b2dc1f2f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.388098 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e00b0c-c3d1-4fb9-a771-8e7b2dc1f2f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.388900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e00b0c-c3d1-4fb9-a771-8e7b2dc1f2f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.390238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd10d49-01e7-4e73-95bd-3fc1ccd2bb50 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.390485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e00b0c-c3d1-4fb9-a771-8e7b2dc1f2f9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.395407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.396333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.399244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.399244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] PATH_INFO: `/v3/users/ad05052a363a422ab5d2b4ffa7bcdb5d` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.399244 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad05052a363a422ab5d2b4ffa7bcdb5d)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.400076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.403151 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1387/2772] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:19.407716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e00b0c-c3d1-4fb9-a771-8e7b2dc1f2f9 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.417896 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e00b0c-c3d1-4fb9-a771-8e7b2dc1f2f9 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.423411 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e63f85b-3628-4dac-926e-c16c34952362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.427298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63f85b-3628-4dac-926e-c16c34952362 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.427298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63f85b-3628-4dac-926e-c16c34952362 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.427298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e63f85b-3628-4dac-926e-c16c34952362 admin admin] PATH_INFO: `/v3/projects/1ee26f63bc87418e89e357824ea38774/users/32094a91a51a46539141fe361c45bcca/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.442335 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63f85b-3628-4dac-926e-c16c34952362 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ee26f63bc87418e89e357824ea38774, user_id=32094a91a51a46539141fe361c45bcca, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.445268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e63f85b-3628-4dac-926e-c16c34952362 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.503940 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1388/2773] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:19 2022] PUT /identity/v3/projects/1ee26f63bc87418e89e357824ea38774/users/32094a91a51a46539141fe361c45bcca/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:19.516026 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c804d1-5ff0-4019-b02d-4d52c4c6adcd None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.516325 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c804d1-5ff0-4019-b02d-4d52c4c6adcd None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.516611 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c804d1-5ff0-4019-b02d-4d52c4c6adcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.544488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-c1c804d1-5ff0-4019-b02d-4d52c4c6adcd None None] MFA Rules not processed for user `32094a91a51a46539141fe361c45bcca`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:19.546472 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c1c804d1-5ff0-4019-b02d-4d52c4c6adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:19.568701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad05052a363a422ab5d2b4ffa7bcdb5d'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:19.583039 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad05052a363a422ab5d2b4ffa7bcdb5d'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:19.584734 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad05052a363a422ab5d2b4ffa7bcdb5d'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:19.585596 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad05052a363a422ab5d2b4ffa7bcdb5d'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:19.613215 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1389/2774] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:19.625034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c804d1-5ff0-4019-b02d-4d52c4c6adcd None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:19.626418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-c1c804d1-5ff0-4019-b02d-4d52c4c6adcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:19.661925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad05052a363a422ab5d2b4ffa7bcdb5d'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:19.676269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1386/2775] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:19 2022] DELETE /identity/v3/users/ad05052a363a422ab5d2b4ffa7bcdb5d => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:19.683608 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c804d1-5ff0-4019-b02d-4d52c4c6adcd None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:19.736406 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b29d7b-67a5-4558-86fb-8731ff5168c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5211ed409a3f43d281bca44382aa03fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:19.737062 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29d7b-67a5-4558-86fb-8731ff5168c3 service glance] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:19.737348 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29d7b-67a5-4558-86fb-8731ff5168c3 service glance] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:19.737629 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b29d7b-67a5-4558-86fb-8731ff5168c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:19.796945 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b29d7b-67a5-4558-86fb-8731ff5168c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:19.798310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b29d7b-67a5-4558-86fb-8731ff5168c3 service glance] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:19.807482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1390/2776] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:20.144555 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:20.146034 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:20.239052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1838e-0adb-4d93-aaae-bab1cf6011d3 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:20.243701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:20.244586 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:20.244872 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:20.245207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c admin admin] PATH_INFO: `/v3/projects/5b6009b06e6b4c8a91a0c566385ad9dd` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:20.246350 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b6009b06e6b4c8a91a0c566385ad9dd)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:20.248892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:20.337345 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b6009b06e6b4c8a91a0c566385ad9dd', 'request_id': 'req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:20.342852 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b6009b06e6b4c8a91a0c566385ad9dd', 'request_id': 'req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:20.349186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b6009b06e6b4c8a91a0c566385ad9dd', 'request_id': 'req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:20.383062 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:20.429340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c admin admin] The token cache is being invalidate because project 5b6009b06e6b4c8a91a0c566385ad9dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:20.429700 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:20.430642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2cbd26c0-4605-4af6-ab02-2f0969fcd18c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:20.437019 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1387/2777] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:20 2022] DELETE /identity/v3/projects/5b6009b06e6b4c8a91a0c566385ad9dd => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:20.439189 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5bcd3-06bf-457d-b59f-a176c7261cc4 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:20.441132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5bcd3-06bf-457d-b59f-a176c7261cc4 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:20.441437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5bcd3-06bf-457d-b59f-a176c7261cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:20.460618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-84d5bcd3-06bf-457d-b59f-a176c7261cc4 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:20.461871 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-84d5bcd3-06bf-457d-b59f-a176c7261cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:20.515538 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:20.533298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1391/2778] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:20.535269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725089-db59-4a91-bca8-2b1f372c1e3f None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:20.535568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725089-db59-4a91-bca8-2b1f372c1e3f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:20.535885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb725089-db59-4a91-bca8-2b1f372c1e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:20.556043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-bb725089-db59-4a91-bca8-2b1f372c1e3f None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:20.557679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-bb725089-db59-4a91-bca8-2b1f372c1e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:20.568001 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1388/2779] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:20.572753 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5bcd3-06bf-457d-b59f-a176c7261cc4 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:20.582637 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5bcd3-06bf-457d-b59f-a176c7261cc4 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:20.587905 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c586-8299-4676-8d4b-c5e1be0a1c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:20.588530 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c586-8299-4676-8d4b-c5e1be0a1c93 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:20.588813 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c586-8299-4676-8d4b-c5e1be0a1c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:20.589091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee5c586-8299-4676-8d4b-c5e1be0a1c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:20.589853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5c586-8299-4676-8d4b-c5e1be0a1c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:20.590168 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5c586-8299-4676-8d4b-c5e1be0a1c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:20.592330 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee5c586-8299-4676-8d4b-c5e1be0a1c93 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:20.604546 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1392/2780] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:20.609428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725089-db59-4a91-bca8-2b1f372c1e3f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:20.619114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb725089-db59-4a91-bca8-2b1f372c1e3f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:20.629801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef67ea-9730-4e6a-b54d-957f134c72b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:20.629801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef67ea-9730-4e6a-b54d-957f134c72b9 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:20.629801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef67ea-9730-4e6a-b54d-957f134c72b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:20.629801 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ef67ea-9730-4e6a-b54d-957f134c72b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:20.630129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef67ea-9730-4e6a-b54d-957f134c72b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:20.630129 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ef67ea-9730-4e6a-b54d-957f134c72b9 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:20.756765 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1389/2781] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:20 2022] POST /identity/v3/projects => generated 387 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:20.761254 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c586-8299-4676-8d4b-c5e1be0a1c93 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:20.773242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee5c586-8299-4676-8d4b-c5e1be0a1c93 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:20.836675 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261e72f-4c7d-4c19-ad6b-795189dff123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:20.837518 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261e72f-4c7d-4c19-ad6b-795189dff123 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:20.840008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261e72f-4c7d-4c19-ad6b-795189dff123 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:20.840008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261e72f-4c7d-4c19-ad6b-795189dff123 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:20.840008 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261e72f-4c7d-4c19-ad6b-795189dff123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:20.840773 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5261e72f-4c7d-4c19-ad6b-795189dff123 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:20.968050 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1393/2782] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:20 2022] POST /identity/v3/users => generated 294 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:20.976122 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef67ea-9730-4e6a-b54d-957f134c72b9 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:20.986631 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ef67ea-9730-4e6a-b54d-957f134c72b9 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:20.991291 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191fdd3-0f0c-4ff8-a005-e6f1c98de646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:20.994119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191fdd3-0f0c-4ff8-a005-e6f1c98de646 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:20.994119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191fdd3-0f0c-4ff8-a005-e6f1c98de646 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:20.994119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191fdd3-0f0c-4ff8-a005-e6f1c98de646 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:20.994119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191fdd3-0f0c-4ff8-a005-e6f1c98de646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:20.994873 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191fdd3-0f0c-4ff8-a005-e6f1c98de646 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:21.006079 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1390/2783] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:21.010494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261e72f-4c7d-4c19-ad6b-795189dff123 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.021522 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261e72f-4c7d-4c19-ad6b-795189dff123 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.026887 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c692aaf4-dc97-48b6-8d21-3bb27ca7906d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.027553 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692aaf4-dc97-48b6-8d21-3bb27ca7906d admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.027866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692aaf4-dc97-48b6-8d21-3bb27ca7906d admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.028301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c692aaf4-dc97-48b6-8d21-3bb27ca7906d admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.029040 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692aaf4-dc97-48b6-8d21-3bb27ca7906d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:21.031210 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c692aaf4-dc97-48b6-8d21-3bb27ca7906d admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:21.042153 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1394/2784] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:21.046775 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191fdd3-0f0c-4ff8-a005-e6f1c98de646 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.058023 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191fdd3-0f0c-4ff8-a005-e6f1c98de646 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.063270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbe937-15b3-4e03-b8e3-bf3448935f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.064293 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe937-15b3-4e03-b8e3-bf3448935f98 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.064579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe937-15b3-4e03-b8e3-bf3448935f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.064855 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cbe937-15b3-4e03-b8e3-bf3448935f98 admin admin] PATH_INFO: `/v3/projects/de5948556a9a4bdbbda19120cb054ce3/users/fd05a423728e452d9fbb343a8052097b/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.080583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbe937-15b3-4e03-b8e3-bf3448935f98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de5948556a9a4bdbbda19120cb054ce3, user_id=fd05a423728e452d9fbb343a8052097b, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:21.083260 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cbe937-15b3-4e03-b8e3-bf3448935f98 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:21.180150 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1391/2785] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:21 2022] PUT /identity/v3/projects/de5948556a9a4bdbbda19120cb054ce3/users/fd05a423728e452d9fbb343a8052097b/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:21.194004 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f7108-fde7-4002-b3b1-50d6af6a2734 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.194304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f7108-fde7-4002-b3b1-50d6af6a2734 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.194587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0f7108-fde7-4002-b3b1-50d6af6a2734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.224578 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-8c0f7108-fde7-4002-b3b1-50d6af6a2734 None None] MFA Rules not processed for user `fd05a423728e452d9fbb343a8052097b`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:21.225874 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-8c0f7108-fde7-4002-b3b1-50d6af6a2734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:21.331340 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1395/2786] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:21.331728 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=100 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:21.332940 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbe937-15b3-4e03-b8e3-bf3448935f98 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.406399 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cbe937-15b3-4e03-b8e3-bf3448935f98 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.411427 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e3e33-1fce-4a25-aa89-bac34e81f8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.412343 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e3e33-1fce-4a25-aa89-bac34e81f8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.414772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e3e33-1fce-4a25-aa89-bac34e81f8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.414772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446e3e33-1fce-4a25-aa89-bac34e81f8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.414772 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e3e33-1fce-4a25-aa89-bac34e81f8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:21.415613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446e3e33-1fce-4a25-aa89-bac34e81f8a6 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:21.492934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:21.501239 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1392/2787] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:21 2022] POST /identity/v3/projects => generated 385 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:21.505143 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f7108-fde7-4002-b3b1-50d6af6a2734 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.517973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0f7108-fde7-4002-b3b1-50d6af6a2734 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.580924 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb8e46-1b5a-4ecc-ae4d-b68dc17b18ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.581952 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb8e46-1b5a-4ecc-ae4d-b68dc17b18ce admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.582389 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb8e46-1b5a-4ecc-ae4d-b68dc17b18ce admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.582835 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb8e46-1b5a-4ecc-ae4d-b68dc17b18ce admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.583901 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb8e46-1b5a-4ecc-ae4d-b68dc17b18ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:21.586041 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb8e46-1b5a-4ecc-ae4d-b68dc17b18ce admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:21.692508 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1396/2788] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:21 2022] POST /identity/v3/users => generated 299 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:21.696723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e3e33-1fce-4a25-aa89-bac34e81f8a6 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.709643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446e3e33-1fce-4a25-aa89-bac34e81f8a6 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.714605 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb5d1a-c654-4520-93af-3254a42d407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.715261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb5d1a-c654-4520-93af-3254a42d407e admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.715582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb5d1a-c654-4520-93af-3254a42d407e admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.715932 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb5d1a-c654-4520-93af-3254a42d407e admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.716752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb5d1a-c654-4520-93af-3254a42d407e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:21.718354 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb5d1a-c654-4520-93af-3254a42d407e admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:21.735767 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1393/2789] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:21.739760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb8e46-1b5a-4ecc-ae4d-b68dc17b18ce admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.751605 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb8e46-1b5a-4ecc-ae4d-b68dc17b18ce admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.758073 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22b22d-435a-4205-982e-a5d331a8ea7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.759033 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22b22d-435a-4205-982e-a5d331a8ea7c admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.759376 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22b22d-435a-4205-982e-a5d331a8ea7c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.759688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22b22d-435a-4205-982e-a5d331a8ea7c admin admin] PATH_INFO: `/v3/projects/f133a4916a3e4f61bb2d4c9bfd50e19b/users/265526c768c244d5a5c2022dc569943e/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.780480 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:21.782363 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22b22d-435a-4205-982e-a5d331a8ea7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f133a4916a3e4f61bb2d4c9bfd50e19b, user_id=265526c768c244d5a5c2022dc569943e, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:21.785247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22b22d-435a-4205-982e-a5d331a8ea7c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:21.880973 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1397/2790] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:21 2022] PUT /identity/v3/projects/f133a4916a3e4f61bb2d4c9bfd50e19b/users/265526c768c244d5a5c2022dc569943e/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:21.885221 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb5d1a-c654-4520-93af-3254a42d407e admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:21.897004 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb5d1a-c654-4520-93af-3254a42d407e admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:21.960374 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:21.967569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c308dd-9a77-4964-acbf-ed3fbd635dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:21.968289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c308dd-9a77-4964-acbf-ed3fbd635dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:21.972847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c308dd-9a77-4964-acbf-ed3fbd635dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:21.972847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c308dd-9a77-4964-acbf-ed3fbd635dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:21.972847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c308dd-9a77-4964-acbf-ed3fbd635dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:21.972847 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c308dd-9a77-4964-acbf-ed3fbd635dd7 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:21.983911 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1394/2791] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:21 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:21.988269 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22b22d-435a-4205-982e-a5d331a8ea7c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:22.007272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22b22d-435a-4205-982e-a5d331a8ea7c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:22.007272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab8f48-c1da-4725-ad27-f21ce32f293d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:22.007272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab8f48-c1da-4725-ad27-f21ce32f293d admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:22.007272 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab8f48-c1da-4725-ad27-f21ce32f293d admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:22.007672 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab8f48-c1da-4725-ad27-f21ce32f293d admin admin] PATH_INFO: `/v3/projects/f133a4916a3e4f61bb2d4c9bfd50e19b/users/265526c768c244d5a5c2022dc569943e/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:22.008405 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab8f48-c1da-4725-ad27-f21ce32f293d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f133a4916a3e4f61bb2d4c9bfd50e19b, user_id=265526c768c244d5a5c2022dc569943e, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:22.011148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab8f48-c1da-4725-ad27-f21ce32f293d admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:22.022909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1398/2792] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:21 2022] PUT /identity/v3/projects/f133a4916a3e4f61bb2d4c9bfd50e19b/users/265526c768c244d5a5c2022dc569943e/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:22.036615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab742f6-3a52-4317-b787-a848ee604141 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:22.037252 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab742f6-3a52-4317-b787-a848ee604141 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:22.037539 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab742f6-3a52-4317-b787-a848ee604141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:22.071579 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-8ab742f6-3a52-4317-b787-a848ee604141 None None] MFA Rules not processed for user `265526c768c244d5a5c2022dc569943e`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:22.072971 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-8ab742f6-3a52-4317-b787-a848ee604141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:22.160751 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1395/2793] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:22.173751 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab8f48-c1da-4725-ad27-f21ce32f293d admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:22.175516 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-33ab8f48-c1da-4725-ad27-f21ce32f293d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:22.244644 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab8f48-c1da-4725-ad27-f21ce32f293d admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:22.249458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcc195-d397-4567-8218-09c0ed05c63d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:22.250149 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcc195-d397-4567-8218-09c0ed05c63d service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:22.250436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcc195-d397-4567-8218-09c0ed05c63d service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:22.250769 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fcc195-d397-4567-8218-09c0ed05c63d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:22.265318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcc195-d397-4567-8218-09c0ed05c63d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:22.266931 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fcc195-d397-4567-8218-09c0ed05c63d service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:22.277502 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1399/2794] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:22 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:23.833048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab742f6-3a52-4317-b787-a848ee604141 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:23.887642 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcc195-d397-4567-8218-09c0ed05c63d service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:23.889986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-21fcc195-d397-4567-8218-09c0ed05c63d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:23.903785 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab742f6-3a52-4317-b787-a848ee604141 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:23.909365 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6750d00-cbb6-440c-8111-8d35e89a5c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:23.910245 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6750d00-cbb6-440c-8111-8d35e89a5c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:23.913395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6750d00-cbb6-440c-8111-8d35e89a5c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:23.913395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6750d00-cbb6-440c-8111-8d35e89a5c51 admin admin] PATH_INFO: `/v3/users/fd05a423728e452d9fbb343a8052097b` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:23.913395 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6750d00-cbb6-440c-8111-8d35e89a5c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd05a423728e452d9fbb343a8052097b)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:23.914202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6750d00-cbb6-440c-8111-8d35e89a5c51 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:23.970128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fcc195-d397-4567-8218-09c0ed05c63d service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:23.974730 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f33f5-2545-4fba-9277-c60e32d87871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:23.975624 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f33f5-2545-4fba-9277-c60e32d87871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:23.975947 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f33f5-2545-4fba-9277-c60e32d87871 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:23.976242 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f33f5-2545-4fba-9277-c60e32d87871 admin admin] PATH_INFO: `/v3/users/616ca2f256ff4f108aac1ed708bc323a` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:23.977442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f33f5-2545-4fba-9277-c60e32d87871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=616ca2f256ff4f108aac1ed708bc323a)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:23.979361 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f33f5-2545-4fba-9277-c60e32d87871 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:24.167593 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d6750d00-cbb6-440c-8111-8d35e89a5c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd05a423728e452d9fbb343a8052097b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:24.181739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d6750d00-cbb6-440c-8111-8d35e89a5c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd05a423728e452d9fbb343a8052097b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:24.182506 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d6750d00-cbb6-440c-8111-8d35e89a5c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd05a423728e452d9fbb343a8052097b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:24.183116 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d6750d00-cbb6-440c-8111-8d35e89a5c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd05a423728e452d9fbb343a8052097b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:24.222603 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a35f33f5-2545-4fba-9277-c60e32d87871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616ca2f256ff4f108aac1ed708bc323a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:24.223556 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a35f33f5-2545-4fba-9277-c60e32d87871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616ca2f256ff4f108aac1ed708bc323a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:24.224310 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a35f33f5-2545-4fba-9277-c60e32d87871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616ca2f256ff4f108aac1ed708bc323a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:24.297044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d6750d00-cbb6-440c-8111-8d35e89a5c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd05a423728e452d9fbb343a8052097b'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:24.304369 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:24.313346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1396/2795] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:23 2022] DELETE /identity/v3/users/fd05a423728e452d9fbb343a8052097b => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:24.318752 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae8d39-3669-4aca-9049-0c3f61522800 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:24.319109 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae8d39-3669-4aca-9049-0c3f61522800 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:24.319535 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae8d39-3669-4aca-9049-0c3f61522800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:24.344556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-a2ae8d39-3669-4aca-9049-0c3f61522800 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:24.345903 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a2ae8d39-3669-4aca-9049-0c3f61522800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:24.408430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1397/2796] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:24.418434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae8d39-3669-4aca-9049-0c3f61522800 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:24.419907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a2ae8d39-3669-4aca-9049-0c3f61522800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:24.439680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a35f33f5-2545-4fba-9277-c60e32d87871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616ca2f256ff4f108aac1ed708bc323a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:24.451162 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-a35f33f5-2545-4fba-9277-c60e32d87871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616ca2f256ff4f108aac1ed708bc323a'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:24.469184 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:24.474825 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1400/2797] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:23 2022] DELETE /identity/v3/users/616ca2f256ff4f108aac1ed708bc323a => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:24.479450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73770898-08a7-4a19-97ff-0d7d227a7bdc None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:24.486154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73770898-08a7-4a19-97ff-0d7d227a7bdc None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:24.486154 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73770898-08a7-4a19-97ff-0d7d227a7bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:24.486358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae8d39-3669-4aca-9049-0c3f61522800 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:24.500703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-73770898-08a7-4a19-97ff-0d7d227a7bdc None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:24.501977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-73770898-08a7-4a19-97ff-0d7d227a7bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:24.536070 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed7f4-790c-4739-9391-0e7467069c3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:24.536807 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed7f4-790c-4739-9391-0e7467069c3d service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:24.537271 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed7f4-790c-4739-9391-0e7467069c3d service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:24.537430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffed7f4-790c-4739-9391-0e7467069c3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:24.577959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1401/2798] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:24.589211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73770898-08a7-4a19-97ff-0d7d227a7bdc None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:24.590246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-73770898-08a7-4a19-97ff-0d7d227a7bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:24.604111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73770898-08a7-4a19-97ff-0d7d227a7bdc None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:24.608780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffed7f4-790c-4739-9391-0e7467069c3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:24.610353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffed7f4-790c-4739-9391-0e7467069c3d service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:24.611076 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1c316-4e3b-4ec9-a259-4648074496dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:24.612018 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1c316-4e3b-4ec9-a259-4648074496dd service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:24.612317 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1c316-4e3b-4ec9-a259-4648074496dd service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:24.617790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd1c316-4e3b-4ec9-a259-4648074496dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:24.621516 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1398/2799] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:24.626158 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1c316-4e3b-4ec9-a259-4648074496dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:24.627848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd1c316-4e3b-4ec9-a259-4648074496dd service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:24.640398 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1402/2800] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:25.083061 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed7f4-790c-4739-9391-0e7467069c3d service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:25.084854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1ffed7f4-790c-4739-9391-0e7467069c3d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:25.109022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:25.118437 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffed7f4-790c-4739-9391-0e7467069c3d service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:25.118667 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1c316-4e3b-4ec9-a259-4648074496dd service neutron] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:25.122000 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-dbd1c316-4e3b-4ec9-a259-4648074496dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:25.145284 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd1c316-4e3b-4ec9-a259-4648074496dd service neutron] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:25.150407 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:25.150909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:25.151265 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:25.151548 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:25.151892 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] PATH_INFO: `/v3/projects/de5948556a9a4bdbbda19120cb054ce3` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:25.152098 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:25.152251 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:25.152609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] PATH_INFO: `/v3/projects/7e1b975328e84d31956aa673bc391f4c` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:25.153385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] RBAC: Authorizing `identity:delete_project(project_id=de5948556a9a4bdbbda19120cb054ce3)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:25.154776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e1b975328e84d31956aa673bc391f4c)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:25.155910 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:25.157387 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:25.321192 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e1b975328e84d31956aa673bc391f4c', 'request_id': 'req-acfac817-19bb-4eae-b946-c33df8968a1b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.321627 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de5948556a9a4bdbbda19120cb054ce3', 'request_id': 'req-b77445fe-e7fa-41dc-be18-d16198d2a29a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.329167 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de5948556a9a4bdbbda19120cb054ce3', 'request_id': 'req-b77445fe-e7fa-41dc-be18-d16198d2a29a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.330863 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e1b975328e84d31956aa673bc391f4c', 'request_id': 'req-acfac817-19bb-4eae-b946-c33df8968a1b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.337009 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de5948556a9a4bdbbda19120cb054ce3', 'request_id': 'req-b77445fe-e7fa-41dc-be18-d16198d2a29a'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.338659 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e1b975328e84d31956aa673bc391f4c', 'request_id': 'req-acfac817-19bb-4eae-b946-c33df8968a1b'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.411851 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] The token cache is being invalidate because project de5948556a9a4bdbbda19120cb054ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:25.412459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.413139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.414761 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1399/2801] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:25 2022] DELETE /identity/v3/projects/de5948556a9a4bdbbda19120cb054ce3 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:25.419199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:25.421496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:25.491270 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77445fe-e7fa-41dc-be18-d16198d2a29a admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:25.495934 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d15c35-f6f0-4948-8100-4916ce7c8ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:25.496797 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d15c35-f6f0-4948-8100-4916ce7c8ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:25.497075 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d15c35-f6f0-4948-8100-4916ce7c8ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:25.497346 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d15c35-f6f0-4948-8100-4916ce7c8ec9 admin admin] PATH_INFO: `/v3/users/265526c768c244d5a5c2022dc569943e` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:25.498594 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d15c35-f6f0-4948-8100-4916ce7c8ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=265526c768c244d5a5c2022dc569943e)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:25.500573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d15c35-f6f0-4948-8100-4916ce7c8ec9 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:25.508498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] The token cache is being invalidate because project 7e1b975328e84d31956aa673bc391f4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:25.508960 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.509703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.511431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1403/2802] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:25 2022] DELETE /identity/v3/projects/7e1b975328e84d31956aa673bc391f4c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:25.806679 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-35d15c35-f6f0-4948-8100-4916ce7c8ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '265526c768c244d5a5c2022dc569943e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.820264 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-35d15c35-f6f0-4948-8100-4916ce7c8ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '265526c768c244d5a5c2022dc569943e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.821003 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-35d15c35-f6f0-4948-8100-4916ce7c8ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '265526c768c244d5a5c2022dc569943e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.821607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-35d15c35-f6f0-4948-8100-4916ce7c8ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '265526c768c244d5a5c2022dc569943e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.891114 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-35d15c35-f6f0-4948-8100-4916ce7c8ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '265526c768c244d5a5c2022dc569943e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:25.907269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1400/2803] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:25 2022] DELETE /identity/v3/users/265526c768c244d5a5c2022dc569943e => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:26.396235 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:26.398415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:26.473265 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acfac817-19bb-4eae-b946-c33df8968a1b admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:26.485505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:26.534827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb54d6-aa87-424b-8c3a-a013075b31d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:26.536104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb54d6-aa87-424b-8c3a-a013075b31d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.536287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb54d6-aa87-424b-8c3a-a013075b31d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.536551 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb54d6-aa87-424b-8c3a-a013075b31d7 admin admin] PATH_INFO: `/v3/projects/f133a4916a3e4f61bb2d4c9bfd50e19b` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.537870 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb54d6-aa87-424b-8c3a-a013075b31d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f133a4916a3e4f61bb2d4c9bfd50e19b)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:26.539777 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcb54d6-aa87-424b-8c3a-a013075b31d7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:26.688749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4bcb54d6-aa87-424b-8c3a-a013075b31d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f133a4916a3e4f61bb2d4c9bfd50e19b', 'request_id': 'req-4bcb54d6-aa87-424b-8c3a-a013075b31d7'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:26.695126 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4bcb54d6-aa87-424b-8c3a-a013075b31d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f133a4916a3e4f61bb2d4c9bfd50e19b', 'request_id': 'req-4bcb54d6-aa87-424b-8c3a-a013075b31d7'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:26.703727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4bcb54d6-aa87-424b-8c3a-a013075b31d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f133a4916a3e4f61bb2d4c9bfd50e19b', 'request_id': 'req-4bcb54d6-aa87-424b-8c3a-a013075b31d7'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:26.777952 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4bcb54d6-aa87-424b-8c3a-a013075b31d7 admin admin] The token cache is being invalidate because project f133a4916a3e4f61bb2d4c9bfd50e19b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:26.778577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4bcb54d6-aa87-424b-8c3a-a013075b31d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:26.779890 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-4bcb54d6-aa87-424b-8c3a-a013075b31d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:26.782959 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1404/2804] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:26 2022] DELETE /identity/v3/projects/f133a4916a3e4f61bb2d4c9bfd50e19b => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:26.786691 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873da83-3599-4779-a43e-621713e1a0fd None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.787227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873da83-3599-4779-a43e-621713e1a0fd None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.787227 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4873da83-3599-4779-a43e-621713e1a0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.796126 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:26.808730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-4873da83-3599-4779-a43e-621713e1a0fd None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:26.813599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4873da83-3599-4779-a43e-621713e1a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:26.873925 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1401/2805] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:26.881844 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2a8e0-4fce-4723-b7d4-5d213995ffb2 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.882130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2a8e0-4fce-4723-b7d4-5d213995ffb2 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.882407 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2a8e0-4fce-4723-b7d4-5d213995ffb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.900884 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-53b2a8e0-4fce-4723-b7d4-5d213995ffb2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:26.907640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-53b2a8e0-4fce-4723-b7d4-5d213995ffb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:26.916788 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1405/2806] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:26.921700 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873da83-3599-4779-a43e-621713e1a0fd None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:26.931525 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4873da83-3599-4779-a43e-621713e1a0fd None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:26.936803 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a9c64-eda7-4503-9e03-178ca1415956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:26.937492 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a9c64-eda7-4503-9e03-178ca1415956 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.937874 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a9c64-eda7-4503-9e03-178ca1415956 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.938151 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a9c64-eda7-4503-9e03-178ca1415956 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.943173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a9c64-eda7-4503-9e03-178ca1415956 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:26.943173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a9c64-eda7-4503-9e03-178ca1415956 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:26.943173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20a9c64-eda7-4503-9e03-178ca1415956 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:26.953839 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1402/2807] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:18:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:26.958197 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2a8e0-4fce-4723-b7d4-5d213995ffb2 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:26.967542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2a8e0-4fce-4723-b7d4-5d213995ffb2 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:26.972437 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b41e6b-8901-4297-9448-176445161533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:26.973287 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b41e6b-8901-4297-9448-176445161533 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:26.973577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b41e6b-8901-4297-9448-176445161533 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:26.973857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b41e6b-8901-4297-9448-176445161533 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:26.974561 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b41e6b-8901-4297-9448-176445161533 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:26.976599 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b41e6b-8901-4297-9448-176445161533 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.059290 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a9c64-eda7-4503-9e03-178ca1415956 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.061660 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-b20a9c64-eda7-4503-9e03-178ca1415956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:27.073403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1406/2808] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:26 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:27.074499 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b41e6b-8901-4297-9448-176445161533 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.076455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a9c64-eda7-4503-9e03-178ca1415956 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.135501 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ff745-b6cd-46c4-b238-4c454a6a7a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.136598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ff745-b6cd-46c4-b238-4c454a6a7a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.136887 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ff745-b6cd-46c4-b238-4c454a6a7a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.137169 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ff745-b6cd-46c4-b238-4c454a6a7a4b admin admin] PATH_INFO: `/v3/users/2ec09c68457a4c858bb3365b05d3498e` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.138087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b41e6b-8901-4297-9448-176445161533 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.138515 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ff745-b6cd-46c4-b238-4c454a6a7a4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ec09c68457a4c858bb3365b05d3498e)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:27.141532 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9ff745-b6cd-46c4-b238-4c454a6a7a4b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.142909 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518c247-53b1-40c8-a5ae-12c2d466d255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.143581 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518c247-53b1-40c8-a5ae-12c2d466d255 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.143889 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518c247-53b1-40c8-a5ae-12c2d466d255 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.144167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2518c247-53b1-40c8-a5ae-12c2d466d255 admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.144868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518c247-53b1-40c8-a5ae-12c2d466d255 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:27.148312 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2518c247-53b1-40c8-a5ae-12c2d466d255 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.272458 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1407/2809] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:27 2022] POST /identity/v3/users => generated 287 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:27.276956 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518c247-53b1-40c8-a5ae-12c2d466d255 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.292148 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2518c247-53b1-40c8-a5ae-12c2d466d255 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.298599 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68b1e9-54de-412a-974f-e9cb59376c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.299140 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68b1e9-54de-412a-974f-e9cb59376c4c admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.299432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68b1e9-54de-412a-974f-e9cb59376c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.299711 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68b1e9-54de-412a-974f-e9cb59376c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.300488 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68b1e9-54de-412a-974f-e9cb59376c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:27.302218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be68b1e9-54de-412a-974f-e9cb59376c4c admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.304265 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:27.319155 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1408/2810] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:18:27.320195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68b1e9-54de-412a-974f-e9cb59376c4c admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.330038 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be68b1e9-54de-412a-974f-e9cb59376c4c admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.343374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367976cc-e61e-4867-8a80-a6db5daa6ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.344119 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367976cc-e61e-4867-8a80-a6db5daa6ddf admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.344403 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367976cc-e61e-4867-8a80-a6db5daa6ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.344977 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367976cc-e61e-4867-8a80-a6db5daa6ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.345415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367976cc-e61e-4867-8a80-a6db5daa6ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:27.347104 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367976cc-e61e-4867-8a80-a6db5daa6ddf admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.348333 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2f9ff745-b6cd-46c4-b238-4c454a6a7a4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ec09c68457a4c858bb3365b05d3498e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:27.359584 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1409/2811] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:27.363743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367976cc-e61e-4867-8a80-a6db5daa6ddf admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.364406 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2f9ff745-b6cd-46c4-b238-4c454a6a7a4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ec09c68457a4c858bb3365b05d3498e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:27.365115 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2f9ff745-b6cd-46c4-b238-4c454a6a7a4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ec09c68457a4c858bb3365b05d3498e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:27.365727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2f9ff745-b6cd-46c4-b238-4c454a6a7a4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ec09c68457a4c858bb3365b05d3498e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:27.374049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367976cc-e61e-4867-8a80-a6db5daa6ddf admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.378707 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d6927e-3886-45ce-a49a-b59385e2d215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.379583 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6927e-3886-45ce-a49a-b59385e2d215 admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.379904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6927e-3886-45ce-a49a-b59385e2d215 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.380188 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d6927e-3886-45ce-a49a-b59385e2d215 admin admin] PATH_INFO: `/v3/projects/52be28f1cdee4c0490e4ee4696240876/users/26556df02b1a4e88a78290833f356754/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.397542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6927e-3886-45ce-a49a-b59385e2d215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52be28f1cdee4c0490e4ee4696240876, user_id=26556df02b1a4e88a78290833f356754, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:27.400408 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d6927e-3886-45ce-a49a-b59385e2d215 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.451229 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2f9ff745-b6cd-46c4-b238-4c454a6a7a4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ec09c68457a4c858bb3365b05d3498e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:27.464716 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1403/2812] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:27 2022] DELETE /identity/v3/users/2ec09c68457a4c858bb3365b05d3498e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:27.469903 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4dee7-79df-43b4-baad-49ef97d2ff26 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.470222 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4dee7-79df-43b4-baad-49ef97d2ff26 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.470500 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c4dee7-79df-43b4-baad-49ef97d2ff26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.484983 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1410/2813] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:27 2022] PUT /identity/v3/projects/52be28f1cdee4c0490e4ee4696240876/users/26556df02b1a4e88a78290833f356754/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:18:27.489994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9792da7-1fb0-4092-8477-f4ab59f926a7 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.490289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9792da7-1fb0-4092-8477-f4ab59f926a7 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.490577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9792da7-1fb0-4092-8477-f4ab59f926a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.492162 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-46c4dee7-79df-43b4-baad-49ef97d2ff26 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:27.493390 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-46c4dee7-79df-43b4-baad-49ef97d2ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:27.499262 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:27.507879 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-f9792da7-1fb0-4092-8477-f4ab59f926a7 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:27.509130 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f9792da7-1fb0-4092-8477-f4ab59f926a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:27.562724 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1404/2814] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:27.579965 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4dee7-79df-43b4-baad-49ef97d2ff26 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.581466 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-46c4dee7-79df-43b4-baad-49ef97d2ff26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:27.608185 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1411/2815] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:27.621070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9792da7-1fb0-4092-8477-f4ab59f926a7 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:27.622456 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f9792da7-1fb0-4092-8477-f4ab59f926a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:27.651224 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c4dee7-79df-43b4-baad-49ef97d2ff26 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.655731 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15533be3-3d11-4be6-aa11-a6aa75336d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.656682 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15533be3-3d11-4be6-aa11-a6aa75336d44 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.657146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15533be3-3d11-4be6-aa11-a6aa75336d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.657929 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15533be3-3d11-4be6-aa11-a6aa75336d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.667959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15533be3-3d11-4be6-aa11-a6aa75336d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:27.669461 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15533be3-3d11-4be6-aa11-a6aa75336d44 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.680411 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1405/2816] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:27.683341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9792da7-1fb0-4092-8477-f4ab59f926a7 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:27.690387 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f35262-2b80-452a-94e6-04ba0c87ecb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:27.690387 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f35262-2b80-452a-94e6-04ba0c87ecb5 service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:27.690387 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f35262-2b80-452a-94e6-04ba0c87ecb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:27.690387 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f35262-2b80-452a-94e6-04ba0c87ecb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:27.701918 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f35262-2b80-452a-94e6-04ba0c87ecb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:27.703485 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f35262-2b80-452a-94e6-04ba0c87ecb5 service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:27.727613 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1412/2817] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:28.222261 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15533be3-3d11-4be6-aa11-a6aa75336d44 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:28.224865 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-15533be3-3d11-4be6-aa11-a6aa75336d44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:28.246067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15533be3-3d11-4be6-aa11-a6aa75336d44 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:28.251686 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f641ec28-6d1b-4520-a3f2-0005e0facc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:28.252666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ec28-6d1b-4520-a3f2-0005e0facc14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:28.253206 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ec28-6d1b-4520-a3f2-0005e0facc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:28.253507 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f641ec28-6d1b-4520-a3f2-0005e0facc14 admin admin] PATH_INFO: `/v3/projects/0f562eb955eb402ca23a00224f454905` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.254988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ec28-6d1b-4520-a3f2-0005e0facc14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f562eb955eb402ca23a00224f454905)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:28.256988 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f641ec28-6d1b-4520-a3f2-0005e0facc14 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:28.402096 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f641ec28-6d1b-4520-a3f2-0005e0facc14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f562eb955eb402ca23a00224f454905', 'request_id': 'req-f641ec28-6d1b-4520-a3f2-0005e0facc14'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:28.408313 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f641ec28-6d1b-4520-a3f2-0005e0facc14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f562eb955eb402ca23a00224f454905', 'request_id': 'req-f641ec28-6d1b-4520-a3f2-0005e0facc14'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:28.416991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f641ec28-6d1b-4520-a3f2-0005e0facc14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f562eb955eb402ca23a00224f454905', 'request_id': 'req-f641ec28-6d1b-4520-a3f2-0005e0facc14'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:28.543385 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f641ec28-6d1b-4520-a3f2-0005e0facc14 admin admin] The token cache is being invalidate because project 0f562eb955eb402ca23a00224f454905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75630) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:28.543684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f641ec28-6d1b-4520-a3f2-0005e0facc14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:28.544353 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-f641ec28-6d1b-4520-a3f2-0005e0facc14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:28.549915 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1406/2818] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:28 2022] DELETE /identity/v3/projects/0f562eb955eb402ca23a00224f454905 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:28.551772 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a90e3-4b66-450e-84f7-b34a61fec6b0 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:28.552316 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a90e3-4b66-450e-84f7-b34a61fec6b0 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:28.552477 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788a90e3-4b66-450e-84f7-b34a61fec6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.582761 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-788a90e3-4b66-450e-84f7-b34a61fec6b0 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:28.584222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-788a90e3-4b66-450e-84f7-b34a61fec6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:28.647298 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1413/2819] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:28.655047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872f4ad-91ae-46e6-98d0-28ddecf7b2b2 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:28.655328 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872f4ad-91ae-46e6-98d0-28ddecf7b2b2 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:28.655599 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872f4ad-91ae-46e6-98d0-28ddecf7b2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.674990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-7872f4ad-91ae-46e6-98d0-28ddecf7b2b2 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:28.676243 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-7872f4ad-91ae-46e6-98d0-28ddecf7b2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:28.684658 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1407/2820] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:28.689524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a90e3-4b66-450e-84f7-b34a61fec6b0 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:28.696816 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:28.700649 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788a90e3-4b66-450e-84f7-b34a61fec6b0 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:28.705891 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0da59a-24de-4319-bdb0-b8c4547b8190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:28.706597 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0da59a-24de-4319-bdb0-b8c4547b8190 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:28.709720 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0da59a-24de-4319-bdb0-b8c4547b8190 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:28.709720 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0da59a-24de-4319-bdb0-b8c4547b8190 admin admin] PATH_INFO: `/v3/domains` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.709720 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0da59a-24de-4319-bdb0-b8c4547b8190 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75629) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:28.709720 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0da59a-24de-4319-bdb0-b8c4547b8190 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:28.710112 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0da59a-24de-4319-bdb0-b8c4547b8190 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:28.723491 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1414/2821] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:18:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:28.728188 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872f4ad-91ae-46e6-98d0-28ddecf7b2b2 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:28.745911 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872f4ad-91ae-46e6-98d0-28ddecf7b2b2 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:28.751976 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00a1c8-f817-4c18-9f78-210c59c088d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:28.752674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00a1c8-f817-4c18-9f78-210c59c088d4 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:28.753100 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00a1c8-f817-4c18-9f78-210c59c088d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:28.753421 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00a1c8-f817-4c18-9f78-210c59c088d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.754146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00a1c8-f817-4c18-9f78-210c59c088d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:28.758730 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c00a1c8-f817-4c18-9f78-210c59c088d4 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:28.912913 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1408/2822] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:28 2022] POST /identity/v3/projects => generated 397 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:28.913934 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0da59a-24de-4319-bdb0-b8c4547b8190 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:28.925247 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0da59a-24de-4319-bdb0-b8c4547b8190 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:28.989609 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3ee17-a5eb-49f2-b8f3-6061753b568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:28.990560 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3ee17-a5eb-49f2-b8f3-6061753b568e admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:28.990837 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3ee17-a5eb-49f2-b8f3-6061753b568e admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:28.991113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3ee17-a5eb-49f2-b8f3-6061753b568e admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:28.991853 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3ee17-a5eb-49f2-b8f3-6061753b568e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:28.993852 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3ee17-a5eb-49f2-b8f3-6061753b568e admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:29.110432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1415/2823] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:28 2022] POST /identity/v3/users => generated 299 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:29.128496 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00a1c8-f817-4c18-9f78-210c59c088d4 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.139161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00a1c8-f817-4c18-9f78-210c59c088d4 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.144180 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b072eb9-50c5-40ad-aa61-992e75d201be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.144845 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072eb9-50c5-40ad-aa61-992e75d201be admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.145187 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072eb9-50c5-40ad-aa61-992e75d201be admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.145471 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b072eb9-50c5-40ad-aa61-992e75d201be admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.146190 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b072eb9-50c5-40ad-aa61-992e75d201be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:29.148048 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b072eb9-50c5-40ad-aa61-992e75d201be admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:29.150207 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:29.160644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1409/2824] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:29.171043 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3ee17-a5eb-49f2-b8f3-6061753b568e admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.175975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3ee17-a5eb-49f2-b8f3-6061753b568e admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.180815 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5197a-f37f-4e2a-b983-c16d7c26c5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.181482 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5197a-f37f-4e2a-b983-c16d7c26c5ea admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.181770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5197a-f37f-4e2a-b983-c16d7c26c5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.182055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5197a-f37f-4e2a-b983-c16d7c26c5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.182786 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5197a-f37f-4e2a-b983-c16d7c26c5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:29.184690 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5197a-f37f-4e2a-b983-c16d7c26c5ea admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:29.195927 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1416/2825] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:29.199613 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b072eb9-50c5-40ad-aa61-992e75d201be admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.210510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b072eb9-50c5-40ad-aa61-992e75d201be admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.215161 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcc665-0432-438c-a21b-a59e850d4ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.220447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcc665-0432-438c-a21b-a59e850d4ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.220447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcc665-0432-438c-a21b-a59e850d4ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.220447 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedcc665-0432-438c-a21b-a59e850d4ac8 admin admin] PATH_INFO: `/v3/projects/e71858d941084151b870673428e4fc96/users/be95bea0c8a1454dba20c830414388cd/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.233358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcc665-0432-438c-a21b-a59e850d4ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e71858d941084151b870673428e4fc96, user_id=be95bea0c8a1454dba20c830414388cd, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:29.236094 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedcc665-0432-438c-a21b-a59e850d4ac8 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:29.349673 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1410/2826] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:29 2022] PUT /identity/v3/projects/e71858d941084151b870673428e4fc96/users/be95bea0c8a1454dba20c830414388cd/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:29.361780 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159d7d-0976-43e1-b1f2-b00471b97d1f None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.362069 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159d7d-0976-43e1-b1f2-b00471b97d1f None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.362354 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e159d7d-0976-43e1-b1f2-b00471b97d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.403159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-5e159d7d-0976-43e1-b1f2-b00471b97d1f None None] MFA Rules not processed for user `be95bea0c8a1454dba20c830414388cd`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:29.404442 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-5e159d7d-0976-43e1-b1f2-b00471b97d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:29.482039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1417/2827] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:29.505194 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcc665-0432-438c-a21b-a59e850d4ac8 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.507265 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-fedcc665-0432-438c-a21b-a59e850d4ac8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:29.547847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea04da-e945-4c9a-ab23-88868856a443 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.547847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea04da-e945-4c9a-ab23-88868856a443 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.547847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea04da-e945-4c9a-ab23-88868856a443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.580186 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-82ea04da-e945-4c9a-ab23-88868856a443 None None] MFA Rules not processed for user `26556df02b1a4e88a78290833f356754`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:29.581434 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-82ea04da-e945-4c9a-ab23-88868856a443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:29.600282 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedcc665-0432-438c-a21b-a59e850d4ac8 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.607708 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe1b2c-0cd5-4e8f-b621-b0a64f088ec7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.608582 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe1b2c-0cd5-4e8f-b621-b0a64f088ec7 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.608898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe1b2c-0cd5-4e8f-b621-b0a64f088ec7 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.609240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe1b2c-0cd5-4e8f-b621-b0a64f088ec7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.619714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe1b2c-0cd5-4e8f-b621-b0a64f088ec7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:29.621917 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe1b2c-0cd5-4e8f-b621-b0a64f088ec7 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:29.631792 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1411/2828] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:29.636731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:29.661211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1418/2829] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:29.673930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe1b2c-0cd5-4e8f-b621-b0a64f088ec7 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.675297 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3ebe1b2c-0cd5-4e8f-b621-b0a64f088ec7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:29.750176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe1b2c-0cd5-4e8f-b621-b0a64f088ec7 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.755739 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38e449-7919-4649-9617-e4da6a6b4d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.756429 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38e449-7919-4649-9617-e4da6a6b4d8b admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.756709 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38e449-7919-4649-9617-e4da6a6b4d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.756981 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d38e449-7919-4649-9617-e4da6a6b4d8b admin admin] PATH_INFO: `/v3/projects` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.757666 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38e449-7919-4649-9617-e4da6a6b4d8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:29.760546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d38e449-7919-4649-9617-e4da6a6b4d8b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:29.854487 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1412/2830] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:29 2022] POST /identity/v3/projects => generated 371 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:29.857864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea04da-e945-4c9a-ab23-88868856a443 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:29.869576 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea04da-e945-4c9a-ab23-88868856a443 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:29.932447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b99d17-1203-49dd-93eb-21d976b2fbdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:29.933064 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b99d17-1203-49dd-93eb-21d976b2fbdd admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:29.933604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b99d17-1203-49dd-93eb-21d976b2fbdd admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:29.933885 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b99d17-1203-49dd-93eb-21d976b2fbdd admin admin] PATH_INFO: `/v3/users` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:29.934570 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b99d17-1203-49dd-93eb-21d976b2fbdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:29.937111 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b99d17-1203-49dd-93eb-21d976b2fbdd admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:30.040356 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1419/2831] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:29 2022] POST /identity/v3/users => generated 292 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:30.044392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38e449-7919-4649-9617-e4da6a6b4d8b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:30.055485 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d38e449-7919-4649-9617-e4da6a6b4d8b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:30.060397 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae4427-6799-42cb-8116-39eabb0e3503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:30.061648 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae4427-6799-42cb-8116-39eabb0e3503 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:30.061959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae4427-6799-42cb-8116-39eabb0e3503 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:30.062212 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae4427-6799-42cb-8116-39eabb0e3503 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:30.063053 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae4427-6799-42cb-8116-39eabb0e3503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:30.064694 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ae4427-6799-42cb-8116-39eabb0e3503 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:30.075573 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1413/2832] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:30.088878 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b99d17-1203-49dd-93eb-21d976b2fbdd admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:30.099690 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b99d17-1203-49dd-93eb-21d976b2fbdd admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:30.104476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c648518-abbf-4e28-85be-74bab5ce59ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:30.105374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c648518-abbf-4e28-85be-74bab5ce59ba admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:30.105663 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c648518-abbf-4e28-85be-74bab5ce59ba admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:30.105948 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c648518-abbf-4e28-85be-74bab5ce59ba admin admin] PATH_INFO: `/v3/projects/7e4be43919fe4005a6ca8749f880eec2/users/8d9347392bb3404da5fc7765adc590d9/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:30.123573 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c648518-abbf-4e28-85be-74bab5ce59ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4be43919fe4005a6ca8749f880eec2, user_id=8d9347392bb3404da5fc7765adc590d9, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:30.126817 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c648518-abbf-4e28-85be-74bab5ce59ba admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:30.240777 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1420/2833] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:30 2022] PUT /identity/v3/projects/7e4be43919fe4005a6ca8749f880eec2/users/8d9347392bb3404da5fc7765adc590d9/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:30.244947 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae4427-6799-42cb-8116-39eabb0e3503 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:30.256052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae4427-6799-42cb-8116-39eabb0e3503 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:30.318815 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:30.328692 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a8bfff-3249-4329-912c-dfa0d21ab306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:30.329362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8bfff-3249-4329-912c-dfa0d21ab306 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:30.329644 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8bfff-3249-4329-912c-dfa0d21ab306 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:30.329920 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a8bfff-3249-4329-912c-dfa0d21ab306 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:30.330642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8bfff-3249-4329-912c-dfa0d21ab306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:30.332285 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a8bfff-3249-4329-912c-dfa0d21ab306 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:30.343866 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1414/2834] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:30.348222 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c648518-abbf-4e28-85be-74bab5ce59ba admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:30.359505 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c648518-abbf-4e28-85be-74bab5ce59ba admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:30.364291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2cec3-8128-41b8-8365-afe7fc9799cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:30.365171 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2cec3-8128-41b8-8365-afe7fc9799cd admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:30.365455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2cec3-8128-41b8-8365-afe7fc9799cd admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:30.365733 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2cec3-8128-41b8-8365-afe7fc9799cd admin admin] PATH_INFO: `/v3/projects/7e4be43919fe4005a6ca8749f880eec2/users/8d9347392bb3404da5fc7765adc590d9/roles/8e02985a870646e28fbd44e3b3a3c800` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:30.367796 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2cec3-8128-41b8-8365-afe7fc9799cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e4be43919fe4005a6ca8749f880eec2, user_id=8d9347392bb3404da5fc7765adc590d9, role_id=8e02985a870646e28fbd44e3b3a3c800)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:30.370471 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce2cec3-8128-41b8-8365-afe7fc9799cd admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:30.381553 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1421/2835] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:30 2022] PUT /identity/v3/projects/7e4be43919fe4005a6ca8749f880eec2/users/8d9347392bb3404da5fc7765adc590d9/roles/8e02985a870646e28fbd44e3b3a3c800 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:31.914574 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714c86a-560f-46b4-87ed-87aa3fce284f None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:31.915172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714c86a-560f-46b4-87ed-87aa3fce284f None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:31.915172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a714c86a-560f-46b4-87ed-87aa3fce284f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:31.946141 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-a714c86a-560f-46b4-87ed-87aa3fce284f None None] MFA Rules not processed for user `8d9347392bb3404da5fc7765adc590d9`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:31.947432 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a714c86a-560f-46b4-87ed-87aa3fce284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:32.022794 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1415/2836] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:31 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:32.035305 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872c7ae-b8c6-467b-acd8-6dbdea13fa88 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:32.035957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872c7ae-b8c6-467b-acd8-6dbdea13fa88 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:32.036132 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9872c7ae-b8c6-467b-acd8-6dbdea13fa88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:32.056705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-9872c7ae-b8c6-467b-acd8-6dbdea13fa88 None None] MFA Rules not processed for user `26556df02b1a4e88a78290833f356754`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:32.057961 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9872c7ae-b8c6-467b-acd8-6dbdea13fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:32.114848 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1422/2837] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:32.136510 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714c86a-560f-46b4-87ed-87aa3fce284f None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:32.137923 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a714c86a-560f-46b4-87ed-87aa3fce284f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:32.210795 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a714c86a-560f-46b4-87ed-87aa3fce284f None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:32.216279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bafea-d92a-4f7c-b48f-b53ebddba22c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a020e7fe06574a108b46f9f48bddc4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'ResellerAdmin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:32.216918 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bafea-d92a-4f7c-b48f-b53ebddba22c service nova] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:32.217199 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bafea-d92a-4f7c-b48f-b53ebddba22c service nova] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:32.217472 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2bafea-d92a-4f7c-b48f-b53ebddba22c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:32.225205 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bafea-d92a-4f7c-b48f-b53ebddba22c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:32.226791 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2bafea-d92a-4f7c-b48f-b53ebddba22c service nova] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:32.236358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1416/2838] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:34.347227 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872c7ae-b8c6-467b-acd8-6dbdea13fa88 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:34.348688 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-9872c7ae-b8c6-467b-acd8-6dbdea13fa88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:34.399992 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:34.421178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9872c7ae-b8c6-467b-acd8-6dbdea13fa88 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:34.426165 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227d0f2-f24f-4b3c-b748-f41d28b70fb6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e838dd9aa24f4571b64719125610c528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:34.426823 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227d0f2-f24f-4b3c-b748-f41d28b70fb6 service placement] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:34.427102 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227d0f2-f24f-4b3c-b748-f41d28b70fb6 service placement] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:34.427377 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227d0f2-f24f-4b3c-b748-f41d28b70fb6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:34.429182 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-7227d0f2-f24f-4b3c-b748-f41d28b70fb6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:34.441418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227d0f2-f24f-4b3c-b748-f41d28b70fb6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:34.442993 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227d0f2-f24f-4b3c-b748-f41d28b70fb6 service placement] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:34.452866 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1423/2839] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:35.849352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bafea-d92a-4f7c-b48f-b53ebddba22c service nova] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:35.914225 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=100 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:35.919392 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2bafea-d92a-4f7c-b48f-b53ebddba22c service nova] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:35.926667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:35.927778 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:35.928183 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:35.928583 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] PATH_INFO: `/v3/users/be95bea0c8a1454dba20c830414388cd` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:35.929922 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be95bea0c8a1454dba20c830414388cd)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:35.932133 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:36.136113 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be95bea0c8a1454dba20c830414388cd'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:36.150431 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be95bea0c8a1454dba20c830414388cd'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:36.151623 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be95bea0c8a1454dba20c830414388cd'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:36.152268 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be95bea0c8a1454dba20c830414388cd'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:36.286266 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be95bea0c8a1454dba20c830414388cd'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:36.305269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1417/2840] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:35 2022] DELETE /identity/v3/users/be95bea0c8a1454dba20c830414388cd => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:36.310400 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302e0b-1bd5-4148-8121-342ed04dac9b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:36.310957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302e0b-1bd5-4148-8121-342ed04dac9b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:36.310957 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12302e0b-1bd5-4148-8121-342ed04dac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:36.332869 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-12302e0b-1bd5-4148-8121-342ed04dac9b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:36.336195 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-12302e0b-1bd5-4148-8121-342ed04dac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:36.399743 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1424/2841] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:36.412047 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:36.413770 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:36.491262 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950341ad-e8d8-460d-badf-f897dd67e5a7 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:36.493236 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fbd55-0cdb-400d-9de6-21daba4fb4d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:36.493909 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fbd55-0cdb-400d-9de6-21daba4fb4d7 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:36.494177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fbd55-0cdb-400d-9de6-21daba4fb4d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:36.494459 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6fbd55-0cdb-400d-9de6-21daba4fb4d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:36.504428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fbd55-0cdb-400d-9de6-21daba4fb4d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:36.505877 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6fbd55-0cdb-400d-9de6-21daba4fb4d7 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:36.517725 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1418/2842] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:37.047732 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302e0b-1bd5-4148-8121-342ed04dac9b None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:37.049843 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-12302e0b-1bd5-4148-8121-342ed04dac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:37.069080 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12302e0b-1bd5-4148-8121-342ed04dac9b None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:37.076806 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:37.077689 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:37.077966 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:37.078237 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb admin admin] PATH_INFO: `/v3/projects/e71858d941084151b870673428e4fc96` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:37.080030 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e71858d941084151b870673428e4fc96)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:37.081524 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:37.199142 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e71858d941084151b870673428e4fc96', 'request_id': 'req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:37.206617 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e71858d941084151b870673428e4fc96', 'request_id': 'req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:37.213900 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e71858d941084151b870673428e4fc96', 'request_id': 'req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:37.332065 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb admin admin] The token cache is being invalidate because project e71858d941084151b870673428e4fc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:37.333113 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:37.333782 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-5b0bdfdb-9ccc-4445-a71d-d1d9b8fb72eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:37.335964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1425/2843] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:37 2022] DELETE /identity/v3/projects/e71858d941084151b870673428e4fc96 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:37.493248 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fbd55-0cdb-400d-9de6-21daba4fb4d7 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:37.495677 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-bc6fbd55-0cdb-400d-9de6-21daba4fb4d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:37.510306 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6fbd55-0cdb-400d-9de6-21daba4fb4d7 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:37.607693 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:37.608598 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:37.608888 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:37.610639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] PATH_INFO: `/v3/users/32094a91a51a46539141fe361c45bcca` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:37.610639 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32094a91a51a46539141fe361c45bcca)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:37.612430 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:37.634463 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:37.858845 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32094a91a51a46539141fe361c45bcca'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:37.871508 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32094a91a51a46539141fe361c45bcca'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:37.872302 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32094a91a51a46539141fe361c45bcca'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:37.872924 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32094a91a51a46539141fe361c45bcca'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:37.942043 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32094a91a51a46539141fe361c45bcca'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:37.955720 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1419/2844] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:37 2022] DELETE /identity/v3/users/32094a91a51a46539141fe361c45bcca => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:37.960416 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85fcb6-183f-4da2-9849-0ec741ca7841 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:37.960708 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85fcb6-183f-4da2-9849-0ec741ca7841 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:37.960986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85fcb6-183f-4da2-9849-0ec741ca7841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:37.978360 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-fa85fcb6-183f-4da2-9849-0ec741ca7841 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:37.979567 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-fa85fcb6-183f-4da2-9849-0ec741ca7841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:38.030904 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:38.039543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1426/2845] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:38.049149 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:38.050570 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:38.109041 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d012cb49-6b6c-47fb-8ff9-cc055c6e7e86 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:38.113213 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c21a79-79c1-4777-b412-303a19c227ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:38.116294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c21a79-79c1-4777-b412-303a19c227ca service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:38.116294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c21a79-79c1-4777-b412-303a19c227ca service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:38.116294 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c21a79-79c1-4777-b412-303a19c227ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:38.123897 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c21a79-79c1-4777-b412-303a19c227ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:38.125340 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c21a79-79c1-4777-b412-303a19c227ca service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:38.135741 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1420/2846] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:38.857464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85fcb6-183f-4da2-9849-0ec741ca7841 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:38.859090 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-fa85fcb6-183f-4da2-9849-0ec741ca7841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:38.872344 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85fcb6-183f-4da2-9849-0ec741ca7841 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:38.877070 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b493fcdd-2715-4603-8396-30b9f3e333d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:38.877981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493fcdd-2715-4603-8396-30b9f3e333d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:38.878259 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493fcdd-2715-4603-8396-30b9f3e333d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:38.878542 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b493fcdd-2715-4603-8396-30b9f3e333d7 admin admin] PATH_INFO: `/v3/projects/1ee26f63bc87418e89e357824ea38774` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:38.879763 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493fcdd-2715-4603-8396-30b9f3e333d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ee26f63bc87418e89e357824ea38774)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:38.884974 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b493fcdd-2715-4603-8396-30b9f3e333d7 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:39.020128 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b493fcdd-2715-4603-8396-30b9f3e333d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ee26f63bc87418e89e357824ea38774', 'request_id': 'req-b493fcdd-2715-4603-8396-30b9f3e333d7'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:39.026435 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b493fcdd-2715-4603-8396-30b9f3e333d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ee26f63bc87418e89e357824ea38774', 'request_id': 'req-b493fcdd-2715-4603-8396-30b9f3e333d7'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:39.032275 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b493fcdd-2715-4603-8396-30b9f3e333d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ee26f63bc87418e89e357824ea38774', 'request_id': 'req-b493fcdd-2715-4603-8396-30b9f3e333d7'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:39.143134 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b493fcdd-2715-4603-8396-30b9f3e333d7 admin admin] The token cache is being invalidate because project 1ee26f63bc87418e89e357824ea38774 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:39.143913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b493fcdd-2715-4603-8396-30b9f3e333d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:39.144577 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-b493fcdd-2715-4603-8396-30b9f3e333d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:39.146218 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1427/2847] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:38 2022] DELETE /identity/v3/projects/1ee26f63bc87418e89e357824ea38774 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:39.151452 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6655247-a2cf-4614-a4ed-4fa39569966e None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.152068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6655247-a2cf-4614-a4ed-4fa39569966e None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.152068 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6655247-a2cf-4614-a4ed-4fa39569966e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.170251 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-e6655247-a2cf-4614-a4ed-4fa39569966e None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:39.171454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-e6655247-a2cf-4614-a4ed-4fa39569966e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:39.232424 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1421/2848] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:39.241460 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8febd22-079a-4320-b46f-b0779934952b None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.241755 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8febd22-079a-4320-b46f-b0779934952b None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.242041 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8febd22-079a-4320-b46f-b0779934952b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.260760 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-a8febd22-079a-4320-b46f-b0779934952b None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:39.261979 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-a8febd22-079a-4320-b46f-b0779934952b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:39.270557 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1428/2849] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:39.274948 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6655247-a2cf-4614-a4ed-4fa39569966e None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:39.285152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6655247-a2cf-4614-a4ed-4fa39569966e None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:39.289907 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aff8ea-87ea-4874-9210-9fc1ddb2e339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:39.290571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff8ea-87ea-4874-9210-9fc1ddb2e339 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.290849 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff8ea-87ea-4874-9210-9fc1ddb2e339 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.291148 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4aff8ea-87ea-4874-9210-9fc1ddb2e339 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.291910 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aff8ea-87ea-4874-9210-9fc1ddb2e339 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:39.292296 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aff8ea-87ea-4874-9210-9fc1ddb2e339 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:39.293830 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4aff8ea-87ea-4874-9210-9fc1ddb2e339 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:39.307060 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1422/2850] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:18:39.311964 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8febd22-079a-4320-b46f-b0779934952b None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:39.322322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8febd22-079a-4320-b46f-b0779934952b None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:39.327055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d916527-1718-4052-b0a3-ccccbbd07384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:39.327703 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d916527-1718-4052-b0a3-ccccbbd07384 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.328706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d916527-1718-4052-b0a3-ccccbbd07384 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.328706 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d916527-1718-4052-b0a3-ccccbbd07384 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.329190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d916527-1718-4052-b0a3-ccccbbd07384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:39.331638 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d916527-1718-4052-b0a3-ccccbbd07384 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:39.419160 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1429/2851] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:39 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:39.423617 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aff8ea-87ea-4874-9210-9fc1ddb2e339 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:39.434386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4aff8ea-87ea-4874-9210-9fc1ddb2e339 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:39.461591 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:39.494475 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76da62-b383-46ed-9711-d0de75356742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:39.495324 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76da62-b383-46ed-9711-d0de75356742 admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.495838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76da62-b383-46ed-9711-d0de75356742 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.496564 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf76da62-b383-46ed-9711-d0de75356742 admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.497311 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76da62-b383-46ed-9711-d0de75356742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:39.499247 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf76da62-b383-46ed-9711-d0de75356742 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:39.634491 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1423/2852] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:39 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 23 11:18:39.638922 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d916527-1718-4052-b0a3-ccccbbd07384 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:39.651311 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d916527-1718-4052-b0a3-ccccbbd07384 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:39.656099 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55f69a-4e57-4361-a8c2-7d99ce0db651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:39.656764 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55f69a-4e57-4361-a8c2-7d99ce0db651 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.657081 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55f69a-4e57-4361-a8c2-7d99ce0db651 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.658156 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd55f69a-4e57-4361-a8c2-7d99ce0db651 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.658749 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55f69a-4e57-4361-a8c2-7d99ce0db651 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:39.660452 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd55f69a-4e57-4361-a8c2-7d99ce0db651 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:39.671289 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1430/2853] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:39.675289 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76da62-b383-46ed-9711-d0de75356742 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:39.685952 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf76da62-b383-46ed-9711-d0de75356742 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:39.691451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b4ea4-d25e-4123-93f3-ba1821ad2285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:39.691916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4ea4-d25e-4123-93f3-ba1821ad2285 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.692201 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4ea4-d25e-4123-93f3-ba1821ad2285 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.692480 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b4ea4-d25e-4123-93f3-ba1821ad2285 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.693220 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b4ea4-d25e-4123-93f3-ba1821ad2285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:39.694855 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b4ea4-d25e-4123-93f3-ba1821ad2285 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:39.705974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1424/2854] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:18:39.710398 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55f69a-4e57-4361-a8c2-7d99ce0db651 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:39.720975 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd55f69a-4e57-4361-a8c2-7d99ce0db651 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:39.725756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8244b1c-08ae-4563-8b15-346a4c0bc3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:39.726646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8244b1c-08ae-4563-8b15-346a4c0bc3ea admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:39.726968 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8244b1c-08ae-4563-8b15-346a4c0bc3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:39.727274 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8244b1c-08ae-4563-8b15-346a4c0bc3ea admin admin] PATH_INFO: `/v3/projects/f9943e9d374646188502563a50825bd3/users/7a23e56179344c5b987df7d34de8b1fa/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:39.743124 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8244b1c-08ae-4563-8b15-346a4c0bc3ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9943e9d374646188502563a50825bd3, user_id=7a23e56179344c5b987df7d34de8b1fa, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:39.745870 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8244b1c-08ae-4563-8b15-346a4c0bc3ea admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:40.034666 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1431/2855] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:39 2022] PUT /identity/v3/projects/f9943e9d374646188502563a50825bd3/users/7a23e56179344c5b987df7d34de8b1fa/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:40.045481 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcc196-0b3e-4758-9407-a14fcd5f29cf None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:40.045747 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcc196-0b3e-4758-9407-a14fcd5f29cf None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:40.046026 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adcc196-0b3e-4758-9407-a14fcd5f29cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:40.077484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-3adcc196-0b3e-4758-9407-a14fcd5f29cf None None] MFA Rules not processed for user `7a23e56179344c5b987df7d34de8b1fa`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:40.078826 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3adcc196-0b3e-4758-9407-a14fcd5f29cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:40.144482 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1425/2856] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:40.155907 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8244b1c-08ae-4563-8b15-346a4c0bc3ea admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:40.157627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f8244b1c-08ae-4563-8b15-346a4c0bc3ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:40.215436 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8244b1c-08ae-4563-8b15-346a4c0bc3ea admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:40.218923 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e73b6-4d44-44b5-a8e9-c629162e0cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:40.219558 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e73b6-4d44-44b5-a8e9-c629162e0cec service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:40.219906 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e73b6-4d44-44b5-a8e9-c629162e0cec service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:40.220176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e73b6-4d44-44b5-a8e9-c629162e0cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:40.228564 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e73b6-4d44-44b5-a8e9-c629162e0cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:40.229986 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e73b6-4d44-44b5-a8e9-c629162e0cec service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:40.238731 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1432/2857] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 23 11:18:42.736377 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcc196-0b3e-4758-9407-a14fcd5f29cf None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:42.738022 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-3adcc196-0b3e-4758-9407-a14fcd5f29cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:42.814273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adcc196-0b3e-4758-9407-a14fcd5f29cf None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:42.818423 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cc491-ba5c-4edc-a309-e8ff219b3f17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:42.819146 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cc491-ba5c-4edc-a309-e8ff219b3f17 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:42.819552 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cc491-ba5c-4edc-a309-e8ff219b3f17 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:42.819924 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167cc491-ba5c-4edc-a309-e8ff219b3f17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:42.821784 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-167cc491-ba5c-4edc-a309-e8ff219b3f17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:42.832812 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cc491-ba5c-4edc-a309-e8ff219b3f17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:42.834308 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167cc491-ba5c-4edc-a309-e8ff219b3f17 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:42.842974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1426/2858] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:42.919864 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e73b6-4d44-44b5-a8e9-c629162e0cec service cinder] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:42.929685 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e73b6-4d44-44b5-a8e9-c629162e0cec service cinder] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:42.933873 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55e3ad8-21be-42bc-b330-c4d667ec7d2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:42.934521 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e3ad8-21be-42bc-b330-c4d667ec7d2f service neutron] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:42.934827 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e3ad8-21be-42bc-b330-c4d667ec7d2f service neutron] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:42.935211 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55e3ad8-21be-42bc-b330-c4d667ec7d2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:42.937042 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-d55e3ad8-21be-42bc-b330-c4d667ec7d2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:42.958028 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:43.016393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e3ad8-21be-42bc-b330-c4d667ec7d2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:43.018478 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55e3ad8-21be-42bc-b330-c4d667ec7d2f service neutron] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:43.030418 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1433/2859] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:43.629171 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cc491-ba5c-4edc-a309-e8ff219b3f17 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:43.681970 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:43.703945 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167cc491-ba5c-4edc-a309-e8ff219b3f17 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:43.708806 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:43.709714 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:43.710109 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:43.710386 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] PATH_INFO: `/v3/users/7a23e56179344c5b987df7d34de8b1fa` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:43.711568 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a23e56179344c5b987df7d34de8b1fa)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:43.713656 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:43.949119 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a23e56179344c5b987df7d34de8b1fa'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:43.965968 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a23e56179344c5b987df7d34de8b1fa'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:43.971158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a23e56179344c5b987df7d34de8b1fa'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:43.971158 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a23e56179344c5b987df7d34de8b1fa'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:44.044838 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a23e56179344c5b987df7d34de8b1fa'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:44.058609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1427/2860] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:43 2022] DELETE /identity/v3/users/7a23e56179344c5b987df7d34de8b1fa => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:44.063176 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61876ea-ce4f-416b-9112-f66a15fb1148 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:44.063684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61876ea-ce4f-416b-9112-f66a15fb1148 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:44.063790 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61876ea-ce4f-416b-9112-f66a15fb1148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:44.082109 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-e61876ea-ce4f-416b-9112-f66a15fb1148 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:44.083431 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e61876ea-ce4f-416b-9112-f66a15fb1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:44.143229 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1434/2861] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:44.153132 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:44.154578 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:44.212634 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96f783-0e7d-48aa-874e-b64c72cbca9b admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:44.216375 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a3a70-8cad-4a52-acc2-af43da8fd276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:44.217046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a3a70-8cad-4a52-acc2-af43da8fd276 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:44.217334 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a3a70-8cad-4a52-acc2-af43da8fd276 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:44.217615 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a3a70-8cad-4a52-acc2-af43da8fd276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:44.232959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a3a70-8cad-4a52-acc2-af43da8fd276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:44.232959 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a3a70-8cad-4a52-acc2-af43da8fd276 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:44.240569 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1428/2862] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:44.871799 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61876ea-ce4f-416b-9112-f66a15fb1148 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:44.873590 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-e61876ea-ce4f-416b-9112-f66a15fb1148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:44.888811 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61876ea-ce4f-416b-9112-f66a15fb1148 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:44.895669 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ce57a-1288-46be-841d-b4a6b99f39bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:44.896976 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ce57a-1288-46be-841d-b4a6b99f39bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:44.897497 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ce57a-1288-46be-841d-b4a6b99f39bf admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:44.898016 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ce57a-1288-46be-841d-b4a6b99f39bf admin admin] PATH_INFO: `/v3/projects/f9943e9d374646188502563a50825bd3` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:44.899981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ce57a-1288-46be-841d-b4a6b99f39bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9943e9d374646188502563a50825bd3)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:44.903450 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ce57a-1288-46be-841d-b4a6b99f39bf admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:45.093913 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c54ce57a-1288-46be-841d-b4a6b99f39bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9943e9d374646188502563a50825bd3', 'request_id': 'req-c54ce57a-1288-46be-841d-b4a6b99f39bf'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:45.105523 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c54ce57a-1288-46be-841d-b4a6b99f39bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9943e9d374646188502563a50825bd3', 'request_id': 'req-c54ce57a-1288-46be-841d-b4a6b99f39bf'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:45.112440 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c54ce57a-1288-46be-841d-b4a6b99f39bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9943e9d374646188502563a50825bd3', 'request_id': 'req-c54ce57a-1288-46be-841d-b4a6b99f39bf'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:45.194679 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c54ce57a-1288-46be-841d-b4a6b99f39bf admin admin] The token cache is being invalidate because project f9943e9d374646188502563a50825bd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:45.195017 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c54ce57a-1288-46be-841d-b4a6b99f39bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:45.196093 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-c54ce57a-1288-46be-841d-b4a6b99f39bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:45.197654 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1435/2863] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:44 2022] DELETE /identity/v3/projects/f9943e9d374646188502563a50825bd3 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:45.202626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0b4ef-9c03-49eb-9475-9968aea58a39 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.203108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0b4ef-9c03-49eb-9475-9968aea58a39 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.203108 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e0b4ef-9c03-49eb-9475-9968aea58a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.223672 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-53e0b4ef-9c03-49eb-9475-9968aea58a39 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:45.227930 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-53e0b4ef-9c03-49eb-9475-9968aea58a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:45.292152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1429/2864] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 23 11:18:45.299944 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874bc3a-18e9-4de5-99c2-31361b704c59 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.300265 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874bc3a-18e9-4de5-99c2-31361b704c59 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.300571 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0874bc3a-18e9-4de5-99c2-31361b704c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.322708 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0874bc3a-18e9-4de5-99c2-31361b704c59 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:45.324095 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0874bc3a-18e9-4de5-99c2-31361b704c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:45.337664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1436/2865] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:45.342809 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0b4ef-9c03-49eb-9475-9968aea58a39 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:45.346572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:45.352176 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e0b4ef-9c03-49eb-9475-9968aea58a39 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:45.356898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d9f00-c9fb-4cc0-a42a-29dde3ef2e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:45.357554 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9f00-c9fb-4cc0-a42a-29dde3ef2e86 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.357867 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9f00-c9fb-4cc0-a42a-29dde3ef2e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.358121 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d9f00-c9fb-4cc0-a42a-29dde3ef2e86 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.358879 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d9f00-c9fb-4cc0-a42a-29dde3ef2e86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:18:45.359186 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d9f00-c9fb-4cc0-a42a-29dde3ef2e86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:45.360857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d9f00-c9fb-4cc0-a42a-29dde3ef2e86 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:45.373885 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1430/2866] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:18:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 23 11:18:45.379307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874bc3a-18e9-4de5-99c2-31361b704c59 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:45.389246 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0874bc3a-18e9-4de5-99c2-31361b704c59 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:45.394671 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5824e-217d-4ede-8322-395f6249c5b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:45.395332 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5824e-217d-4ede-8322-395f6249c5b9 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.395618 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5824e-217d-4ede-8322-395f6249c5b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.395937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5824e-217d-4ede-8322-395f6249c5b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.396635 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5824e-217d-4ede-8322-395f6249c5b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:45.398601 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5824e-217d-4ede-8322-395f6249c5b9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:45.527046 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1437/2867] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:18:45 2022] POST /identity/v3/projects => generated 373 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:45.531446 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d9f00-c9fb-4cc0-a42a-29dde3ef2e86 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:45.541990 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d9f00-c9fb-4cc0-a42a-29dde3ef2e86 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:45.598689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0fe5-6fbc-4850-82ac-8aaef78ed1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:45.599356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0fe5-6fbc-4850-82ac-8aaef78ed1ea admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.599635 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0fe5-6fbc-4850-82ac-8aaef78ed1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.599948 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb0fe5-6fbc-4850-82ac-8aaef78ed1ea admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.600689 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb0fe5-6fbc-4850-82ac-8aaef78ed1ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:45.602588 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb0fe5-6fbc-4850-82ac-8aaef78ed1ea admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:45.721123 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1431/2868] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:18:45 2022] POST /identity/v3/users => generated 287 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:18:45.725231 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5824e-217d-4ede-8322-395f6249c5b9 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:45.730949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:45.736055 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5824e-217d-4ede-8322-395f6249c5b9 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:45.740771 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1665f4e-4b68-40d4-8c1b-133e62fc00dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:45.741430 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665f4e-4b68-40d4-8c1b-133e62fc00dd admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.741728 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665f4e-4b68-40d4-8c1b-133e62fc00dd admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.741999 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1665f4e-4b68-40d4-8c1b-133e62fc00dd admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.742723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1665f4e-4b68-40d4-8c1b-133e62fc00dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:45.744372 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1665f4e-4b68-40d4-8c1b-133e62fc00dd admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:45.755673 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1438/2869] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:45.765058 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0fe5-6fbc-4850-82ac-8aaef78ed1ea admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:45.776000 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb0fe5-6fbc-4850-82ac-8aaef78ed1ea admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:45.780991 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7836d453-f3fd-4974-9c08-a3668ff853ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:45.781572 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836d453-f3fd-4974-9c08-a3668ff853ab admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.781858 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836d453-f3fd-4974-9c08-a3668ff853ab admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.782785 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7836d453-f3fd-4974-9c08-a3668ff853ab admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.783519 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836d453-f3fd-4974-9c08-a3668ff853ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:45.785177 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7836d453-f3fd-4974-9c08-a3668ff853ab admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:45.795833 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1432/2870] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:18:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:18:45.800049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1665f4e-4b68-40d4-8c1b-133e62fc00dd admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:45.810856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1665f4e-4b68-40d4-8c1b-133e62fc00dd admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:45.815849 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91629db0-148f-49ad-81cb-3588cb383c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:45.816740 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91629db0-148f-49ad-81cb-3588cb383c3f admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.817025 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91629db0-148f-49ad-81cb-3588cb383c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.817301 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91629db0-148f-49ad-81cb-3588cb383c3f admin admin] PATH_INFO: `/v3/projects/2df5d16edd154df4a5c4dc01eef618ad/users/dcc5336c97fa4fdba48fb20ff20da752/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.832627 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91629db0-148f-49ad-81cb-3588cb383c3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2df5d16edd154df4a5c4dc01eef618ad, user_id=dcc5336c97fa4fdba48fb20ff20da752, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:45.835270 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91629db0-148f-49ad-81cb-3588cb383c3f admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:45.909981 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1439/2871] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:18:45 2022] PUT /identity/v3/projects/2df5d16edd154df4a5c4dc01eef618ad/users/dcc5336c97fa4fdba48fb20ff20da752/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:45.926859 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526a820-b560-47dd-8f91-5973d4f41992 None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:45.927179 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526a820-b560-47dd-8f91-5973d4f41992 None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:45.927462 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526a820-b560-47dd-8f91-5973d4f41992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:45.957652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-f526a820-b560-47dd-8f91-5973d4f41992 None None] MFA Rules not processed for user `dcc5336c97fa4fdba48fb20ff20da752`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:45.957652 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-f526a820-b560-47dd-8f91-5973d4f41992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:46.033210 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1433/2872] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:45 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:46.044362 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91629db0-148f-49ad-81cb-3588cb383c3f admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:46.046157 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-91629db0-148f-49ad-81cb-3588cb383c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:46.109535 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91629db0-148f-49ad-81cb-3588cb383c3f admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:46.114079 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bc75f3-f5c4-4be4-bd22-c9f0b22bb080 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:46.114727 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc75f3-f5c4-4be4-bd22-c9f0b22bb080 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.115074 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc75f3-f5c4-4be4-bd22-c9f0b22bb080 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.115423 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bc75f3-f5c4-4be4-bd22-c9f0b22bb080 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.124996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc75f3-f5c4-4be4-bd22-c9f0b22bb080 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:46.126647 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bc75f3-f5c4-4be4-bd22-c9f0b22bb080 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:46.137991 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1440/2873] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:46.163076 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526a820-b560-47dd-8f91-5973d4f41992 None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:46.232668 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:46.237916 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526a820-b560-47dd-8f91-5973d4f41992 None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:46.242771 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:46.243754 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.250592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.250592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] PATH_INFO: `/v3/users/dcc5336c97fa4fdba48fb20ff20da752` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.250592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcc5336c97fa4fdba48fb20ff20da752)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:46.250592 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:46.430780 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcc5336c97fa4fdba48fb20ff20da752'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:46.443286 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcc5336c97fa4fdba48fb20ff20da752'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:46.445410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcc5336c97fa4fdba48fb20ff20da752'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:46.445410 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcc5336c97fa4fdba48fb20ff20da752'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:46.518984 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcc5336c97fa4fdba48fb20ff20da752'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:46.531952 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1434/2874] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:18:46 2022] DELETE /identity/v3/users/dcc5336c97fa4fdba48fb20ff20da752 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:46.537178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec08b8d-0141-4485-b432-60e25744b292 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.537393 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec08b8d-0141-4485-b432-60e25744b292 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.537680 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec08b8d-0141-4485-b432-60e25744b292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.554779 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-dec08b8d-0141-4485-b432-60e25744b292 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:18:46.559082 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-dec08b8d-0141-4485-b432-60e25744b292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:46.620464 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1441/2875] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:18:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:18:46.631587 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:46.633067 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:46.697857 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1724661b-9ce1-415b-91fc-0c2ebfce80a5 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:46.701619 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e8921-b785-4265-b1e0-36192ce7c447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:46.702275 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e8921-b785-4265-b1e0-36192ce7c447 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:46.702562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e8921-b785-4265-b1e0-36192ce7c447 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:46.702841 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5e8921-b785-4265-b1e0-36192ce7c447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:46.714551 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e8921-b785-4265-b1e0-36192ce7c447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:46.716093 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5e8921-b785-4265-b1e0-36192ce7c447 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:46.728525 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1435/2876] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:47.297744 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec08b8d-0141-4485-b432-60e25744b292 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:47.303651 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-dec08b8d-0141-4485-b432-60e25744b292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:47.313071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec08b8d-0141-4485-b432-60e25744b292 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:47.318268 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:47.319395 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:47.319868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:47.320332 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] PATH_INFO: `/v3/projects/2df5d16edd154df4a5c4dc01eef618ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:47.321876 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=2df5d16edd154df4a5c4dc01eef618ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:47.323854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:47.470756 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2df5d16edd154df4a5c4dc01eef618ad', 'request_id': 'req-00a990b6-00af-4eaf-a1ea-060ce75856ab'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:47.477374 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2df5d16edd154df4a5c4dc01eef618ad', 'request_id': 'req-00a990b6-00af-4eaf-a1ea-060ce75856ab'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:47.483404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2df5d16edd154df4a5c4dc01eef618ad', 'request_id': 'req-00a990b6-00af-4eaf-a1ea-060ce75856ab'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:47.486204 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:47.576308 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] The token cache is being invalidate because project 2df5d16edd154df4a5c4dc01eef618ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:18:47.576659 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:47.577297 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:18:47.579984 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1442/2877] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:18:47 2022] DELETE /identity/v3/projects/2df5d16edd154df4a5c4dc01eef618ad => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:18:49.600693 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e8921-b785-4265-b1e0-36192ce7c447 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:18:49.602086 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-4a5e8921-b785-4265-b1e0-36192ce7c447 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:49.657624 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5e8921-b785-4265-b1e0-36192ce7c447 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:18:49.688860 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:49.706238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6348d2-1258-4b95-9a1f-79422e1c45e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:18:49.706890 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6348d2-1258-4b95-9a1f-79422e1c45e3 service cinder] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:18:49.707172 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6348d2-1258-4b95-9a1f-79422e1c45e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:18:49.707451 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6348d2-1258-4b95-9a1f-79422e1c45e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:18:49.709359 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5a6348d2-1258-4b95-9a1f-79422e1c45e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:18:49.775710 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6348d2-1258-4b95-9a1f-79422e1c45e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:18:49.777173 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6348d2-1258-4b95-9a1f-79422e1c45e3 service cinder] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:18:49.787625 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1436/2878] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:18:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:18:57.764828 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:DELETE=1,keystone:SELECT=2 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:18:59.783478 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=34 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:12.771754 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:12.773323 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:12.844868 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a990b6-00af-4eaf-a1ea-060ce75856ab admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:12.850023 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72569717-7104-409e-a9ef-13bb6eca99aa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e838dd9aa24f4571b64719125610c528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:12.850674 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72569717-7104-409e-a9ef-13bb6eca99aa service placement] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:12.850962 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72569717-7104-409e-a9ef-13bb6eca99aa service placement] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:12.851245 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72569717-7104-409e-a9ef-13bb6eca99aa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:12.853039 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-72569717-7104-409e-a9ef-13bb6eca99aa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:12.865451 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72569717-7104-409e-a9ef-13bb6eca99aa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:12.867049 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72569717-7104-409e-a9ef-13bb6eca99aa service placement] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:12.877264 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1443/2879] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:19:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:19:13.542352 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6348d2-1258-4b95-9a1f-79422e1c45e3 service cinder] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:13.544038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-5a6348d2-1258-4b95-9a1f-79422e1c45e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:13.610484 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6348d2-1258-4b95-9a1f-79422e1c45e3 service cinder] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:13.615044 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:13.615948 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:13.616231 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:13.616505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] PATH_INFO: `/v3/users/26556df02b1a4e88a78290833f356754` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:13.617701 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] RBAC: Authorizing `identity:delete_user(user_id=26556df02b1a4e88a78290833f356754)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:13.619642 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:13.859055 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26556df02b1a4e88a78290833f356754'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:13.871546 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26556df02b1a4e88a78290833f356754'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:13.872263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26556df02b1a4e88a78290833f356754'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:13.872875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26556df02b1a4e88a78290833f356754'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:13.946602 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26556df02b1a4e88a78290833f356754'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:13.959913 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1437/2880] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:19:13 2022] DELETE /identity/v3/users/26556df02b1a4e88a78290833f356754 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:14.212410 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72569717-7104-409e-a9ef-13bb6eca99aa service placement] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.226063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72569717-7104-409e-a9ef-13bb6eca99aa service placement] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.293830 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.294774 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.295063 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.295341 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] PATH_INFO: `/v3/projects/52be28f1cdee4c0490e4ee4696240876` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.296566 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=52be28f1cdee4c0490e4ee4696240876)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.298494 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:14.398847 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52be28f1cdee4c0490e4ee4696240876', 'request_id': 'req-06dd680e-d080-4739-b434-d5f7ca41a2cf'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:14.405179 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52be28f1cdee4c0490e4ee4696240876', 'request_id': 'req-06dd680e-d080-4739-b434-d5f7ca41a2cf'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:14.412415 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52be28f1cdee4c0490e4ee4696240876', 'request_id': 'req-06dd680e-d080-4739-b434-d5f7ca41a2cf'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:14.614836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] The token cache is being invalidate because project 52be28f1cdee4c0490e4ee4696240876 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:19:14.615133 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:14.615775 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:14.617366 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1444/2881] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:19:14 2022] DELETE /identity/v3/projects/52be28f1cdee4c0490e4ee4696240876 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:14.631262 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:14.631262 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:14.636557 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef2bfc-03a4-41e6-9b35-77e0451cd79d admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:14.694263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1242f001-c305-4819-86ba-a21efdd19278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:14.695152 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f001-c305-4819-86ba-a21efdd19278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:14.695434 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f001-c305-4819-86ba-a21efdd19278 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:14.695727 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1242f001-c305-4819-86ba-a21efdd19278 admin admin] PATH_INFO: `/v3/users/8d9347392bb3404da5fc7765adc590d9` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:14.697052 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242f001-c305-4819-86ba-a21efdd19278 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d9347392bb3404da5fc7765adc590d9)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:14.699038 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1242f001-c305-4819-86ba-a21efdd19278 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:14.721511 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:15.028240 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1242f001-c305-4819-86ba-a21efdd19278 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d9347392bb3404da5fc7765adc590d9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:15.041135 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1242f001-c305-4819-86ba-a21efdd19278 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d9347392bb3404da5fc7765adc590d9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:15.041813 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1242f001-c305-4819-86ba-a21efdd19278 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d9347392bb3404da5fc7765adc590d9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:15.042433 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1242f001-c305-4819-86ba-a21efdd19278 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d9347392bb3404da5fc7765adc590d9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:15.135458 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-1242f001-c305-4819-86ba-a21efdd19278 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d9347392bb3404da5fc7765adc590d9'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:15.148898 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1438/2882] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:19:14 2022] DELETE /identity/v3/users/8d9347392bb3404da5fc7765adc590d9 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:15.408392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.411221 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:15.423134 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd680e-d080-4739-b434-d5f7ca41a2cf admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:15.442258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:15.482856 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c9675-386c-4c77-a91b-92cf96d427c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:15.483724 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c9675-386c-4c77-a91b-92cf96d427c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.484034 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c9675-386c-4c77-a91b-92cf96d427c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.484314 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c9675-386c-4c77-a91b-92cf96d427c4 admin admin] PATH_INFO: `/v3/projects/7e4be43919fe4005a6ca8749f880eec2` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.485498 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c9675-386c-4c77-a91b-92cf96d427c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e4be43919fe4005a6ca8749f880eec2)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:15.487404 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1c9675-386c-4c77-a91b-92cf96d427c4 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:15.742052 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-be1c9675-386c-4c77-a91b-92cf96d427c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e4be43919fe4005a6ca8749f880eec2', 'request_id': 'req-be1c9675-386c-4c77-a91b-92cf96d427c4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:15.748294 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-be1c9675-386c-4c77-a91b-92cf96d427c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e4be43919fe4005a6ca8749f880eec2', 'request_id': 'req-be1c9675-386c-4c77-a91b-92cf96d427c4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:15.754640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-be1c9675-386c-4c77-a91b-92cf96d427c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e4be43919fe4005a6ca8749f880eec2', 'request_id': 'req-be1c9675-386c-4c77-a91b-92cf96d427c4'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:15.826776 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-be1c9675-386c-4c77-a91b-92cf96d427c4 admin admin] The token cache is being invalidate because project 7e4be43919fe4005a6ca8749f880eec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:19:15.827071 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-be1c9675-386c-4c77-a91b-92cf96d427c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:15.827716 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-be1c9675-386c-4c77-a91b-92cf96d427c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:15.829318 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1445/2883] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:19:15 2022] DELETE /identity/v3/projects/7e4be43919fe4005a6ca8749f880eec2 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 23 11:19:15.834325 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae810e33-3a00-428c-8c04-a4a2b9a7a2db None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.834795 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae810e33-3a00-428c-8c04-a4a2b9a7a2db None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.834795 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae810e33-3a00-428c-8c04-a4a2b9a7a2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.852733 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-ae810e33-3a00-428c-8c04-a4a2b9a7a2db None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:15.853935 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-ae810e33-3a00-428c-8c04-a4a2b9a7a2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:15.913505 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1439/2884] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:19:15.921264 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54ff6b-f562-4664-9474-01f95a89c1a0 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.921554 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54ff6b-f562-4664-9474-01f95a89c1a0 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.921836 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b54ff6b-f562-4664-9474-01f95a89c1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.941726 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-0b54ff6b-f562-4664-9474-01f95a89c1a0 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:15.942954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0b54ff6b-f562-4664-9474-01f95a89c1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:15.950994 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1446/2885] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:19:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:19:15.955556 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae810e33-3a00-428c-8c04-a4a2b9a7a2db None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:15.965316 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae810e33-3a00-428c-8c04-a4a2b9a7a2db None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:15.969891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33799e97-54e8-4179-ac3c-1eed8ceb8b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:15.971054 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33799e97-54e8-4179-ac3c-1eed8ceb8b95 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:15.971337 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33799e97-54e8-4179-ac3c-1eed8ceb8b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:15.971626 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33799e97-54e8-4179-ac3c-1eed8ceb8b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:15.972362 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33799e97-54e8-4179-ac3c-1eed8ceb8b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=75630) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 23 11:19:15.972667 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33799e97-54e8-4179-ac3c-1eed8ceb8b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:15.974269 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33799e97-54e8-4179-ac3c-1eed8ceb8b95 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:15.986891 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1440/2886] 10.222.0.52 () {58 vars in 1152 bytes} [Thu Jun 23 11:19:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 23 11:19:15.991525 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54ff6b-f562-4664-9474-01f95a89c1a0 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.001091 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b54ff6b-f562-4664-9474-01f95a89c1a0 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.005704 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d2059-0431-489d-bea0-d46ffe99d806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.006347 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d2059-0431-489d-bea0-d46ffe99d806 admin admin] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.006629 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d2059-0431-489d-bea0-d46ffe99d806 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.006903 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d2059-0431-489d-bea0-d46ffe99d806 admin admin] PATH_INFO: `/v3/projects` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.007588 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d2059-0431-489d-bea0-d46ffe99d806 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.009543 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d2059-0431-489d-bea0-d46ffe99d806 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.131954 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1447/2887] 10.222.0.52 () {60 vars in 1152 bytes} [Thu Jun 23 11:19:15 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:19:16.145939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33799e97-54e8-4179-ac3c-1eed8ceb8b95 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.156002 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33799e97-54e8-4179-ac3c-1eed8ceb8b95 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.212455 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea07dd5-ab70-4c18-804e-25dac339afdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.213118 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea07dd5-ab70-4c18-804e-25dac339afdb admin admin] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.213425 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea07dd5-ab70-4c18-804e-25dac339afdb admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.213674 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea07dd5-ab70-4c18-804e-25dac339afdb admin admin] PATH_INFO: `/v3/users` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.214358 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea07dd5-ab70-4c18-804e-25dac339afdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.216310 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea07dd5-ab70-4c18-804e-25dac339afdb admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.382467 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1441/2888] 10.222.0.52 () {60 vars in 1143 bytes} [Thu Jun 23 11:19:16 2022] POST /identity/v3/users => generated 287 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 23 11:19:16.386705 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d2059-0431-489d-bea0-d46ffe99d806 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.397640 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d2059-0431-489d-bea0-d46ffe99d806 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.403586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b51ee2-03c3-405e-9640-0bd84092d690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.403586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51ee2-03c3-405e-9640-0bd84092d690 admin admin] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.403586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51ee2-03c3-405e-9640-0bd84092d690 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.403953 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b51ee2-03c3-405e-9640-0bd84092d690 admin admin] PATH_INFO: `/v3/roles` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.404455 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b51ee2-03c3-405e-9640-0bd84092d690 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.405996 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b51ee2-03c3-405e-9640-0bd84092d690 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.418072 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1448/2889] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 23 11:19:16.422250 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea07dd5-ab70-4c18-804e-25dac339afdb admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.433419 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea07dd5-ab70-4c18-804e-25dac339afdb admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.438209 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c323d-321a-4743-86fc-887d4cde3890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.438875 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c323d-321a-4743-86fc-887d4cde3890 admin admin] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.439153 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c323d-321a-4743-86fc-887d4cde3890 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.439428 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c323d-321a-4743-86fc-887d4cde3890 admin admin] PATH_INFO: `/v3/roles` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.440218 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c323d-321a-4743-86fc-887d4cde3890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.441817 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486c323d-321a-4743-86fc-887d4cde3890 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.452040 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1442/2890] 10.222.0.52 () {58 vars in 1121 bytes} [Thu Jun 23 11:19:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 23 11:19:16.456814 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b51ee2-03c3-405e-9640-0bd84092d690 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.467307 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b51ee2-03c3-405e-9640-0bd84092d690 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.472664 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a4a35-b00b-41d3-960a-201cbddb737d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.473552 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a4a35-b00b-41d3-960a-201cbddb737d admin admin] REQUEST_METHOD: `PUT` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.473832 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a4a35-b00b-41d3-960a-201cbddb737d admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.474110 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3a4a35-b00b-41d3-960a-201cbddb737d admin admin] PATH_INFO: `/v3/projects/cd9995a34c1b4d08b83e56627b1ced6d/users/5281ce5cf94a4ffdbc5323f57057d406/roles/7a7c8cc02f174648b814192cba5506ad` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.488930 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a4a35-b00b-41d3-960a-201cbddb737d admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd9995a34c1b4d08b83e56627b1ced6d, user_id=5281ce5cf94a4ffdbc5323f57057d406, role_id=7a7c8cc02f174648b814192cba5506ad)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.491587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3a4a35-b00b-41d3-960a-201cbddb737d admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.564723 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1449/2891] 10.222.0.52 () {60 vars in 1482 bytes} [Thu Jun 23 11:19:16 2022] PUT /identity/v3/projects/cd9995a34c1b4d08b83e56627b1ced6d/users/5281ce5cf94a4ffdbc5323f57057d406/roles/7a7c8cc02f174648b814192cba5506ad => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:16.574942 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c591eb-184c-4198-85c6-934e85cec72c None None] REQUEST_METHOD: `POST` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.575711 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c591eb-184c-4198-85c6-934e85cec72c None None] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.576020 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c591eb-184c-4198-85c6-934e85cec72c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.584263 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:16.612609 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.auth.core [None req-28c591eb-184c-4198-85c6-934e85cec72c None None] MFA Rules not processed for user `5281ce5cf94a4ffdbc5323f57057d406`. Rule list: `[]` (Enabled: `True`). {{(pid=75630) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:16.614766 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-28c591eb-184c-4198-85c6-934e85cec72c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:16.685049 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1443/2892] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:19:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:19:16.696196 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a4a35-b00b-41d3-960a-201cbddb737d admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.698048 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-0f3a4a35-b00b-41d3-960a-201cbddb737d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:16.750101 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:16.755931 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3a4a35-b00b-41d3-960a-201cbddb737d admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.759646 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12646aa7-3ef6-4f98-85fc-54fbb7cdeaf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '71539f69f3c8446ca7e9833d244d20fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.760257 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12646aa7-3ef6-4f98-85fc-54fbb7cdeaf5 service cinder] REQUEST_METHOD: `GET` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.760540 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12646aa7-3ef6-4f98-85fc-54fbb7cdeaf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.760813 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12646aa7-3ef6-4f98-85fc-54fbb7cdeaf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.769865 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12646aa7-3ef6-4f98-85fc-54fbb7cdeaf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.771296 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12646aa7-3ef6-4f98-85fc-54fbb7cdeaf5 service cinder] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:16.780717 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1450/2893] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:19:16 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:19:16.800939 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c591eb-184c-4198-85c6-934e85cec72c None None] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:16.862663 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c591eb-184c-4198-85c6-934e85cec72c None None] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:16.867684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:16.868575 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:16.868919 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:16.869139 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] PATH_INFO: `/v3/users/5281ce5cf94a4ffdbc5323f57057d406` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:16.870786 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5281ce5cf94a4ffdbc5323f57057d406)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:16.872764 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:17.045860 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5281ce5cf94a4ffdbc5323f57057d406'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:17.058355 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5281ce5cf94a4ffdbc5323f57057d406'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:17.059046 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5281ce5cf94a4ffdbc5323f57057d406'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:17.059755 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5281ce5cf94a4ffdbc5323f57057d406'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:17.147204 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5281ce5cf94a4ffdbc5323f57057d406'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:17.160142 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1444/2894] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:19:16 2022] DELETE /identity/v3/users/5281ce5cf94a4ffdbc5323f57057d406 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:17.164894 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1e902-e0d2-44ee-8daf-55d4f7062bf6 None None] REQUEST_METHOD: `POST` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.165190 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1e902-e0d2-44ee-8daf-55d4f7062bf6 None None] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.165476 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1e902-e0d2-44ee-8daf-55d4f7062bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:17.183178 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.auth.core [None req-f4b1e902-e0d2-44ee-8daf-55d4f7062bf6 None None] MFA Rules not processed for user `42a7a441efc44b648a036ca3257b9aad`. Rule list: `[]` (Enabled: `True`). {{(pid=75629) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 23 11:19:17.184432 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f4b1e902-e0d2-44ee-8daf-55d4f7062bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:17.242382 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1451/2895] 10.222.0.52 () {58 vars in 957 bytes} [Thu Jun 23 11:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 23 11:19:17.252870 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:17.254283 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:17.268601 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:17.311974 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242bd7f-0c89-4563-a9b2-6eedd142b8b7 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:17.319421 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4f5d2-da33-450f-96a4-4d30efb86620 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2d903a8e2ce4489fa7f5b7479ff0b7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:17.319421 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4f5d2-da33-450f-96a4-4d30efb86620 service neutron] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.319421 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4f5d2-da33-450f-96a4-4d30efb86620 service neutron] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.319421 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a4f5d2-da33-450f-96a4-4d30efb86620 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:17.326813 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4f5d2-da33-450f-96a4-4d30efb86620 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:17.328315 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a4f5d2-da33-450f-96a4-4d30efb86620 service neutron] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:17.338024 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1445/2896] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:19:17.771653 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1e902-e0d2-44ee-8daf-55d4f7062bf6 None None] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:19:17.773159 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-f4b1e902-e0d2-44ee-8daf-55d4f7062bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:19:17.785949 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1e902-e0d2-44ee-8daf-55d4f7062bf6 None None] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:19:17.791291 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:19:17.792217 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:19:17.792504 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:19:17.792784 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] PATH_INFO: `/v3/projects/cd9995a34c1b4d08b83e56627b1ced6d` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:19:17.794020 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd9995a34c1b4d08b83e56627b1ced6d)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:19:17.795990 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:19:17.914293 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd9995a34c1b4d08b83e56627b1ced6d', 'request_id': 'req-629d280a-205e-4b05-a1d6-0ef7e868cf51'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:17.920619 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd9995a34c1b4d08b83e56627b1ced6d', 'request_id': 'req-629d280a-205e-4b05-a1d6-0ef7e868cf51'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:17.926131 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd9995a34c1b4d08b83e56627b1ced6d', 'request_id': 'req-629d280a-205e-4b05-a1d6-0ef7e868cf51'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:18.014682 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] The token cache is being invalidate because project cd9995a34c1b4d08b83e56627b1ced6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:19:18.014970 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:18.015595 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:19:18.017200 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1452/2897] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:19:17 2022] DELETE /identity/v3/projects/cd9995a34c1b4d08b83e56627b1ced6d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:19:27.398938 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=20 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:19:28.011495 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=59,keystone:DELETE=7,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:20.990356 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4f5d2-da33-450f-96a4-4d30efb86620 service neutron] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:20.991849 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-d3a4f5d2-da33-450f-96a4-4d30efb86620 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:21.006896 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a4f5d2-da33-450f-96a4-4d30efb86620 service neutron] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:21.064454 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:21.065315 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:21.065597 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:21.065869 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] PATH_INFO: `/v3/users/f207186e394a4d1eb89451314d1e2e7e` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:21.067561 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f207186e394a4d1eb89451314d1e2e7e)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:21.069589 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:21.314197 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f207186e394a4d1eb89451314d1e2e7e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:21.326279 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f207186e394a4d1eb89451314d1e2e7e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:21.326958 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f207186e394a4d1eb89451314d1e2e7e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:21.327562 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f207186e394a4d1eb89451314d1e2e7e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:21.383409 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f207186e394a4d1eb89451314d1e2e7e'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:21.397083 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1446/2898] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:20:20 2022] DELETE /identity/v3/users/f207186e394a4d1eb89451314d1e2e7e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:20:21.650258 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:21.652302 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:21.665857 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629d280a-205e-4b05-a1d6-0ef7e868cf51 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:21.732001 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:21.732862 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:21.733144 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:21.733413 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] PATH_INFO: `/v3/projects/649ba0b239424b72b1bbed1e372e4905` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:21.734586 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=649ba0b239424b72b1bbed1e372e4905)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:21.736531 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:21.886604 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '649ba0b239424b72b1bbed1e372e4905', 'request_id': 'req-cd970916-4ba2-46f8-ab8c-4a97991a6b97'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:21.892854 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '649ba0b239424b72b1bbed1e372e4905', 'request_id': 'req-cd970916-4ba2-46f8-ab8c-4a97991a6b97'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:21.898480 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '649ba0b239424b72b1bbed1e372e4905', 'request_id': 'req-cd970916-4ba2-46f8-ab8c-4a97991a6b97'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:22.005951 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] The token cache is being invalidate because project 649ba0b239424b72b1bbed1e372e4905 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:20:22.006263 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:22.007174 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:22.008770 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1453/2899] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:20:21 2022] DELETE /identity/v3/projects/649ba0b239424b72b1bbed1e372e4905 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:20:22.012776 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:22.014238 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:22.027584 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7a54b3-5a16-4bb4-8ccb-dd5afbe71bfb admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:22.083045 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:22.083931 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:22.084215 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:22.084489 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] PATH_INFO: `/v3/users/ca5eade4bf1c4984a218500a04f1cadd` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:22.085684 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca5eade4bf1c4984a218500a04f1cadd)` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:22.087618 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:22.109273 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:22.337643 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca5eade4bf1c4984a218500a04f1cadd'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:22.350854 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca5eade4bf1c4984a218500a04f1cadd'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:22.351571 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca5eade4bf1c4984a218500a04f1cadd'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:22.352202 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca5eade4bf1c4984a218500a04f1cadd'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:22.437384 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.notifications [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca5eade4bf1c4984a218500a04f1cadd'} {{(pid=75630) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:22.450391 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1447/2900] 10.222.0.52 () {58 vars in 1223 bytes} [Thu Jun 23 11:20:22 2022] DELETE /identity/v3/users/ca5eade4bf1c4984a218500a04f1cadd => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:20:22.753249 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] Authenticating user token {{(pid=75629) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:20:22.755369 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.fernet_utils [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75629) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:20:22.772322 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd970916-4ba2-46f8-ab8c-4a97991a6b97 admin admin] Validating token access rules against request {{(pid=75629) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:20:22.829447 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f9ff66-7618-4f13-9326-4152ebc12cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '42a7a441efc44b648a036ca3257b9aad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '38b92a57b84f432b87f291c46bdda9ea', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75629) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:20:22.830304 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9ff66-7618-4f13-9326-4152ebc12cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:20:22.830587 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9ff66-7618-4f13-9326-4152ebc12cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:20:22.830859 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9ff66-7618-4f13-9326-4152ebc12cc9 admin admin] PATH_INFO: `/v3/projects/5efe039d6a2b4563a26c1dcfa6c17663` {{(pid=75629) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:20:22.832087 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9ff66-7618-4f13-9326-4152ebc12cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5efe039d6a2b4563a26c1dcfa6c17663)` {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:20:22.834684 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f9ff66-7618-4f13-9326-4152ebc12cc9 admin admin] RBAC: Authorization granted {{(pid=75629) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:20:22.975185 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:22.986987 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f0f9ff66-7618-4f13-9326-4152ebc12cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5efe039d6a2b4563a26c1dcfa6c17663', 'request_id': 'req-f0f9ff66-7618-4f13-9326-4152ebc12cc9'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:22.994101 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f0f9ff66-7618-4f13-9326-4152ebc12cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5efe039d6a2b4563a26c1dcfa6c17663', 'request_id': 'req-f0f9ff66-7618-4f13-9326-4152ebc12cc9'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:23.003108 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f0f9ff66-7618-4f13-9326-4152ebc12cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5efe039d6a2b4563a26c1dcfa6c17663', 'request_id': 'req-f0f9ff66-7618-4f13-9326-4152ebc12cc9'} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:23.085392 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f0f9ff66-7618-4f13-9326-4152ebc12cc9 admin admin] The token cache is being invalidate because project 5efe039d6a2b4563a26c1dcfa6c17663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=75629) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 23 11:20:23.085681 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f0f9ff66-7618-4f13-9326-4152ebc12cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:23.086320 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG keystone.notifications [None req-f0f9ff66-7618-4f13-9326-4152ebc12cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=75629) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 23 11:20:23.087937 dv-cinder-826607-6-smb devstack@keystone.service[75629]: [pid: 75629|app: 0|req: 1454/2901] 10.222.0.52 () {58 vars in 1232 bytes} [Thu Jun 23 11:20:22 2022] DELETE /identity/v3/projects/5efe039d6a2b4563a26c1dcfa6c17663 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 23 11:20:32.446748 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:20:33.163167 dv-cinder-826607-6-smb devstack@keystone.service[75629]: DEBUG dbcounter [-] [75629] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=75629) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:23:35.430723 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] Authenticating user token {{(pid=75630) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 23 11:23:35.432226 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:35.570745 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a01e86-ac21-4844-8fcd-cbece01653a2 admin admin] Validating token access rules against request {{(pid=75630) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 23 11:23:35.636016 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf702c8-fe77-43e0-9bd8-18889ead715a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e838dd9aa24f4571b64719125610c528', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd27530ca8f8e4156a519c726bd98c2a0', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75630) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 23 11:23:35.636665 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf702c8-fe77-43e0-9bd8-18889ead715a service placement] REQUEST_METHOD: `GET` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 23 11:23:35.636949 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf702c8-fe77-43e0-9bd8-18889ead715a service placement] SCRIPT_NAME: `/identity` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 23 11:23:35.637232 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf702c8-fe77-43e0-9bd8-18889ead715a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=75630) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 23 11:23:35.639029 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.fernet_utils [None req-acf702c8-fe77-43e0-9bd8-18889ead715a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=75630) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 23 11:23:35.650272 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf702c8-fe77-43e0-9bd8-18889ead715a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 23 11:23:35.651889 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf702c8-fe77-43e0-9bd8-18889ead715a service placement] RBAC: Authorization granted {{(pid=75630) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 23 11:23:35.662336 dv-cinder-826607-6-smb devstack@keystone.service[75630]: [pid: 75630|app: 0|req: 1448/2902] 10.222.0.52 () {60 vars in 1365 bytes} [Thu Jun 23 11:23:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 23 11:23:45.658607 dv-cinder-826607-6-smb devstack@keystone.service[75630]: DEBUG dbcounter [-] [75630] Writing DB stats keystone:SELECT=89 {{(pid=75630) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}